awesome-code.md

https://github.com/karpathy

1. Get Code - git clone https://github.com/karpathy/nanoGPT.git
2. Get Data - python data/shakespeare_char/prepare.py
3. Get PyTorch Nightly - pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu
4. Training/ I have a Apple M1 - python train.py config/train_shakespeare_char.py --device=mps --compile=False (Ctrl+C to stop!)
5. Generating Text - python sample.py --out_dir=out-shakespeare-char --device=mps
6. Get Data - python data/openwebtext/prepare.py
7. Training/ I have a Apple M1 - python3 train.py --batch_size=32 --device=mps --compile=False

The Alignment Handbook - https://github.com/huggingface/alignment-handbook

Hackable implementation of state-of-the-art open-source large language models - https://github.com/mozilla-ai/lit-gpt

Better data, better AI - https://github.com/lilacai/lilac

Structured data extraction in PHP - https://github.com/adrienbrault/instructor-php

https://github.com/vbwyrde/DSPY_VBWyrde

https://github.com/boxabirds/pytorch2mlx

--

• DeepMind
• AI2
• LMSYS
• ml-explore
• NousResearch

--

https://github.com/bigcode-project

• https://huggingface.co/blog/starcoder

S/W Agent capable of writing Go plugins (specs TBD, this looks interesting https://www.benthos.dev/blog/2021/10/12/new-plugins-stable)

Exploring these repos currently:

• https://github.com/princeton-nlp/SWE-agent
• https://github.com/stitionai/devika
• https://github.com/OpenDevin/OpenDevin

--

• https://medium.com/snowflake/mistral-snowflake-the-new-frontier-in-sql-copilot-products-f71b8a939899