The LLaMA Ecosystem

Meta’s LLaMA is one of the most popular families of large language models. Its non-commercial license and easy-to-obtain weights made it one of the most used open-source models in academia and beyond. A look at the ecosystem that’s developed:

Fine-tuned offshoots

• Replicated, but under a permissive license — RedPajama, OpenLLaMA, OpenAlpaca,
• Instruction-following model — Alpaca
• Chatbot Model — Vicuna, Koala, Orca
• More training data for different languages — Chinese-LLaMA-Alpaca
• Quantization of LLaMA — GPTQ-for-LLaMA
• Fine-tune on consumer hardware (with LoRA) — Alpaca-lora
• Training data from other LLMs — WizardLM
• “Uncensored” training data — WizardLM-Uncensored

Tools to run LLaMA

• llama.cpp — port of LLaMA in pure C/C++
• dalai — a command line tool that makes it easy to run llama locally
• chat.matt-rickard.com — WebGPU accelerated Vicuna in the browser