Lit-LLaMA ️ Homepage, Documentation and Downloads – Language Model Based on nanoGPT – News Fast Delivery
Lit-LLaMA is an implementation of the nanoGPT-based LLaMA language model that supports quantization, LoRA fine-tuning, and pre-training. Design Principles Simple: single file implementation, no boilerplate code Correct: Numerically equivalent to the original model Optimized: run on consumer hardware or at scale Open source: no strings attached set up Clone repository […]