OpenLLaMA is an open source rendition of Meta AI’s LLaMA large language model under a permissive license.

The repository contains a public preview of the trained 200 billion token 7B OpenLLaMA model, and provides PyTorch and Jax weights for the pretrained OpenLLaMA model, as well as evaluation results and comparisons to the original LLaMA model.