The Llama 3 Herd of Models

arXiv:2407.21783

Meta AI

We present Llama 3, a family of foundation models that support multilinguality, coding, reasoning, and tool use. We detail pretraining data mixtures, scaling laws, post-training alignment, and safety evaluations across 8B, 70B, and 405B parameter models.