AIster · The model wars · Launches
Meta releases Llama 3
Meta pitches downloadable models as the best open source options in their class
Key facts
- Date
- 18 Apr 2024
- Era
- The model wars
- Interest
- Launches
- Threads
- Open vs closed
- Who
- Meta
- Sizes
- 8B and 70B, pretrained and instruction-tuned
- Training data
- Over 15 trillion tokens
Meta released Llama 3 in 8-billion and 70-billion-parameter versions (parameters are the internal settings a model learns), trained on over 15 trillion tokens (small chunks of text), with weights (the model files) available to download under Meta's licence. It called them the best open source models of their class and said larger versions of over 400 billion parameters were still in training.
Sources
- Meta, Introducing Meta Llama 3: The most capable openly available LLM to date, 2024-04-18