Llama 3.1 405B
Llama 3.1 405B is an open-weight language model from Meta, released on July 23, 2024. It is a dense model with 405B parameters. Meta lists a context window of 128K tokens. The model takes text input.
- Developer
- Meta
- Released
- July 23, 2024
- Total parameters
- 405B
- Architecture
- Dense
- Context window
- 128K
- Input
- Text
- License
- Llama 3.1 Community License
- Commercial use
- Yes, with conditions
- Official weights, GB
- 811.7 GB
- Hugging Face repository
- huggingface.co
- Checked on
The weights are released under the Llama 3.1 Community License. Commercial use is allowed with conditions. Companies whose products had more than 700 million monthly active users need a separate license from Meta, and the Llama Acceptable Use Policy applies.
The official weights on Hugging Face take about 812 GB in BF16. Running the model needs at least that much memory across GPUs and system RAM, plus room for the context cache; quantized versions need less.
- Total parameters, billions
- 405B
- Context window, tokens
- 128K
- License type
- Custom license
- License conditions
- Companies whose products had more than 700 million monthly active users need a separate license from Meta, and the Llama Acceptable Use Policy applies.
- Weights precision
- BF16
- Official quantized or alternative versions
- meta-llama/Llama-3.1-405B-Instruct-FP8
- License text
- github.com
- Sources
Page URL Hugging Face model page https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct Hugging Face API https://huggingface.co/api/models/meta-llama/Llama-3.1-405B-Instruct?expand=safetensors Hugging Face API https://huggingface.co/api/models?author=meta-llama&search=FP8