Open Systems, Blockchain & Business Daily

OSBBD

AI, money and the software behind them.

Llama 3.3 70B

Llama 3.3 70B is an open-weight language model from Meta, released on December 6, 2024. It is a dense model with 70B parameters. Meta lists a context window of 128K tokens. The model takes text input.

Developer
Meta
Released
December 6, 2024
Total parameters
70B
Architecture
Dense
Context window
128K
Input
Text
License
Llama 3.3 Community License
Commercial use
Yes, with conditions
Official weights, GB
141.1 GB
Hugging Face repository
huggingface.co
Checked on

The weights are released under the Llama 3.3 Community License. Commercial use is allowed with conditions. Companies whose products had more than 700 million monthly active users on the release date need a separate license from Meta. Products must display “Built with Llama”, model names derived from it must start with “Llama”, and the Llama Acceptable Use Policy applies.

The official weights on Hugging Face take about 141 GB in BF16. Running the model needs at least that much memory across GPUs and system RAM, plus room for the context cache; quantized versions need less.

Total parameters, billions
70B
Context window, tokens
128K
License type
Custom license
License conditions
Companies whose products had more than 700 million monthly active users on the release date need a separate license from Meta. Products must display "Built with Llama", model names derived from it must start with "Llama", and the Llama Acceptable Use Policy applies.
Weights precision
BF16
License text
github.com
Sources
PageURL
Hugging Face model pagehttps://huggingface.co/meta-llama/Llama-3.3-70B-Instruct
Hugging Face APIhttps://huggingface.co/api/models/meta-llama/Llama-3.3-70B-Instruct?expand=safetensors
OSBBD

What are you looking for?

Search by headline, topic or keyword.