Open Systems, Blockchain & Business Daily

OSBBD

AI, money and the software behind them.

Llama 3.3 70B

Llama 3.3 70B is an open-weight language model from Meta, released on December 6, 2024.

Developer
Meta
Released
December 6, 2024
Total parameters
70B
Architecture
Dense
Context window
128K
Input
Text
License
Llama 3.3 Community License
Commercial use
Yes, with conditions
Official weights, GB
141.1 GB
Hugging Face repository
huggingface.co
Checked on

Llama 3.3 70B is a dense model with 70B parameters. Meta lists a context window of 128K tokens. The model takes text input. The weights are released under the Llama 3.3 Community License. Commercial use is allowed with conditions. Companies whose products had more than 700 million monthly active users on the release date need a separate license from Meta. Products must display “Built with Llama”, model names derived from it must start with “Llama”, and the Llama Acceptable Use Policy applies.

The official weights on Hugging Face take about 141 GB in BF16. Running the model needs at least that much memory across GPUs and system RAM, plus room for the context cache; quantized versions need less.

Total parameters, billions
70B
Context window, tokens
128K
License type
Custom license
License conditions
Companies whose products had more than 700 million monthly active users on the release date need a separate license from Meta. Products must display "Built with Llama", model names derived from it must start with "Llama", and the Llama Acceptable Use Policy applies.
Weights precision
BF16
License text
github.com
Sources
PageURL
Hugging Face model pagehttps://huggingface.co/meta-llama/Llama-3.3-70B-Instruct
Hugging Face APIhttps://huggingface.co/api/models/meta-llama/Llama-3.3-70B-Instruct?expand=safetensors

Questions

What license does Llama 3.3 70B use?
The weights are released under the Llama 3.3 Community License.
Can I use Llama 3.3 70B commercially?
Yes, with conditions. Companies whose products had more than 700 million monthly active users on the release date need a separate license from Meta. Products must display “Built with Llama”, and derived model names must start with “Llama”.
How much memory does Llama 3.3 70B need?
The official BF16 weights take about 141 GB. A 70B model needs about 70 GB at 8 bits and about 39 GB at 4 bits for the weights alone; the memory calculator checks which setups fit.
How many parameters does Llama 3.3 70B have?
Llama 3.3 70B is a dense model with 70B parameters and a context window of 128K tokens.

Sources

Every figure comes from the developer’s model card, license text and official announcements, and from the model’s Hugging Face repository metadata. Each model page lists its sources and the date they were checked; the register is rechecked every week.

OSBBD

What are you looking for?

Search by headline, topic or keyword.