Phi-4
Phi-4 is an open-weight language model from Microsoft, released on December 12, 2024. It is a dense model with 14B parameters. Microsoft lists a context window of 16K tokens. The model takes text input.
- Developer
- Microsoft
- Released
- December 12, 2024
- Total parameters
- 14B
- Architecture
- Dense
- Context window
- 16K
- Input
- Text
- License
- MIT
- Commercial use
- Yes
- Official weights, GB
- 29.3 GB
- Hugging Face repository
- huggingface.co
- Checked on
The weights are released under the MIT license, which allows commercial use.
The official weights on Hugging Face take about 29.3 GB in BF16. Running the model needs at least that much memory across GPUs and system RAM, plus room for the context cache; quantized versions need less.
- Total parameters, billions
- 14B
- Context window, tokens
- 16K
- License type
- MIT
- License conditions
- MIT: keep the copyright and permission notice.
- Weights precision
- BF16
- Official quantized or alternative versions
- microsoft/phi-4-gguf; microsoft/phi-4-onnx
- License text
- huggingface.co
- Sources
Page URL Hugging Face model card https://huggingface.co/microsoft/phi-4/raw/main/README.md Hugging Face API https://huggingface.co/api/models/microsoft/phi-4?expand=safetensors