Instructions to use microsoft/Phi-4-mini-flash-reasoning with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/Phi-4-mini-flash-reasoning with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="microsoft/Phi-4-mini-flash-reasoning", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-4-mini-flash-reasoning", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use microsoft/Phi-4-mini-flash-reasoning with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "microsoft/Phi-4-mini-flash-reasoning" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "microsoft/Phi-4-mini-flash-reasoning", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/microsoft/Phi-4-mini-flash-reasoning
- SGLang
How to use microsoft/Phi-4-mini-flash-reasoning with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "microsoft/Phi-4-mini-flash-reasoning" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "microsoft/Phi-4-mini-flash-reasoning", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "microsoft/Phi-4-mini-flash-reasoning" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "microsoft/Phi-4-mini-flash-reasoning", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use microsoft/Phi-4-mini-flash-reasoning with Docker Model Runner:
docker model run hf.co/microsoft/Phi-4-mini-flash-reasoning
Commit History
-
Improve model card: Add paper abstract for Phi-4-mini-flash-reasoning
Verified signatureHi team, This PR aims to improve the model card for `microsoft/Phi-4-mini-flash-reasoning` by adding the paper's abstract directly into the Markdown content. This provides users with a more immediate and comprehensive understanding of the model's research context and contributions without needing to click through to external links. The current model card already includes links to the paper and the GitHub repository, as well as clear sample usage and correct metadata. This change focuses on enriching the "paper" information as specified in our model card guidelines. Please let me know if any adjustments are needed! Thanks, Niels0868e47
-
Update README.md
Verified signature486d7c3
-
Update README.md
Verified signaturefc31dd3 -
Add training codebase link mentioned in paper abstract (#3)
Verified signature- Add training codebase link mentioned in paper abstract (9ac7b4e63e418ac9c012a69587ff1dde6d3050d2) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>dcf4f08
-
Update README.md
Verified signature0c2b39f
-
Update README.md
Verified signature98fd671
-
Update README.md
Verified signature98a8001 -
Update README.md
Verified signature43aab46 -
Upload Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signaturea830f22 -
Delete Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation.pdf
Verified signatureb5116f9 -
Delete Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signature6f94ac5 -
Upload Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation.pdf
Verified signatured847d2d
-
Update README.md
Verified signatureb240aa7 -
Update README.md
Verified signature5140046 -
Upload Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signatureebfff50 -
Upload Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signature375bfc2
-
Upload Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signaturecca57de -
Delete Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation.pdf
Verified signature9444ff6 -
Upload Decoder_Hybrid_Decoder_Architecture_for_Efficient_Reasoning_with_Long_Generation.pdf
Verified signature6d6acda
-
Upload Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation.pdf
Verified signature1f8307a -
Update README.md
Verified signature1f168f5 -
Update README.md
Verified signaturecddb27e -
Update README.md
Verified signaturee49b6ce
-
Update README.md
Verified signaturea24e8b9
-
Update README.md
Verified signature44171ba
-
Update README.md
Verified signaturef1114ff
-
Update README.md
Verified signatureed7b17d -
Update README.md
Verified signaturea5d1907 -
Update README.md
Verified signature2840921 -
Update README.md
Verified signaturef3746df -
Update README.md
Verified signature5bf09df
-
Update README.md
Verified signature068f2c0 -
Update README.md
Verified signature452fd5f -
Upload README.md
Verified signaturea892bba -
Upload 3 files
Verified signature47c33b0 -
Upload 5 files
Verified signature0fdaec1 -
Upload 3 files
Verified signature3c17a22 -
Upload 12 files
Verified signature86604fc
-
initial commit
Verified signature590843e