Automatic Speech Recognition
Transformers
Safetensors
phi4mm
text-generation
nlp
code
audio
speech-summarization
speech-translation
visual-question-answering
phi-4-multimodal
phi
phi-4-mini
custom_code
Eval Results
Instructions to use microsoft/Phi-4-multimodal-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/Phi-4-multimodal-instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="microsoft/Phi-4-multimodal-instruct", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-4-multimodal-instruct", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
fix loading processor after save_pretrained with transformers 4.49+
Verified signaturesave_pretrained additionally save chat_template.json file and trying to load it into processor, but there is no field for this argument. As the result we got File "~/python3.11/site-packages/transformers/processing_utils.py", line 868, in from_args_and_dict processor = cls(*args, **processor_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: Phi4MMProcessor.__init__() got an unexpected keyword argument 'chat_template' the same issue also visible in phi-3-vision and phi-3.5-vision9ae38d6
-
Added model files
d93d2f6