Any-to-Any
Transformers
Safetensors
multilingual
minicpmo
feature-extraction
minicpm-o
omni
vision
ocr
multi-image
video
custom_code
audio
speech
voice cloning
live Streaming
realtime speech conversation
asr
tts
Instructions to use openbmb/MiniCPM-o-2_6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openbmb/MiniCPM-o-2_6 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signature9da79ac
-
Update README.md
Verified signature40fb6f3
-
Update resampler.py (#45)
Verified signature- Update resampler.py (585890d29b440e43c32ad8fedb5a8579aa244be1) - Update resampler.py (dd98ddb3845e288e3f7e2abf0d25f3eedbdf5d1c) Co-authored-by: Ekaterina Aidova <katuni4ka@users.noreply.huggingface.co>1758aee -
Make model compatible with Transformers v4.49.0 (#40)
Verified signature- Make model compatible with Transformers v4.49.0 (ae440694f5af374760e184d6c45b5a8ec4f67301) Co-authored-by: Harry Mellor <hmellor@users.noreply.huggingface.co>58b0fd1
-
Supports MacOS in MiniCPM-o 2.6 (#19)
Verified signature- Supports MacOS in MiniCPM-o 2.6 (1ceb0cbfa4dd6c40d2d504994a50afd210222039) Co-authored-by: Richard Fang <wanderor@users.noreply.huggingface.co>df3d4c9
-
Update README.md
Verified signature9a8db9d
-
Delete assets/qa.wav
Verified signature33bfc71 -
Delete assets/mimick.wav
Verified signaturea535950 -
Update README.md
Verified signature4dedb07 -
Upload assistant_female_voice.wav
Verified signaturea323bd6
-
Update modeling_minicpmo.py
Verified signaturef343679
-
Update modeling_minicpmo.py (#32)
Verified signature- Update modeling_minicpmo.py (cdca350426179d35200fe3d66352ceca8261dc19) Co-authored-by: Zhangchi Feng <BUAADreamer@users.noreply.huggingface.co>954cd56
-
Avoid duplicate input kwargs in `_decode` (#28)
Verified signature- Avoid duplicate input kwargs in `_decode` (18005e74b8257c981bb97dd4f350b06cd28f7aa6) - avoid duplicate generate args (5d0120037703b4b70ec932f62ddb81e07b8b85c4) - update modeling_minicpmo.py (cac55956a6efb7456cf5bbcad4e3e4f14d2e7ea9) Co-authored-by: Zhihui He <HwwwH@users.noreply.huggingface.co>34a6e7f -
Update README.md
Verified signature77225ff -
Update README.md
Verified signature19c5f03
-
Update system prompt of assistant mode to make sure AudioEvals metric is replicable
Verified signature7a26a08 -
Update README.md
Verified signature8329cd6
-
Release `get_audio_placeholder` interface in processing (#24)
Verified signature- release (7616f5094f7995e8f126d75e97493ef7ff2fc767) Co-authored-by: Zhihui He <HwwwH@users.noreply.huggingface.co>ac4f235
-
fix vision-only inference
Verified signature4a25f99 -
fix audio batch inference
Verified signature1bbb766
-
Update README.md
Verified signature4e1cff2 -
update readme
41a38b3 -
support audio finetuning (#22)
Verified signature- support audio finetuning (29a824ea848aa2a72b26706a1c641bc339a51869) Co-authored-by: Zhangchi Feng <BUAADreamer@users.noreply.huggingface.co>2ea48c8
-
add usage samples to readme
686e87a -
update readme, add audio input examples
7063fbc -
Update README.md
Verified signature8670477 -
Update README.md
Verified signature1939b37 -
Update README.md
Verified signatureda91e91 -
Update README.md
Verified signature1f9e583 -
Update README.md
Verified signaturee1b08c1 -
Update README.md
Verified signatureca9a10b
-
Update README.md
Verified signature21e853e
-
Update README.md
Verified signature0ea6c98
-
Fix an issue in TTS generate to avoid gap between training and inference
Verified signaturece5aba2 -
update audio demo
hfw4d54644 -
updata audio demo
hfwa884350 -
Replace the inplace operation (#7)
Verified signature- Update modeling_minicpmo.py (909a86b1f20fd048c8a8fbe4119910812cc3eaaf) Co-authored-by: Zhangchi Feng <BUAADreamer@users.noreply.huggingface.co>8618726
-
Update README.md
Verified signatureaf3a448 -
add omni case for inference
e652c6b -
Update README.md
Verified signatureb282589 -
Update README.md
Verified signaturee62ac00
-
Update README.md (#13)
Verified signature- Update README.md (9e55825a940b44ee9aff7df2bec61d74555c6775) Co-authored-by: wang <flyingmrwang@users.noreply.huggingface.co>cb48002 -
Update README.md
Verified signature386c926 -
Update modeling_minicpmo.py
Verified signature956319a -
update readme
4ac69b4 -
update readme
e89b46b -
Update README.md
Verified signature8e54b31
-
Update README.md
Verified signature0f4c447 -
Update README.md
Verified signature2e82667 -
update readme
da1b850