| --- |
| language: en |
| license: apache-2.0 |
| tags: |
| - minicpm |
| - minicpm-o |
| - multimodal |
| - vision |
| - audio |
| - text-to-speech |
| - tiny-model |
| - random-weights |
| model-index: |
| - name: MiniCPM-o-2_6 |
| results: [] |
| --- |
| |
| # Tiny Random MiniCPM-o-2_6 |
| |
| This is a tiny random variant of the MiniCPM-o-2_6 model, specifically created for testing and validation purposes with Optimum-Intel. |
|
|
| ## Model Details |
|
|
| - **Model Type**: Multimodal (Vision + Audio + Text-to-Speech) |
| - **Original Model**: [openbmb/MiniCPM-o-2_6](https://huggingface.co/openbmb/MiniCPM-o-2_6) |
| - **Size**: ~4.4MB (significantly reduced from original 160MB) |
| - **Architecture**: MiniCPMO (multimodal architecture) |
| - **Purpose**: Testing and validation with Optimum-Intel |
|
|
| ## Configuration Changes |
|
|
| This tiny model has the following modifications from the original: |
|
|
| - `hidden_size`: 16 (reduced from original) |
| - `intermediate_size`: 32 (reduced from original) |
| - `num_hidden_layers`: 1 (reduced from original) |
| - `vocab_size`: 32000 (maintained for compatibility) |
| - Vision and Audio components significantly reduced in size |
|
|
| ## Usage |
|
|
| ```python |
| from transformers import AutoModel, AutoTokenizer, AutoProcessor |
| |
| model = AutoModel.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
| tokenizer = AutoTokenizer.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
| processor = AutoProcessor.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
| ``` |
|
|
| ## Validation |
|
|
| This model has been tested and validated with Optimum-Intel tests: |
| - ✅ `test_compare_to_transformers_14_minicpmo` |
| - ✅ `test_generate_utils_14_minicpmo` |
| - ✅ `test_model_can_be_loaded_after_saving_14_minicpmo` |
|
|
| ## Limitations |
|
|
| ⚠️ **Important**: This is a random weights model intended for testing purposes only. It will not produce meaningful outputs and should not be used for production applications. |
|
|
| ## License |
|
|
| Apache 2.0 |