Instructions to use aklein4/outer-ibml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aklein4/outer-ibml with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aklein4/outer-ibml", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "architectures": [ | |
| "IBMLModel" | |
| ], | |
| "base_url": "TinyLlama/TinyLlama_v1.1", | |
| "dtype": "float32", | |
| "ibml_num_heads": 4, | |
| "ibml_q1_size": 512, | |
| "ibml_q2_size": 16, | |
| "ibml_value_size": 128, | |
| "model_type": "ibml", | |
| "transformers_version": "4.57.0" | |
| } | |