Instructions to use aklein4/outer-ibml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aklein4/outer-ibml with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aklein4/outer-ibml", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 263 Bytes
99d6351 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 | {
"architectures": [
"IBMLModel"
],
"base_url": "TinyLlama/TinyLlama_v1.1",
"dtype": "float32",
"ibml_num_heads": 4,
"ibml_q1_size": 512,
"ibml_q2_size": 16,
"ibml_value_size": 128,
"model_type": "ibml",
"transformers_version": "4.57.0"
}
|