Instructions to use the-bee/test-bloomd-560m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use the-bee/test-bloomd-560m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="the-bee/test-bloomd-560m")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("the-bee/test-bloomd-560m") model = AutoModel.from_pretrained("the-bee/test-bloomd-560m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download config.json from the-bee/test-bloomd-560m: direct link, hf CLI and curl.
- Browser
- Download file 750 Bytes
-
https://huggingface.co/the-bee/test-bloomd-560m/resolve/main/config.json
- Command line
-
hf download hf://the-bee/test-bloomd-560m/config.json
-
curl -L -o config.json https://huggingface.co/the-bee/test-bloomd-560m/resolve/main/config.json
750 Bytes
| { | |
| "apply_residual_connection_post_layernorm": false, | |
| "architectures": [ | |
| "BloomModel" | |
| ], | |
| "attention_dropout": 0.0, | |
| "attention_softmax_in_fp32": true, | |
| "bias_dropout_fusion": true, | |
| "bos_token_id": 1, | |
| "dht_prefix": "the-bee/test-bloomd-560m", | |
| "eos_token_id": 2, | |
| "hidden_dropout": 0.0, | |
| "hidden_size": 1024, | |
| "initializer_range": 0.02, | |
| "layer_norm_epsilon": 1e-05, | |
| "masked_softmax_fusion": true, | |
| "model_type": "bloom", | |
| "n_head": 16, | |
| "n_inner": null, | |
| "n_layer": 24, | |
| "offset_alibi": 100, | |
| "pad_token_id": 3, | |
| "pretraining_tp": 1, | |
| "skip_bias_add": true, | |
| "skip_bias_add_qkv": false, | |
| "slow_but_exact": false, | |
| "transformers_version": "4.25.1", | |
| "unk_token_id": 0, | |
| "use_cache": true, | |
| "vocab_size": 250880 | |
| } | |