Instructions to use keras/mixtral_8_instruct_7b_en with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- KerasHub
How to use keras/mixtral_8_instruct_7b_en with KerasHub:
import keras_hub # Load CausalLM model (optional: use half precision for inference) causal_lm = keras_hub.models.CausalLM.from_preset("hf://keras/mixtral_8_instruct_7b_en", dtype="bfloat16") causal_lm.compile(sampler="greedy") # (optional) specify a sampler # Generate text causal_lm.generate("Keras: deep learning for", max_length=64)import keras_hub # Create a Backbone model unspecialized for any task backbone = keras_hub.models.Backbone.from_preset("hf://keras/mixtral_8_instruct_7b_en") - Keras
How to use keras/mixtral_8_instruct_7b_en with Keras:
# !pip install -U keras tensorflow huggingface_hub # Keras needs TensorFlow installed to read "hf://" paths, so the tensorflow backend is selected here; # "jax" and "torch" also work for computation once TensorFlow is installed. import os os.environ["KERAS_BACKEND"] = "tensorflow" import keras model = keras.saving.load_model("hf://keras/mixtral_8_instruct_7b_en") - Notebooks
- Google Colab
- Kaggle
File size: 1,437 Bytes
7afd15f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 | {
"module": "keras_hub.src.models.mixtral.mixtral_causal_lm_preprocessor",
"class_name": "MixtralCausalLMPreprocessor",
"config": {
"name": "mixtral_causal_lm_preprocessor_2",
"trainable": true,
"dtype": {
"module": "keras",
"class_name": "DTypePolicy",
"config": {
"name": "float32"
},
"registered_name": null
},
"tokenizer": {
"module": "keras_hub.src.models.mixtral.mixtral_tokenizer",
"class_name": "MixtralTokenizer",
"config": {
"name": "mixtral_tokenizer",
"trainable": true,
"dtype": {
"module": "keras",
"class_name": "DTypePolicy",
"config": {
"name": "int32"
},
"registered_name": null
},
"config_file": "tokenizer.json",
"proto": null,
"sequence_length": null,
"add_bos": false,
"add_eos": false
},
"registered_name": "keras_hub>MixtralTokenizer"
},
"config_file": "preprocessor.json",
"sequence_length": 1024,
"add_start_token": true,
"add_end_token": true
},
"registered_name": "keras_hub>MixtralCausalLMPreprocessor"
} |