Instructions to use zeromodels/all-mpnet-base-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- ZeroModels
How to use zeromodels/all-mpnet-base-v2 with ZeroModels:
# pip install -U zeromodels # ZeroModels is pure Keras 3, so pick a backend: "jax", "torch" or "tensorflow". import os os.environ["KERAS_BACKEND"] = "jax" from zeromodels import AutoZModel # AutoZModel reads the repo's model_type and loads the matching class. # For a task head use the matching loader, e.g. AutoZMImageClassify / AutoZMDetect / # AutoZMSemanticSegment / AutoZMTextGenerate (see zeromodels.auto). model = AutoZModel.from_weights("zeromodels/all-mpnet-base-v2") - Keras
How to use zeromodels/all-mpnet-base-v2 with Keras:
# !pip install -U keras tensorflow huggingface_hub # Keras needs TensorFlow installed to read "hf://" paths, so the tensorflow backend is selected here; # "jax" and "torch" also work for computation once TensorFlow is installed. import os os.environ["KERAS_BACKEND"] = "tensorflow" import keras model = keras.saving.load_model("hf://zeromodels/all-mpnet-base-v2") - sentence-transformers
How to use zeromodels/all-mpnet-base-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("zeromodels/all-mpnet-base-v2") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Migrate Sentence Transformer namespace and ZM class names
Browse files- README.md +6 -6
- zm_config.json +2 -2
- zm_preprocessor.json +2 -2
README.md
CHANGED
|
@@ -34,14 +34,14 @@ import os
|
|
| 34 |
os.environ["KERAS_BACKEND"] = "torch" # set before importing Keras / ZeroModels
|
| 35 |
|
| 36 |
from keras import ops
|
| 37 |
-
from zeromodels.
|
| 38 |
-
|
| 39 |
-
|
| 40 |
)
|
| 41 |
|
| 42 |
repo = "zeromodels/all-mpnet-base-v2"
|
| 43 |
-
model =
|
| 44 |
-
tokenizer =
|
| 45 |
|
| 46 |
texts = ["A person is reading a book.", "Someone reads a novel."]
|
| 47 |
embeddings = model.encode(texts, tokenizer=tokenizer)
|
|
@@ -94,7 +94,7 @@ All 13 converted variants use `from_weights("zeromodels/<variant>")`:
|
|
| 94 |
- Use the tokenizer from the **same** repo as the model. It preserves the source
|
| 95 |
truncation length of 384 tokens for this checkpoint.
|
| 96 |
- For exact source loading without these converted Keras weights, use
|
| 97 |
-
`
|
| 98 |
- The repository contains `model.weights.h5`, `zm_config.json`, and
|
| 99 |
`tokenizer.json`. The pinned source commit is listed above.
|
| 100 |
|
|
|
|
| 34 |
os.environ["KERAS_BACKEND"] = "torch" # set before importing Keras / ZeroModels
|
| 35 |
|
| 36 |
from keras import ops
|
| 37 |
+
from zeromodels.sentence_transformers import (
|
| 38 |
+
ZMSentenceTransformer,
|
| 39 |
+
ZMSentenceTransformerTokenizer,
|
| 40 |
)
|
| 41 |
|
| 42 |
repo = "zeromodels/all-mpnet-base-v2"
|
| 43 |
+
model = ZMSentenceTransformer.from_weights(repo)
|
| 44 |
+
tokenizer = ZMSentenceTransformerTokenizer.from_weights(repo)
|
| 45 |
|
| 46 |
texts = ["A person is reading a book.", "Someone reads a novel."]
|
| 47 |
embeddings = model.encode(texts, tokenizer=tokenizer)
|
|
|
|
| 94 |
- Use the tokenizer from the **same** repo as the model. It preserves the source
|
| 95 |
truncation length of 384 tokens for this checkpoint.
|
| 96 |
- For exact source loading without these converted Keras weights, use
|
| 97 |
+
`ZMSentenceTransformer.from_weights("hf:sentence-transformers/all-mpnet-base-v2")`.
|
| 98 |
- The repository contains `model.weights.h5`, `zm_config.json`, and
|
| 99 |
`tokenizer.json`. The pinned source commit is listed above.
|
| 100 |
|
zm_config.json
CHANGED
|
@@ -1,8 +1,8 @@
|
|
| 1 |
{
|
| 2 |
"library_name": "zeromodels",
|
| 3 |
"zeromodels_version": "1.3.0",
|
| 4 |
-
"model_module": "zeromodels.
|
| 5 |
-
"model_class": "
|
| 6 |
"variant": "all-mpnet-base-v2",
|
| 7 |
"weights": "model.weights.h5",
|
| 8 |
"schema_version": 2,
|
|
|
|
| 1 |
{
|
| 2 |
"library_name": "zeromodels",
|
| 3 |
"zeromodels_version": "1.3.0",
|
| 4 |
+
"model_module": "zeromodels.sentence_transformers",
|
| 5 |
+
"model_class": "ZMSentenceTransformer",
|
| 6 |
"variant": "all-mpnet-base-v2",
|
| 7 |
"weights": "model.weights.h5",
|
| 8 |
"schema_version": 2,
|
zm_preprocessor.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
{
|
| 2 |
"library_name": "zeromodels",
|
| 3 |
-
"preprocessor_module": "zeromodels.
|
| 4 |
-
"preprocessor_class": "
|
| 5 |
"variant": "all-mpnet-base-v2",
|
| 6 |
"tokenizer_file": "tokenizer.json",
|
| 7 |
"backbone_type": "mpnet",
|
|
|
|
| 1 |
{
|
| 2 |
"library_name": "zeromodels",
|
| 3 |
+
"preprocessor_module": "zeromodels.sentence_transformers",
|
| 4 |
+
"preprocessor_class": "ZMSentenceTransformerTokenizer",
|
| 5 |
"variant": "all-mpnet-base-v2",
|
| 6 |
"tokenizer_file": "tokenizer.json",
|
| 7 |
"backbone_type": "mpnet",
|