Sentence Similarity
sentence-transformers
ONNX
English
Chinese
qwen3
feature-extraction
text-embeddings
embeddings
retrieval
mteb
onnxruntime
cpu
int-4
custom_code
text-embeddings-inference
Instructions to use magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4", trust_remote_code=True) sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Download custom_st.py from magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4: direct link, hf CLI and curl.
- Browser
- Download file 361 Bytes
-
https://huggingface.co/magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4/resolve/main/custom_st.py
- Command line
-
hf download hf://magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4/custom_st.py
-
curl -L -o custom_st.py https://huggingface.co/magiccodingman/Jasper-Token-Compression-600M-ONNX-INT4/resolve/main/custom_st.py
361 Bytes
| import torch | |
| from sentence_transformers.models import Transformer as BaseTransformer | |
| class JasperTransformer(BaseTransformer): | |
| def forward(self, features: dict[str, torch.Tensor], **kwargs) -> dict[str, torch.Tensor]: | |
| vectors = self.auto_model(**features, **kwargs) | |
| features.update({"sentence_embedding": vectors}) | |
| return features | |