Instructions to use tokiers/M2V_base_output with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Model2Vec
How to use tokiers/M2V_base_output with Model2Vec:
from model2vec import StaticModel model = StaticModel.from_pretrained("tokiers/M2V_base_output") embeddings = model.encode(["It's dangerous to go alone!", "It's a secret to everybody."]) print(embeddings.shape) - sentence-transformers
How to use tokiers/M2V_base_output with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("tokiers/M2V_base_output") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Commit History
Yesterday
-
Add the tokie 0.2 tokenizer file
Verified signature56fd4e1
-
Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
Verified signatured22cfdd
-
Upload README.md with huggingface_hub
Verified signature0a9d929 -
Upload README.md with huggingface_hub
Verified signaturedbe70ab -
Upload tokie-banner.png with huggingface_hub
Verified signature53f7751 -
Upload vocab.txt with huggingface_hub
Verified signature8304c94 -
Upload tokenizer_config.json with huggingface_hub
Verified signatureb93f094 -
Upload special_tokens_map.json with huggingface_hub
Verified signature1e77f76 -
Upload onnx/model_uint8.onnx with huggingface_hub
Verified signature6d67773 -
Upload onnx/model_quantized.onnx with huggingface_hub
Verified signaturee69a970 -
Upload onnx/model_int8.onnx with huggingface_hub
Verified signaturecedd4d8 -
Upload onnx/model_fp16.onnx with huggingface_hub
Verified signature858a8a7 -
Upload onnx/model.onnx with huggingface_hub
Verified signaturef2c8bbd -
Upload modules.json with huggingface_hub
Verified signaturebee3ddf -
Upload model.safetensors with huggingface_hub
Verified signaturefd7d670 -
Upload embeddings.safetensors with huggingface_hub
Verified signature0b077e8 -
Upload config.json with huggingface_hub
Verified signature526675e -
Upload tokenizer.json with huggingface_hub
Verified signaturef267883 -
Upload tokenizer.tkz with huggingface_hub
Verified signatured4e0af1 -
initial commit
Verified signature130dc1e