How to use Takara-DS1/miru-codev3-tokenlearn with Model2Vec:
from model2vec import StaticModel model = StaticModel.from_pretrained("Takara-DS1/miru-codev3-tokenlearn") embeddings = model.encode(["It's dangerous to go alone!", "It's a secret to everybody."]) print(embeddings.shape)
fbefc90
1
2
3
4
{ "normalize": true, "embedding_dtype": "float32" }
