How to use lightonai/LateOn-Code with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="lightonai/LateOn-Code") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False)
https://huggingface.co/lightonai/LateOn-Code/resolve/refs%2Fpr%2F1/tokenizer.json
hf download hf://lightonai/LateOn-Code@refs/pr/1/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/lightonai/LateOn-Code/resolve/refs%2Fpr%2F1/tokenizer.json
