🚀 vtx-embed-7M (mini)

The world's most memory-efficient static embedding model powering vortexa. Native 4-Bit quantization · 4.72 MB RAM · 7.56M Parameters · Matryoshka MRL · Sub-millisecond CPU latency

---

⚡ Integration with Vortexa

This model powers vortexa — a standalone codebase indexing and semantic search engine designed for AI agents and developers.

vortexa builds a persistent, hybrid search index over source code using:

• Dense Retrieval: Driven natively by vtx-embed-7M (on-the-fly LF4 4-bit dequantization, SIF+PC pooling, Matryoshka truncation).
• Sparse Retrieval: BM25 keyword scoring for exact symbol matches.
• AST-Aware Chunking: Tree-sitter powered chunking respecting function and class boundaries.
• LMDB Storage: Fast, persistent vector and document chunk storage.

---

📄 Model Details

Property	Value
Model Name / Tier	vtx-embed-7M ("mini")
Total Parameters	7.56M
Tensor Storage Format	lf4 — 4-bit per-block with FP16 scale + zero
In-RAM Memory	4.72 MB
On-Disk Size	4.72 MB
Vocabulary Size	29,528
Max Sequence Length	512 tokens
Output Dimensions	256 (Matryoshka supported)
Pooling	SIF IDF-weighted + PC-1 removal
Primary Engine Integration	OEvortex/vortexa
License	MIT

---

📊 Official Benchmark Results

Dataset	Metric	vtx-embed-7M (4.72 MB)	MiniLM-L6-v2 (90 MB)	bge-small-en-v1.5 (134 MB)
STSBenchmark	Spearman ρ	0.7918	0.8284	0.8278
SICK-R	Spearman ρ	0.6294	0.7572	0.7460
Banking77Classification	Accuracy	0.7043	0.7451	0.7884
AmazonCounterfactual	Accuracy	0.6679	0.7371	0.7279
TwentyNewsgroups	V-Measure	0.2936	0.3529	0.4419
RedditClustering	V-Measure	0.388	0.4342	0.5376

---

💻 Quickstart Usage

Native Vortexa Core API

from vortexa.core.inference import VortexEmbedInference, similarity

# Load model using the "mini" model alias
model = VortexEmbedInference("mini")

queries = [
    "What is the capital of India?",
    "Explain gravity and general relativity",
]
documents = [
    "The capital of India is New Delhi.",
    "Gravity is a fundamental interaction that causes mutual attraction between all things with mass or energy.",
]

# 1. Encode queries and documents
query_embeddings = model.encode(queries)
document_embeddings = model.encode(documents)

# 2. Compute similarity matrix directly
similarity_matrix = query_embeddings @ document_embeddings.T
print("Similarity Matrix:")
print(similarity_matrix)
# Example output:
# [[0.82, 0.12],
#  [0.11, 0.74]]

# 3. Use built-in model similarity method
scores = model.similarity(query_embeddings, document_embeddings)

# 4. Single query against document list lookup
scores_single = model.similarity("What is the capital of India?", documents)
print("Single query scores:", scores_single)

---

📜 Citation

@misc{vtx-embed-7m},
  title  = {vtx-embed-7M: Native 4-Bit Embeddings for Standalone Codebase Indexing},
  author = {VTXAI},
  year   = {2026},
  url    = {https://huggingface.co/VTXAI/vtx-embed-7M}
}

---

📄 License

MIT License — free for commercial and research use.