card: add the aneforge[models] install line to the snippet

a732a6b verified 2 months ago

1.05 kB

license: mit
library_name: aneforge
base_model: thenlper/gte-small
pipeline_tag: sentence-similarity
tags:
  - aneforge
  - apple-neural-engine
  - sentence-transformers

GTE-small (ANEForge)

An unmodified duplicate of thenlper/gte-small, tagged for use with ANEForge so the weights load and run directly on the Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for the model details. Licensed mit from the source.

Use with ANEForge

# pip install "aneforge[models]"
from aneforge.sentence_transformers import SentenceTransformer

model = SentenceTransformer("aneforge/gte-small")
emb = model.encode(["Hello from the Neural Engine"], normalize_embeddings=True)

ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo via huggingface_hub. See the docs and the paper.