| license: mit | |
| library_name: aneforge | |
| base_model: thenlper/gte-small | |
| pipeline_tag: sentence-similarity | |
| tags: | |
| - aneforge | |
| - apple-neural-engine | |
| - sentence-transformers | |
| # GTE-small (ANEForge) | |
| An unmodified duplicate of [`thenlper/gte-small`](https://huggingface.co/thenlper/gte-small), tagged for use with | |
| [**ANEForge**](https://github.com/sbryngelson/ANEForge) so the weights load and run directly on the | |
| Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for | |
| the model details. Licensed `mit` from the source. | |
| ## Use with ANEForge | |
| ```python | |
| # pip install "aneforge[models]" | |
| from aneforge.sentence_transformers import SentenceTransformer | |
| model = SentenceTransformer("aneforge/gte-small") | |
| emb = model.encode(["Hello from the Neural Engine"], normalize_embeddings=True) | |
| ``` | |
| ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo | |
| via `huggingface_hub`. See the [docs](https://aneforge.readthedocs.io) and the [paper](https://arxiv.org/abs/2606.17090). | |