Spaces:
Running
Running
Add Lapis Labs organization card
Browse files
README.md
CHANGED
|
@@ -1,10 +1,61 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Lapis Labs
|
| 3 |
+
emoji: 馃拵
|
| 4 |
+
colorFrom: blue
|
| 5 |
+
colorTo: purple
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
short_description: Efficient bilingual tool routing for AI assistants
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# 馃拵 Lapis Labs
|
| 13 |
+
|
| 14 |
+
### Small models. Practical AI.
|
| 15 |
+
|
| 16 |
+
We build efficient models that help AI assistants decide which tool to use鈥攐r when no tool is needed.
|
| 17 |
+
|
| 18 |
+
Our **Lapis SAL** family focuses on English鈥揝panish tool routing, with a larger teacher, a distilled student, and an MLX release for local inference on Apple Silicon.
|
| 19 |
+
|
| 20 |
+
## Why tool routing?
|
| 21 |
+
|
| 22 |
+
Assistants often need to choose between searching the web, checking a calendar, sending a message, or answering directly.
|
| 23 |
+
|
| 24 |
+
A dedicated routing model can handle this decision before the request reaches a larger language model or an external service. This supports local processing and gives developers explicit control over the available tools.
|
| 25 |
+
|
| 26 |
+
## Available models
|
| 27 |
+
|
| 28 |
+
| Model | Purpose |
|
| 29 |
+
| :--- | :--- |
|
| 30 |
+
| [Lapis SAL 150M](https://huggingface.co/lapislabsai/lapis-sal-150M) | Distilled PyTorch student for research, further training, and export. |
|
| 31 |
+
| [Lapis SAL 421M](https://huggingface.co/lapislabsai/lapis-sal-421M) | Larger PyTorch teacher used in the distillation workflow. |
|
| 32 |
+
| [Lapis SAL 150M MLX](https://huggingface.co/lapislabsai/lapis-sal-150M-MLX) | Apple Silicon release with FP16 inference and optional INT8 quantization at load time. |
|
| 33 |
+
|
| 34 |
+
The student鈥檚 **150M** name identifies its encoder family. The complete routing model contains approximately **164M learned parameters**.
|
| 35 |
+
|
| 36 |
+
## Supported tools
|
| 37 |
+
|
| 38 |
+
Calculator 路 Calendar 路 Clock 路 Code 路 Contacts 路 Health 路 Location 路 Mail 路 Maps 路 Messages 路 Reminders 路 Weather 路 Web Search
|
| 39 |
+
|
| 40 |
+
A **NONE** option covers requests that do not require an available tool. Developers supply the tool descriptions at inference time.
|
| 41 |
+
|
| 42 |
+
## Training and evaluation
|
| 43 |
+
|
| 44 |
+
The student learns from a larger teacher through knowledge distillation. The workflow includes supervised adaptation, calibration, and deployment export.
|
| 45 |
+
|
| 46 |
+
On our private, synthetic, held-out benchmark of **1,000 English鈥揝panish examples**:
|
| 47 |
+
|
| 48 |
+
- **Teacher:** 96.0% routing accuracy.
|
| 49 |
+
- **MLX student:** 95.1% with both FP16 and optional INT8 inference.
|
| 50 |
+
|
| 51 |
+
These results describe this benchmark and do not guarantee performance on other datasets or real-world traffic. See each model card for evaluation details and limitations.
|
| 52 |
+
|
| 53 |
+
## Get started
|
| 54 |
+
|
| 55 |
+
Choose a model above and follow its README for installation and usage.
|
| 56 |
+
|
| 57 |
+
These releases use a custom routing runtime. They select tools; they do not execute them, generate conversational responses, or provide medical advice.
|
| 58 |
+
|
| 59 |
+
---
|
| 60 |
+
|
| 61 |
+
**English & Spanish 路 Knowledge distillation 路 Local inference 路 Apache 2.0**
|