metadata
library_name: cactus-compute
pipeline_tag: text-generation
license: apache-2.0
tags:
- tool-calling
- function-calling
- on-device
- edge
- quantization
- webassembly
Needle 3
An on-device model for tool calling, structured extraction and text embeddings. See the Needle website for model details, benchmarks and the browser demo.
Get started
pip install -U cactus-compute
import cactus
@cactus.tool
def get_weather(city: str):
"Get the current weather for a city."
return {"city": city, "temp_c": 27, "sky": "clear"}
with cactus.Cactus(tools=[get_weather]) as agent:
print(agent.run("What's the weather in Lagos?")["results"])
The package downloads and caches the engine and weights on first use.
This repository provides needle3.cact and checkpoints/needle3.safetensors.
Runtime binaries and supported platforms live in the Cactus repository.