logo

Alchemyst-AI/Chintan

Chintan is Alchemyst AI's conversational language model, fine-tuned and optimized for serving on our own inference infrastructure. It is exposed through the Alchemyst LLM Gateway as an OpenAI-compatible API.

Model description

Chintan is a small-footprint decoder-only language model for structured, goal-driven conversation. It was trained on real multi-turn dialogues with explicit objectives rather than generic web text, and is designed for products where the conversation must go somewhere: counselling, onboarding, feedback collection, and other scripted-but-natural interactions.

  • Developed by: Alchemyst AI (https://getalchemystai.com)
  • Model type: causal language model (text generation)
  • Languages: English, Hindi / Hinglish (natural code-switching)
  • License: Alchemyst Research License β€” see LICENSE. Commercial use requires a separate agreement.

Intended uses

Structured, goal-driven conversation. The model keeps multi-turn interactions moving forward, asks the right next question, and gracefully steers when a user drifts off-script.

Persona fidelity. Chintan holds a persona β€” tone, register, and role β€” across long sessions without collapsing back into generic assistant voice. Give it a character brief and it stays in character, turn after turn.

Multilingual, code-switched conversation. The model is comfortable in English and Hindi/Hinglish and switches between them mid-conversation the way real Indian users speak β€” without announcing the switch or losing the thread. Mixed-script turns like "kya aapko yeh details chahiye?" are handled natively.

Grounded personalization. The model works from a context sheet β€” user details, role or program specifics, prior conversation state β€” and weaves those facts into natural speech instead of reciting them.

Out-of-scope uses

Chintan is a conversationalist, not a general-purpose assistant. It is not tuned for code generation, long-form document synthesis, open-domain knowledge work, or factual question answering beyond its conversation context. For those workloads, use a larger frontier model.

Do not use the model to impersonate real individuals, for medical/legal/ financial advice, or in safety-critical decision loops without human oversight.

Technical specifications

Model type causal LM, decoder-only
Parameters 0.6 B
Precision bfloat16
Context length 40,960 tokens
Hidden size 1024
Layers 28
Attention heads 16 (8 KV heads, GQA)
Vocabulary 151,936 tokens
Tokenizer BPE
Framework transformers

Performance (single NVIDIA L40S, 46 GB)

Served via SGLang, bf16, with continuous batching enabled:

Metric Measured
Response latency, short replies (~30 tokens) ~80–130 ms
Response latency, medium replies (~130–190 tokens) ~370–500 ms
First-token latency under light load sub-100 ms
Throughput hundreds of tokens/s aggregate; batching scales near-linearly until GPU memory saturates

Numbers are end-to-end gateway latencies (auth, routing, and metering included), measured on the production gateway stack. Latency scales primarily with output length; input context up to a few thousand tokens contributes negligibly thanks to prefix caching.

Usage

The model is served behind the Alchemyst LLM Gateway with a standard OpenAI-compatible surface:

curl http://<gateway>/v1/chat/completions \
  -H "Authorization: Bearer $ALCHEMYST_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Alchemyst-AI/Chintan",
    "messages": [{"role": "user", "content": "Hi, who is this?"}],
    "stream": true
  }'

Streaming (SSE) and realtime WebSocket sessions are both supported.

Bias, risks, and limitations

  • The model is trained on conversational data reflecting the demographics and scenarios of its training corpus; outputs may carry those biases.
  • It can produce incorrect or fabricated details when a conversation requires facts beyond its context sheet.
  • Low-latency design trades off against the depth and world knowledge of much larger models.

Citation

@software{alchemyst_chintan,
  title  = {Chintan: a conversational language model},
  author = {Alchemyst AI},
  year   = {2026},
  url    = {https://getalchemystai.com}
}
Downloads last month
5
Safetensors
Model size
0.6B params
Tensor type
BF16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support