Qwen2.5-1.5B-Instruct — Serverless API on Token Factory by packet.ai

Run Qwen2.5-1.5B-Instruct through a serverless, OpenAI-compatible API with pay-per-token billing. Token Factory by packet.ai serves open-weight models behind an OpenAI-compatible endpoint, so you can switch your existing OpenAI SDK code by changing only the base URL and API key.

This card describes the hosted API for Qwen/Qwen2.5-1.5B-Instruct, the instruction-tuned 1.5B model from the Qwen2.5 series developed by the Qwen team.

Why use Qwen2.5-1.5B-Instruct on Token Factory

  • OpenAI-compatible endpoint — works with existing OpenAI SDKs.
  • Streaming, JSON mode and tool calling supported on chat completions.
  • Pay per token — input and output tokens are metered separately; nothing is charged while idle.
  • Free for one month at launch (till Dec 16th), then billed per 1M tokens. See current pricing.
  • Scale to dedicated GPUs — move the model to a dedicated GPU running vLLM while keeping the same endpoint shape.

Good for

  • Classification
  • Extraction
  • Multilingual use (29+ languages)

Model overview

Property Value
Model Qwen2.5-1.5B-Instruct
Developer Qwen team
Type Causal language model, instruction-tuned
Parameters 1.54B (1.31B non-embedding)
Layers 28
Attention GQA — 12 query heads, 2 KV heads
Architecture Transformer with RoPE, SwiGLU, RMSNorm, attention QKV bias, tied word embeddings
Context length 32,768 tokens
Max generation 8,192 tokens
Languages 29+
License Apache 2.0

Per the Qwen team, Qwen2.5 improves on Qwen2 in coding and math, instruction following, structured output (including JSON), long-context support and multilingual support (29+ languages).

Quickstart

1. Get an API key

Sign up at dash.packet.ai and create an API key.

2. Call the API (Python, OpenAI SDK)

from openai import OpenAI
 
client = OpenAI(
    api_key="PACKET_API_KEY",
    base_url="https://api.packet.ai/v1",
)
 
response = client.chat.completions.create(
    model="QWEN_MODEL_ID_FROM_DASHBOARD",
    messages=[{"role": "user", "content": "Implement Hello World"}],
)
print(response.choices[0].message.content)

Replace PACKET_API_KEY with your API key. Full API documentation: dash.packet.ai/docs

Other models on Token Factory

Model Highlights
nvidia/DeepSeek-V4.1-Flash-NVFP4 Reasoning model, 1M-token context, image input
MiniMaxAI/MiniMax-M3.1-Flash Agentic model for coding and computer use, 1M-token context, text/image/video input

See the full, up-to-date list at packet.ai/token-factory.

Run it yourself

Prefer to self-host? Use the original weights from the Qwen team:

About packet.ai

packet.ai is a hosted·ai project operated by HOSTED AI Inc., 2880 Zanker Rd, Suite 203, San Jose, CA 95134. Alongside Token Factory, packet.ai offers GPUs (B200, RTX PRO 6000, A100, RTX 4090), dynamic and dedicated GPUs, and bare metal/clusters, billed by the minute.

License and attribution

Qwen2.5-1.5B-Instruct is developed by the Qwen team and released under the Apache 2.0 license. Token Factory provides hosted inference for this model. Use of the API is subject to packet.ai's Terms and Privacy Policy.

Citation

  • Qwen Team, "Qwen2.5: A Party of Foundation Models," September 2024. Blog
  • An Yang et al., "Qwen2 Technical Report," arXiv:2407.10671, 2024.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for tokenfactorypacketai/Qwen2.5-1.5B-Instruct

Finetuned
(2,159)
this model

Paper for tokenfactorypacketai/Qwen2.5-1.5B-Instruct