transformers/pr_48421/en/serve-cli/jan.md

Jan

Jan is an open-source ChatGPT alternative. It supports transformers serve natively without extra tunneling.

Go to Settings > Model Providers.

1. Set Base URL to http://localhost:8000/v1.
2. Enter any text in API Key (required).

Check the Models section (click Refresh if empty). Click + to add a specific model like Qwen/Qwen3-4B, or <repo>:<file>.gguf for a GGUF one.