Buckets:

hf-doc-build
/

doc-dev

Files

xet

hf-doc-build/doc-dev / transformers /pr_48421 /en /serve-cli /jan.md

HuggingFaceDocBuilder

30 days ago

preview code

download

raw

433 Bytes

# Jan

[Jan](https://jan.ai/) is an open-source ChatGPT alternative. It supports `transformers serve` natively without extra tunneling.

Go to **Settings > Model Providers**.

1. Set **Base URL** to http://localhost:8000/v1.
2. Enter any text in **API Key** (required).

Check the **Models** section (click **Refresh** if empty). Click **+** to add a specific model like Qwen/Qwen3-4B, or `<repo>:<file>.gguf` for a GGUF one.

Xet Storage Details

Size:: 433 Bytes
Xet hash:: 5b6f851a0d98aca09002910541413db192096dc11f758105a778ebb78e1aeb88

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.

	# Jan

	[Jan](https://jan.ai/) is an open-source ChatGPT alternative. It supports `transformers serve` natively without extra tunneling.

	Go to Settings > Model Providers.

	1. Set Base URL to http://localhost:8000/v1.
	2. Enter any text in API Key (required).

	Check the Models section (click Refresh if empty). Click + to add a specific model like Qwen/Qwen3-4B, or `<repo>:<file>.gguf` for a GGUF one.