Instructions to use IFM/K2-Horizon-3.7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use IFM/K2-Horizon-3.7B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="IFM/K2-Horizon-3.7B", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("IFM/K2-Horizon-3.7B", trust_remote_code=True, device_map="auto")

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use IFM/K2-Horizon-3.7B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "IFM/K2-Horizon-3.7B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IFM/K2-Horizon-3.7B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/IFM/K2-Horizon-3.7B

SGLang

How to use IFM/K2-Horizon-3.7B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "IFM/K2-Horizon-3.7B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IFM/K2-Horizon-3.7B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "IFM/K2-Horizon-3.7B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IFM/K2-Horizon-3.7B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use IFM/K2-Horizon-3.7B with Docker Model Runner:
```
docker model run hf.co/IFM/K2-Horizon-3.7B
```

K2-Horizon-3.7B

Commit History

Nov 4 Today

03:08
Update README.md

hunterhector

Verified signature
ea9a45d

Oct 28 7 days ago

01:38
Upload k2-horizon-3.7b-benchmarks.png

chen11003

Verified signature
4525090
01:37
Upload k2-horizon-3.7b-benchmarks.png

chen11003

Verified signature
dc12ec6
01:32
Update README.md

chen11003

Verified signature
f78231e

Oct 14 21 days ago

10:30
Support OpenAI-style text content lists (#7)⁠

mingshan +1: hanseungwook

9d280ff

Oct 2

18:58
Update README.md with information on FTPO

zhou94539

Verified signature
d6e5432
18:56
Update README.md with information on FTPO.

zhou94539

Verified signature
93c35f5

Oct 1

20:10
Fix the tag name of anti doom loop checkpoint in README.md

zhou94539

Verified signature
c7d0261
20:03
Update README.md to include anti doom loop checkpoint

zhou94539

Verified signature
35ba769
16:45
Promote checkpoint anti_doom_loop_verified to main

HF release automation

fe504ef
16:45
Publish checkpoint anti_doom_loop_verified⁠

HF release automation

0ec9899
15:46
Fix typo and wording.

desaifan-mbzuai

Verified signature
6e609f8
04:50
Add anti-doom-loop paragraph

desaifan-mbzuai

Verified signature
17701a5
00:24
Update README.md

hunterhector

Verified signature
77cf611
00:23
Document tool_call_format API options (#2)⁠

hunterhector +1: hanseungwook

641ee63

Sep 28

16:10
Release artifacts updated.

desaifan-mbzuai

Verified signature
943ce4e

Sep 24

20:11
Delete files migration_manifest.json validation.json with huggingface_hub

zhou94539

Verified signature
85f683b

Sep 22

23:26
Add a note on ckpt usage

desaifan-mbzuai

Verified signature
242d92f

Sep 21

01:40
Update model card

zhou94539

Verified signature
6360f70

Sep 17

21:18
Preserve checkpoint history: rl_stemcode⁠

HF release automation

09568ba
21:18
Publish checkpoint rl_stemcode⁠

HF release automation

8fdfbf0
21:16
Preserve checkpoint history: rl_code⁠

HF release automation

747acd3
21:16
Publish checkpoint rl_code⁠

HF release automation

79763ae
21:14
Preserve checkpoint history: rl_math⁠

HF release automation

972a537
21:14
Publish checkpoint rl_math⁠

HF release automation

d3279cd

Sep 16

22:41
Fix typo

desaifan-mbzuai

Verified signature
7a7d2c1
22:40
Update ckpt progress

desaifan-mbzuai

Verified signature
d237986

Sep 15

22:53
Add details in RL stage in Training Overview.

desaifan-mbzuai

Verified signature
9395c67
17:18
Preserve checkpoint history: sft_2_500⁠

HF release automation

7c542d8
17:18
Preserve checkpoint history: sft_2_1000⁠

HF release automation

3f9153f
17:18
Preserve checkpoint history: sft_2_1500⁠

HF release automation

47bf9f4
17:18
Preserve checkpoint history: sft_2_2000⁠

HF release automation

f705041
17:18
Preserve checkpoint history: sft_2_2500⁠

HF release automation

481170a
17:18
Preserve checkpoint history: sft_1_2000⁠

HF release automation

5fa6fe7
17:18
Preserve checkpoint history: sft_1_4000⁠

HF release automation

f1df18d
17:18
Preserve checkpoint history: sft_1_6000⁠

HF release automation

8f96a3c
17:18
Preserve checkpoint history: sft_1_8000⁠

HF release automation

e1eb65d
17:18
Preserve checkpoint history: sft_1_10000⁠

HF release automation

76646c0
17:18
Preserve checkpoint history: mid_4_1000⁠

HF release automation

d9cc0e9
17:18
Preserve checkpoint history: mid_4_2000⁠

HF release automation

aace30e
17:18
Preserve checkpoint history: mid_4_3000⁠

HF release automation

4e6ed10
17:18
Preserve checkpoint history: mid_4_4000⁠

HF release automation

00b8afd
17:18
Preserve checkpoint history: mid_4_5000⁠

HF release automation

f748017
17:18
Preserve checkpoint history: mid_4_6000⁠

HF release automation

a3bf52a
17:18
Preserve checkpoint history: mid_4_7000⁠

HF release automation

1bcd87f
17:18
Preserve checkpoint history: mid_4_8000⁠

HF release automation

9ed5257
17:18
Preserve checkpoint history: mid_4_9000⁠

HF release automation

e53b5a5
17:18
Preserve checkpoint history: mid_4_10000⁠

HF release automation

cc00ba7
17:18
Preserve checkpoint history: mid_3_500⁠

HF release automation

c096dab
17:18
Preserve checkpoint history: mid_3_1000⁠

HF release automation

8601d96

Commit History

Nov 4 Today

Update README.md

Oct 28 7 days ago

Upload k2-horizon-3.7b-benchmarks.png

Upload k2-horizon-3.7b-benchmarks.png

Update README.md

Oct 14 21 days ago

Support OpenAI-style text content lists (#7)⁠

Oct 2

Update README.md with information on FTPO

Update README.md with information on FTPO.

Oct 1

Fix the tag name of anti doom loop checkpoint in README.md

Update README.md to include anti doom loop checkpoint

Promote checkpoint anti_doom_loop_verified to main

Publish checkpoint anti_doom_loop_verified⁠

Fix typo and wording.

Add anti-doom-loop paragraph

Update README.md

Document tool_call_format API options (#2)⁠

Sep 28

Release artifacts updated.

Sep 24

Delete files migration_manifest.json validation.json with huggingface_hub

Sep 22

Add a note on ckpt usage

Sep 21

Update model card

Sep 17

Preserve checkpoint history: rl_stemcode⁠

Publish checkpoint rl_stemcode⁠

Preserve checkpoint history: rl_code⁠

Publish checkpoint rl_code⁠

Preserve checkpoint history: rl_math⁠

Publish checkpoint rl_math⁠

Sep 16

Fix typo

Update ckpt progress

Sep 15

Add details in RL stage in Training Overview.

Preserve checkpoint history: sft_2_500⁠

Preserve checkpoint history: sft_2_1000⁠

Preserve checkpoint history: sft_2_1500⁠

Preserve checkpoint history: sft_2_2000⁠

Preserve checkpoint history: sft_2_2500⁠

Preserve checkpoint history: sft_1_2000⁠

Preserve checkpoint history: sft_1_4000⁠

Preserve checkpoint history: sft_1_6000⁠

Preserve checkpoint history: sft_1_8000⁠

Preserve checkpoint history: sft_1_10000⁠

Preserve checkpoint history: mid_4_1000⁠

Preserve checkpoint history: mid_4_2000⁠

Preserve checkpoint history: mid_4_3000⁠

Preserve checkpoint history: mid_4_4000⁠

Preserve checkpoint history: mid_4_5000⁠

Preserve checkpoint history: mid_4_6000⁠

Preserve checkpoint history: mid_4_7000⁠

Preserve checkpoint history: mid_4_8000⁠

Preserve checkpoint history: mid_4_9000⁠

Preserve checkpoint history: mid_4_10000⁠

Preserve checkpoint history: mid_3_500⁠

Preserve checkpoint history: mid_3_1000⁠