Instructions to use skt/A.X-K2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use skt/A.X-K2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="skt/A.X-K2") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("skt/A.X-K2") model = AutoModelForCausalLM.from_pretrained("skt/A.X-K2", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use skt/A.X-K2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "skt/A.X-K2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "skt/A.X-K2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/skt/A.X-K2
- SGLang
How to use skt/A.X-K2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "skt/A.X-K2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "skt/A.X-K2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "skt/A.X-K2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "skt/A.X-K2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use skt/A.X-K2 with Docker Model Runner:
docker model run hf.co/skt/A.X-K2
Commit History
10 days ago
-
Document recommended sampling parameters
Kim, JinRecommend temperature 0.9 and top_p 0.95 for generation, pass them explicitly in the Transformers example, and raise the default temperature in generation_config.json from 0.6 to 0.9 to match.d0805cf
-
Track logo assets with Git LFS
Kim, Jinassets/A.X_K2_BI_{Primary,Negative}.png were stored as raw git blobs even though .gitattributes declares them LFS-tracked. That only held because of a local, uncommitted .git/info/attributes override; in any fresh clone the exception is absent, so the next commit touching them rewrites them to LFS pointers whose objects were never uploaded — the breakage d51aa22 caused and 644dcc3 had to undo. Store them as LFS pointers like every other image in assets/, matching skt/A.X-K2-Preview and the .gitattributes already in the repo.4237c6a -
update citation
Kim, JinCite the arXiv version of the technical report (arXiv:2608.30181) and point the Technical Report links at the arXiv abstract page.bf3cc22
-
Update benchmarks
Kim, Jin9af2e3d -
Restore assets/A.X_K2_BI_{Primary,Negative}.png removed in d51aa22
Kim, Jin644dcc3 -
update benchmarks
Kim, Jind51aa22
-
Update IFBench / AA-LCR scores
Verified signature7b3969c
-
Add HLE, GPQA, and AIME 2026 evaluation results (#3)
- Add HLE, GPQA, and AIME 2026 evaluation results (746e8bdbe552f4236018ccebcfce53ed3487b479) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>68367f2
-
Fix dark-mode logo: absolute srcset URL (HF does not rewrite srcset)
Verified signaturefb412dc -
Point Models link at the A.X K2 collection
Verified signature98f6691 -
Add files using upload-large-folder tool
Verified signature66671a9 -
Add files using upload-large-folder tool
Verified signature1e90ba2 -
Add files using upload-large-folder tool
Verified signature02a83f5 -
Add files using upload-large-folder tool
Verified signature4eced65 -
Add files using upload-large-folder tool
Verified signature0a2e2dc -
Add files using upload-large-folder tool
Verified signature5b61f56 -
initial commit
Verified signatureb0a8c07