Text Generation
Transformers
Safetensors
English
qwen3
reinforcement-learning
teacher-student
adaptive-learning
pedagogy
rlhf
rlaif
conversational
Eval Results (legacy)
text-generation-inference
Instructions to use Arc-Intelligence/ATLAS-8B-Thinking with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Arc-Intelligence/ATLAS-8B-Thinking with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Arc-Intelligence/ATLAS-8B-Thinking") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Arc-Intelligence/ATLAS-8B-Thinking") model = AutoModelForCausalLM.from_pretrained("Arc-Intelligence/ATLAS-8B-Thinking", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Arc-Intelligence/ATLAS-8B-Thinking with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Arc-Intelligence/ATLAS-8B-Thinking" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Arc-Intelligence/ATLAS-8B-Thinking", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Arc-Intelligence/ATLAS-8B-Thinking
- SGLang
How to use Arc-Intelligence/ATLAS-8B-Thinking with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Arc-Intelligence/ATLAS-8B-Thinking" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Arc-Intelligence/ATLAS-8B-Thinking", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Arc-Intelligence/ATLAS-8B-Thinking" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Arc-Intelligence/ATLAS-8B-Thinking", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Arc-Intelligence/ATLAS-8B-Thinking with Docker Model Runner:
docker model run hf.co/Arc-Intelligence/ATLAS-8B-Thinking
Commit History
-
Update README.md
Verified signaturea230fcd -
Move model-00004-of-00004.safetensors from checkpoint/ to root
Verified signature48cf09e -
Move model-00003-of-00004.safetensors from checkpoint/ to root
Verified signature3b4b160 -
Move model-00002-of-00004.safetensors from checkpoint/ to root
Verified signature43596b7 -
Move model-00001-of-00004.safetensors from checkpoint/ to root
Verified signaturea4124d7 -
Add model.safetensors.index.json to root from checkpoint/
Verified signatureb565d89 -
Add generation_config.json to root from checkpoint/
Verified signature4b84378 -
Add added_tokens.json to root from checkpoint/
Verified signature51357e4 -
Add merges.txt to root from checkpoint/
Verified signatureacc87ec -
Add vocab.json to root from checkpoint/
Verified signature5a9b969 -
Add special_tokens_map.json to root from checkpoint/
Verified signature0d30e6d -
Add tokenizer_config.json to root from checkpoint/
Verified signaturebbc3421 -
Add tokenizer.json to root from checkpoint/
Verified signature9393fcb -
Add config.json to root from checkpoint/
Verified signature63e9785 -
Update README.md
Verified signature98d57cb -
Update README.md
Verified signatureb90f54b -
Update README.md
Verified signature6c9cc48
-
Update README.md
Verified signature2047d77 -
Update README.md
Verified signature125e3d7 -
header images
Verified signature2ab2667 -
Update README.md
Verified signature67aa874 -
update the Readme.md
Verified signature9608a83 -
Copy to checkpoint/zero_to_fp32.py
Verified signature25f9fe0 -
Copy to checkpoint/vocab.json
Verified signature3e3fca8 -
Copy to checkpoint/training_args.bin
Verified signature784c9c1 -
Copy to checkpoint/trainer_state.json
Verified signature2e3a075 -
Copy to checkpoint/tokenizer_config.json
Verified signatured8e999d -
Copy to checkpoint/tokenizer.json
Verified signatured0908f3 -
Copy to checkpoint/special_tokens_map.json
Verified signature70a9fc6 -
Copy to checkpoint/rng_state_3.pth
Verified signature38dc39f -
Copy to checkpoint/rng_state_2.pth
Verified signatureda3c7e9 -
Copy to checkpoint/rng_state_1.pth
Verified signaturee441716 -
Copy to checkpoint/rng_state_0.pth
Verified signature3c3a4dc -
Copy to checkpoint/model.safetensors.index.json
Verified signatureeaa2f2c -
Copy to checkpoint/model-00004-of-00004.safetensors
Verified signature20a31b5 -
Copy to checkpoint/model-00003-of-00004.safetensors
Verified signature939492f -
Copy to checkpoint/model-00002-of-00004.safetensors
Verified signatureec3911f -
Copy to checkpoint/model-00001-of-00004.safetensors
Verified signature496cab7 -
Copy to checkpoint/merges.txt
Verified signature1e7c7ea -
Copy to checkpoint/latest
Verified signature2ce9ba3 -
Copy to checkpoint/global_step/zero_pp_rank_3_mp_rank_00_model_states.pt
Verified signature1841af0 -
Copy to checkpoint/global_step/zero_pp_rank_2_mp_rank_00_model_states.pt
Verified signatured41ce45 -
Copy to checkpoint/global_step/zero_pp_rank_1_mp_rank_00_model_states.pt
Verified signaturebe185ce -
Copy to checkpoint/global_step/zero_pp_rank_0_mp_rank_00_model_states.pt
Verified signature48feed7 -
Copy to checkpoint/global_step/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Verified signature27acb16 -
Copy to checkpoint/global_step/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Verified signature503abf8 -
Copy to checkpoint/global_step/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Verified signature5f97599 -
Copy to checkpoint/global_step/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Verified signature90f4754 -
Copy to checkpoint/generation_config.json
Verified signatureb17e8c6 -
Copy to checkpoint/config.json
Verified signaturee212c21