Text Generation
Transformers
Safetensors
qwen2
phai-ide
science
code
tool-use
sft
lora
conversational
text-generation-inference
Instructions to use AItonomy/PhAI-IDE-72B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AItonomy/PhAI-IDE-72B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AItonomy/PhAI-IDE-72B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AItonomy/PhAI-IDE-72B") model = AutoModelForCausalLM.from_pretrained("AItonomy/PhAI-IDE-72B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AItonomy/PhAI-IDE-72B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AItonomy/PhAI-IDE-72B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AItonomy/PhAI-IDE-72B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AItonomy/PhAI-IDE-72B
- SGLang
How to use AItonomy/PhAI-IDE-72B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AItonomy/PhAI-IDE-72B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AItonomy/PhAI-IDE-72B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AItonomy/PhAI-IDE-72B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AItonomy/PhAI-IDE-72B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use AItonomy/PhAI-IDE-72B with Docker Model Runner:
docker model run hf.co/AItonomy/PhAI-IDE-72B
Add benchmark gains in compact model-level tables
Browse filesRestore 14 previously verified public-benchmark improvements in three model rows grouped by reasoning, knowledge, and code. Compact the ScienceAccelBench environment table to two model rows. Preserve paired scores, gains, and subset labels.
README.md
CHANGED
|
@@ -41,12 +41,24 @@ Weight sizes are approximate; inference also requires memory for runtime allocat
|
|
| 41 |
|
| 42 |
Task-held-out, localized scientific-code repair on familiar codebases, with original numerical verification. Each row compares the initial model with its corresponding fine-tuned model on identical tasks. Pass rates are percentages; gains are percentage points.
|
| 43 |
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
|
| 47 |
-
|
|
| 48 |
-
|
|
| 49 |
-
| 9B | PLUTO-RMHD
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
## Quick start
|
| 52 |
|
|
|
|
| 41 |
|
| 42 |
Task-held-out, localized scientific-code repair on familiar codebases, with original numerical verification. Each row compares the initial model with its corresponding fine-tuned model on identical tasks. Pass rates are percentages; gains are percentage points.
|
| 43 |
|
| 44 |
+
Each entry shows **initial model → PhAI-IDE (gain in percentage points)**, with task counts in brackets.
|
| 45 |
+
|
| 46 |
+
| Model | Scientific environment results |
|
| 47 |
+
| --- | --- |
|
| 48 |
+
| 4B | PLUTO-Particles-Dust [3]: 0.00 → **33.33** (**+33.33**) |
|
| 49 |
+
| 9B | LAPS [16]: 31.25 → **50.00** (**+18.75**)<br>MITgcm-biogeo [8]: 0.00 → **12.50** (**+12.50**)<br>PLUTO-RMHD [7]: 0.00 → **28.57** (**+28.57**) |
|
| 50 |
+
|
| 51 |
+
## Public benchmark performance
|
| 52 |
+
|
| 53 |
+
Each entry shows **initial model → PhAI-IDE (gain in percentage points)**. Scores are percentages, with identical items and settings within each model pair. Gains are calculated before rounding.
|
| 54 |
+
|
| 55 |
+
| Model | Reasoning | Knowledge | Code |
|
| 56 |
+
| --- | --- | --- | --- |
|
| 57 |
+
| 4B | BBH multistep-arithmetic-two: 92.40 → **97.60** (**+5.20**) | — | HumanEvalFix-JS (docs-style repair): 35.98 → **44.51** (**+8.54**)<br>APPS introductory: 15.40 → **17.20** (**+1.80**)<br>CRUXEval output prediction†: 32.03 → **34.38** (**+2.34**) |
|
| 58 |
+
| 9B | BBH word-sorting: 25.60 → **60.40** (**+34.80**)<br>AQuA-RAT: 86.61 → **88.98** (**+2.36**)<br>MATH-500: 91.40 → **92.20** (**+0.80**)<br>GSM8K†: 89.84 → **92.97** (**+3.12**) | OpenBookQA†: 33.59 → **35.16** (**+1.56**) | — |
|
| 59 |
+
| 72B | — | ARC-Easy: 83.33 → **84.64** (**+1.30**)<br>ARC-Challenge: 63.05 → **64.42** (**+1.37**)<br>OpenBookQA: 48.80 → **49.20** (**+0.40**) | LiveCodeBench execution-v2: 58.46 → **60.13** (**+1.67**)<br>BIG-bench CS algorithms: 75.76 → **82.58** (**+6.82**) |
|
| 60 |
+
|
| 61 |
+
† 128-item subset. ARC and OpenBookQA use normalized multiple-choice accuracy; CRUXEval and LiveCodeBench execution-v2 measure output prediction. BBH and BIG-bench entries refer to the named tasks.
|
| 62 |
|
| 63 |
## Quick start
|
| 64 |
|