Instructions to use jonathanhe123/iapo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jonathanhe123/iapo with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jonathanhe123/iapo")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jonathanhe123/iapo", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jonathanhe123/iapo with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jonathanhe123/iapo" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jonathanhe123/iapo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/jonathanhe123/iapo
- SGLang
How to use jonathanhe123/iapo with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jonathanhe123/iapo" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jonathanhe123/iapo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jonathanhe123/iapo" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jonathanhe123/iapo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use jonathanhe123/iapo with Docker Model Runner:
docker model run hf.co/jonathanhe123/iapo
Commit History
-
Update metadata and improve model card
Verified signatureHi! I'm Niels, part of the community science team at Hugging Face. This PR improves the model card and metadata for the IAPO checkpoints: - Changed the `pipeline_tag` from `reinforcement-learning` to `text-generation` for better discoverability and to enable the inference widget/standard LLM evaluation. - Added `library_name: transformers` to the metadata to enable the "Use in Transformers" code snippet button. - Cleaned up the Markdown layout and ensured clear links to the paper and code repository. - Provided a clear usage example for loading the different subfolders available in this repository.fd05951
-
Upload Qwen2.5-7B-Instruct_GSM8K/model-00001-of-00004.safetensors with huggingface_hub
Verified signature820cb88 -
Upload folder using huggingface_hub
Verified signature7af1a6f -
Upload folder using huggingface_hub
Verified signatureb805b4a -
Upload Qwen2.5-7B-Instruct_DAPO-Math-17k/model-00003-of-00004.safetensors with huggingface_hub
Verified signatureb0c322b -
Upload Qwen2.5-7B-Instruct_DAPO-Math-17k/model-00002-of-00004.safetensors with huggingface_hub
Verified signature97b423a
-
Upload Qwen2.5-7B-Instruct_DAPO-Math-17k/model-00001-of-00004.safetensors with huggingface_hub
Verified signature7cdecfb -
Update README.md
Verified signature115039f -
Update README.md
Verified signatureb264d85 -
Update README.md
Verified signature94ed2b6 -
Upload folder using huggingface_hub
Verified signature8e4e271 -
Upload folder using huggingface_hub
Verified signature4ab7a26
-
Upload folder using huggingface_hub
Verified signaturedef23e5
-
Upload folder using huggingface_hub
Verified signature861b9dd -
Upload folder using huggingface_hub
Verified signature8c9e22d -
Upload folder using huggingface_hub
Verified signature181ec8b -
Upload folder using huggingface_hub
Verified signaturef90c313
-
Upload folder using huggingface_hub
Verified signaturee221e57 -
Delete vocab.json
Verified signature950388a -
Delete tokenizer_config.json
Verified signature5553e59 -
Delete tokenizer.json
Verified signatureafe4e7d -
Delete special_tokens_map.json
Verified signature25534e5 -
Delete model.safetensors
Verified signature38215e3 -
Delete merges.txt
Verified signature40e6963 -
Delete generation_config.json
Verified signature0e177aa -
Delete config.json
Verified signature9487d21 -
Delete chat_template.jinja
Verified signature4d7fd69 -
Delete added_tokens.json
Verified signatured93c653 -
Delete .gitattributes
Verified signatured48cd3d -
Upload folder using huggingface_hub
Verified signature1221a85
-
initial commit
Verified signature630363c