Text Generation
Transformers
PyTorch
English
multilingual
helion
deepxr
xlarge
instruction-tuned
causal-lm
conversational
custom_code
Eval Results (legacy)
bitsandbytes
Instructions to use DeepXR/Helion-V1.5-XL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DeepXR/Helion-V1.5-XL with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="DeepXR/Helion-V1.5-XL", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("DeepXR/Helion-V1.5-XL", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use DeepXR/Helion-V1.5-XL with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DeepXR/Helion-V1.5-XL" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepXR/Helion-V1.5-XL", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/DeepXR/Helion-V1.5-XL
- SGLang
How to use DeepXR/Helion-V1.5-XL with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "DeepXR/Helion-V1.5-XL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepXR/Helion-V1.5-XL", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "DeepXR/Helion-V1.5-XL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepXR/Helion-V1.5-XL", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use DeepXR/Helion-V1.5-XL with Docker Model Runner:
docker model run hf.co/DeepXR/Helion-V1.5-XL
Commit History
-
Update README.md
Verified signatureab25534
-
Update README.md
Verified signatureb63ee29 -
Create deployment_guide.md
Verified signature531273f -
Upload 26 files
Verified signaturec3128bc -
Update README.md
Verified signature147474c
-
Upload 20 files
Verified signaturedd6c4d8 -
Upload 20 files
Verified signature9ea904d -
Upload 15 files
Verified signaturef307c6f -
Upload 14 files
Verified signatureac609fa -
Create safeguard_filters.py (#2)
Verified signature- Create safeguard_filters.py (aae85cefcc4e1a50f2efa4bfae4be062703217e1) Co-authored-by: Specfic Cognito <Specific-Cognito@users.noreply.huggingface.co>f907a62 -
Create safety_evaluation_report.json (#3)
Verified signature- Create safety_evaluation_report.json (f6af7e69f630066c811839dcb9f2dd02fdbe0252) Co-authored-by: Specfic Cognito <Specific-Cognito@users.noreply.huggingface.co>71b20a1 -
Create safety_config.json (#1)
Verified signature- Create safety_config.json (217e43126bfe3d0c1c2d82a573a9d20bc638c5be) Co-authored-by: Specfic Cognito <Specific-Cognito@users.noreply.huggingface.co>3cdf29d -
Upload model-00011-of-00106.safetensors
Verified signature4bf3b13 -
Upload 5 files
Verified signature3cec64b -
Upload 5 files
Verified signaturea4c87b1 -
Create optimizer_config.json
Verified signaturee6fc028 -
Create benchmark_results.json
Verified signature870da8b -
Create model_memory.json
Verified signature1e51c60 -
Create trainer_config.yaml
Verified signaturefdac17c -
Create configuration_helion.py
Verified signature3d5c120 -
Create modeling_helion.py
Verified signature0e49e6c -
Create special_tokens_map.json
Verified signature9ab4173 -
Create pytorch_model.bin.index.json
Verified signature98b5da4 -
Update README.md
Verified signaturec358a54 -
Create example_usage.py
Verified signature9426882 -
Create model_card.json
Verified signature758bb3e -
Create inference.py
Verified signature23a2e44 -
Create tokenizer_config.json
Verified signature676bc11 -
Create generation_config.json
Verified signature53f9076 -
Create config.json
Verified signatured82b168 -
Delete model-00001-of-00179.safetensors
Verified signatured74816b -
Delete model-00002-of-00179.safetensors
Verified signature99aa76d -
Delete model-00003-of-00179.safetensors
Verified signature4714d28 -
Delete model-00004-of-00179.safetensors
Verified signature8cc5db1 -
Delete model-00005-of-00179.safetensors
Verified signature00f841a -
Delete model-00006-of-00179.safetensors
Verified signaturef3afca3 -
Delete model-00007-of-00179.safetensors
Verified signature1016b6e -
Delete model-00008-of-00179.safetensors
Verified signaturea5b0189 -
Delete model-00009-of-00179.safetensors
Verified signature4ac6e7a -
Delete model-00010-of-00179.safetensors
Verified signatured623471 -
Upload 10 files
Verified signature8a3e7f3 -
initial commit
Verified signaturecf729e4