Instructions to use 7vq0ir/alcy9 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use 7vq0ir/alcy9 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="7vq0ir/alcy9")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("7vq0ir/alcy9") model = AutoModelForCausalLM.from_pretrained("7vq0ir/alcy9", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use 7vq0ir/alcy9 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "7vq0ir/alcy9" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "7vq0ir/alcy9", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/7vq0ir/alcy9
- SGLang
How to use 7vq0ir/alcy9 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "7vq0ir/alcy9" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "7vq0ir/alcy9", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "7vq0ir/alcy9" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "7vq0ir/alcy9", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use 7vq0ir/alcy9 with Docker Model Runner:
docker model run hf.co/7vq0ir/alcy9
Commit History
-
Upload LlamaForCausalLM
Verified signature10e6233 -
Upload LlamaForCausalLM
Verified signatureb01797d -
Upload LlamaForCausalLM
Verified signaturee9e1131 -
Upload LlamaForCausalLM
Verified signatureec9c593 -
Upload LlamaForCausalLM
Verified signature0460dba -
Upload LlamaForCausalLM
Verified signature6c71ab4 -
Upload LlamaForCausalLM
Verified signature14ba35e -
Upload LlamaForCausalLM
Verified signatureb454d11 -
Upload LlamaForCausalLM
Verified signaturea449c28 -
Upload LlamaForCausalLM
Verified signature2cf782c -
Upload LlamaForCausalLM
Verified signaturea6fc29d -
Upload LlamaForCausalLM
Verified signature9e6f340 -
Upload LlamaForCausalLM
Verified signature964d122 -
Upload LlamaForCausalLM
Verified signature2940076 -
Upload LlamaForCausalLM
Verified signature48c9166 -
Upload LlamaForCausalLM
Verified signaturea310470 -
Upload LlamaForCausalLM
Verified signatureef45558 -
Upload LlamaForCausalLM
Verified signaturee9b7e95 -
Upload LlamaForCausalLM
Verified signature47870b7 -
Upload LlamaForCausalLM
Verified signature01b6f02 -
Upload LlamaForCausalLM
Verified signature04416d3 -
Upload LlamaForCausalLM
Verified signaturec55d1c4 -
Upload LlamaForCausalLM
Verified signatureddecce1 -
Upload LlamaForCausalLM
Verified signature2e04479 -
Upload LlamaForCausalLM
Verified signaturee085cac -
Upload LlamaForCausalLM
Verified signaturea59be13 -
Upload LlamaForCausalLM
Verified signature83b0560 -
Upload LlamaForCausalLM
Verified signature5fe287c -
Upload LlamaForCausalLM
Verified signaturee8d83aa -
Upload LlamaForCausalLM
Verified signature2396d95 -
Upload LlamaForCausalLM
Verified signaturea76f3d9 -
Upload LlamaForCausalLM
Verified signatured9860b0 -
Upload LlamaForCausalLM
Verified signature1ee37e6 -
Upload LlamaForCausalLM
Verified signaturecd5cd19 -
Upload LlamaForCausalLM
Verified signature83cff4a
-
Upload LlamaForCausalLM
Verified signature8fb2843 -
Upload LlamaForCausalLM
Verified signaturecd4104e -
Upload LlamaForCausalLM
Verified signatureb85820d -
Upload LlamaForCausalLM
Verified signatured8c26c2 -
Upload LlamaForCausalLM
Verified signaturefccda08 -
Upload LlamaForCausalLM
Verified signature1298a52 -
Upload LlamaForCausalLM
Verified signaturea2c5ce4 -
Upload LlamaForCausalLM
Verified signature0168df1 -
Upload LlamaForCausalLM
Verified signature25a699c -
Upload LlamaForCausalLM
Verified signature07b4e13 -
Upload LlamaForCausalLM
Verified signature1441a15 -
Upload LlamaForCausalLM
Verified signature0f4e0bf -
Upload LlamaForCausalLM
Verified signature520a5af -
Upload LlamaForCausalLM
Verified signaturea31e5ee -
Upload LlamaForCausalLM
Verified signaturecd8fd7f