Instructions to use Ja007/test-muse-100k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Ja007/test-muse-100k with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Ja007/test-muse-100k")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Ja007/test-muse-100k") model = AutoModelForCausalLM.from_pretrained("Ja007/test-muse-100k", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Ja007/test-muse-100k with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Ja007/test-muse-100k" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ja007/test-muse-100k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Ja007/test-muse-100k
- SGLang
How to use Ja007/test-muse-100k with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Ja007/test-muse-100k" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ja007/test-muse-100k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Ja007/test-muse-100k" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ja007/test-muse-100k", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Ja007/test-muse-100k with Docker Model Runner:
docker model run hf.co/Ja007/test-muse-100k
Commit History
-
Training in progress, step 24000
Verified signature63698ab -
Training in progress, step 22000
Verified signaturee8bfb54 -
Training in progress, step 20000
Verified signaturecf4749e -
Training in progress, step 18000
Verified signaturec8f4828 -
Training in progress, step 16000
Verified signaturecd518cb -
Training in progress, step 14000
Verified signaturea1a3b4b -
Training in progress, step 12000
Verified signature0fa3bdb -
Training in progress, step 10000
Verified signature27e5505 -
Training in progress, step 8000
Verified signaturee002ddd -
Training in progress, step 6000
Verified signaturec2c0fd0 -
Training in progress, step 4000
Verified signature503cd16 -
Training in progress, step 2000
Verified signature02e4d40 -
Upload pytorch_model.bin
Verified signature971858c -
Delete pytorch_model.bin
Verified signature19ffc22 -
Training in progress, step 2000
Verified signaturee9da6b9 -
Training in progress, step 1000
Verified signature4a7fb20 -
Training in progress, step 1000
Verified signature9ce5aa9 -
Training in progress, step 1000
Verified signature8716ef2 -
Model save
Verified signature1853fec -
Training in progress, step 500
Verified signature48f834a -
Training in progress, step 400
Verified signature8cc3e0e -
Training in progress, step 300
Verified signature26c673a -
Training in progress, step 200
Verified signature3a58047 -
Training in progress, step 100
Verified signature19c951e -
Model save
Verified signature1e72323 -
Training in progress, step 500
Verified signatureea34c0f -
Training in progress, step 400
Verified signature63c1eae -
Training in progress, step 300
Verified signature9a6514d -
Training in progress, step 200
Verified signaturea700c47 -
Training in progress, step 100
Verified signatureb1582e0 -
Model save
Verified signature2de95a8 -
Training in progress, step 500
Verified signaturec4f91b7 -
Model save
Verified signaturebc97189 -
Training in progress, step 500
Verified signature69a8ca1 -
Training in progress, step 400
Verified signature34d0466 -
Training in progress, step 300
Verified signature45a9342 -
Training in progress, step 200
Verified signature7025aa8 -
Training in progress, step 100
Verified signaturee2e5862 -
initial commit
Verified signaturebc3e0ab