Instructions to use breadlicker45/MuseNeo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use breadlicker45/MuseNeo with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="breadlicker45/MuseNeo")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("breadlicker45/MuseNeo") model = AutoModelForCausalLM.from_pretrained("breadlicker45/MuseNeo", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use breadlicker45/MuseNeo with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "breadlicker45/MuseNeo" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "breadlicker45/MuseNeo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/breadlicker45/MuseNeo
- SGLang
How to use breadlicker45/MuseNeo with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "breadlicker45/MuseNeo" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "breadlicker45/MuseNeo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "breadlicker45/MuseNeo" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "breadlicker45/MuseNeo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use breadlicker45/MuseNeo with Docker Model Runner:
docker model run hf.co/breadlicker45/MuseNeo
Commit History
Update README.md 5152420
Update README.md 81f49fd
Update README.md 8e4ff9a
Update README.md 7fbc05a
Update README.md cb0942a
Update README.md 5f8282b
Update README.md 590f51f
Update README.md 27b7fa3
Update README.md e4d81c3
Update README.md 319e858
Update README.md 59391a9
Update README.md 61176ff
Update README.md d261421
Update README.md 38fddc6
Update README.md 11c25d4
Update README.md 72ab9fc
Update README.md c2a61cd
Update README.md 43163eb
Update README.md dd36905
Update README.md e741c65
Update README.md a63ec5f
Update README.md ff57289
Update README.md 74ae245
Update README.md 6147c10
initial commit 75387f1
matthew mitton commited on