Text Generation
Transformers
PyTorch
English
MAELM
feature-extraction
audio2text
music2text
musicllm
music foundation model
custom_code
Instructions to use UniMus/OpenJMLA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use UniMus/OpenJMLA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="UniMus/OpenJMLA", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("UniMus/OpenJMLA", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use UniMus/OpenJMLA with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "UniMus/OpenJMLA" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "UniMus/OpenJMLA", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/UniMus/OpenJMLA
- SGLang
How to use UniMus/OpenJMLA with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "UniMus/OpenJMLA" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "UniMus/OpenJMLA", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "UniMus/OpenJMLA" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "UniMus/OpenJMLA", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use UniMus/OpenJMLA with Docker Model Runner:
docker model run hf.co/UniMus/OpenJMLA
Commit History
Update README.md d190fe9
Update README.md 6a42acc
Update README.md 70c1315
Update README.md 57485ab
Update README.md a5ff11e
Update README.md 9251da2
Update README.md 7d2c64a
Update README.md d33facd
Update README.md dba8eb5
Update README.md a91e726
Update README.md 8f5733d
Update README.md b119469
UniMus commited on
Update README.md 8bcfe60
sino commited on
Update README.md 73e56d0
sino commited on
Update README.md c96ae54
sino commited on
Update README.md c458959
sino commited on
Update README.md ac615eb
sino commited on
Update README.md 26f1032
sino commited on
Update README.md bb3bb99
sino commited on
Update README.md 0c08cb0
sino commited on
Update README.md 9a4a887
sino commited on
Update README.md ed14d60
sino commited on
Update README.md 99f673d
sino commited on
Update README.md 8fb04ef
sino commited on
Update README.md ced1e40
sino commited on
Upload README.md d0ec5fd
sino commited on
Update README.md b2222c9
sino commited on
Update README.md a357ba5
sino commited on
Update README.md 07bc64b
sino commited on
Update README.md 0d1f840
sino commited on
Create README.md 5642997
sino commited on