Instructions to use marveled/busya with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use marveled/busya with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="marveled/busya")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("marveled/busya") model = AutoModelForCausalLM.from_pretrained("marveled/busya", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use marveled/busya with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "marveled/busya" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "marveled/busya", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/marveled/busya
- SGLang
How to use marveled/busya with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "marveled/busya" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "marveled/busya", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "marveled/busya" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "marveled/busya", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use marveled/busya with Docker Model Runner:
docker model run hf.co/marveled/busya
Commit History
-
Create config.json
Verified signature70d4777 -
Update README.md
Verified signature05ca5e5 -
Update README.md
Verified signaturec1cd0ae -
Training in progress, epoch 179
Verified signature58c2f7a -
Training in progress, epoch 172
Verified signatured60cbfa -
Training in progress, epoch 164
Verified signature12bf436 -
Training in progress, epoch 157
Verified signature2304ad3 -
Training in progress, epoch 150
Verified signatureebc8458 -
Training in progress, epoch 142
Verified signature3c75d55 -
Training in progress, epoch 134
Verified signature88a959e -
Training in progress, epoch 128
Verified signatureec2cfd0 -
Training in progress, epoch 122
Verified signatureb407ea5 -
Training in progress, epoch 113
Verified signature5e57ec2 -
Training in progress, epoch 106
Verified signature757f551 -
Training in progress, epoch 98
Verified signature9a58327 -
Training in progress, epoch 91
Verified signatureea9c5af -
Training in progress, epoch 84
Verified signaturec6f7d56 -
Training in progress, epoch 76
Verified signatured77539c -
Training in progress, epoch 69
Verified signaturedd10809 -
Training in progress, epoch 61
Verified signaturee1c1cc0 -
Training in progress, epoch 54
Verified signature6cb3eea -
Training in progress, epoch 47
Verified signatureb9bf7b8 -
Training in progress, epoch 39
Verified signature991e584 -
Training in progress, epoch 32
Verified signature9a64508 -
Training in progress, epoch 23
Verified signature4bf5699 -
Training in progress, epoch 16
Verified signature6d79b94 -
Training in progress, epoch 9
Verified signature2cab5f4 -
Training in progress, epoch 4
Verified signature4bb18b5 -
Training in progress, epoch 1
Verified signature6ac9a78 -
Training in progress, epoch 79
Verified signature9ea1f35 -
Training in progress, epoch 71
Verified signature3996b08 -
Training in progress, epoch 64
Verified signature32db391 -
Training in progress, epoch 57
Verified signature8170c93 -
Training in progress, epoch 51
Verified signaturea7a24bd -
Training in progress, epoch 48
Verified signaturee4e6120 -
Training in progress, epoch 45
Verified signature7b78332 -
Training in progress, epoch 42
Verified signaturedcd4705 -
Training in progress, epoch 38
Verified signaturee506bd2 -
Training in progress, epoch 34
Verified signaturecc2c415 -
Training in progress, epoch 31
Verified signaturee2acd9f -
Training in progress, epoch 28
Verified signature5f24dfa -
Training in progress, epoch 25
Verified signaturecb80092 -
Training in progress, epoch 22
Verified signature27467bb -
Training in progress, epoch 18
Verified signature5c274b5 -
Training in progress, epoch 15
Verified signature9502dfb -
Training in progress, epoch 12
Verified signatureddfbb0c -
Training in progress, epoch 9
Verified signature4dbd998 -
Training in progress, epoch 5
Verified signature2c6633d -
Training in progress, epoch 1
Verified signatured474370 -
Rename Readme.md to README.md
Verified signature8b27a38