Instructions to use aniruddh123464/allmodels with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aniruddh123464/allmodels with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="aniruddh123464/allmodels")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aniruddh123464/allmodels", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use aniruddh123464/allmodels with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aniruddh123464/allmodels" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aniruddh123464/allmodels", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/aniruddh123464/allmodels
- SGLang
How to use aniruddh123464/allmodels with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "aniruddh123464/allmodels" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aniruddh123464/allmodels", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "aniruddh123464/allmodels" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aniruddh123464/allmodels", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use aniruddh123464/allmodels with Docker Model Runner:
docker model run hf.co/aniruddh123464/allmodels
Commit History
-
Upload Qwen2-VL-72B-Instruct/vocab.json with huggingface_hub
Verified signaturea4da050 -
Upload Qwen2-VL-72B-Instruct/tokenizer_config.json with huggingface_hub
Verified signature3217066 -
Upload Qwen2-VL-72B-Instruct/tokenizer.json with huggingface_hub
Verified signature7411f3e -
Upload Qwen2-VL-72B-Instruct/preprocessor_config.json with huggingface_hub
Verified signature44239c1 -
Upload Qwen2-VL-72B-Instruct/model.safetensors.index.json with huggingface_hub
Verified signaturee6084c0 -
Upload Qwen2-VL-72B-Instruct/model-00038-of-00038.safetensors with huggingface_hub
Verified signaturef2855e6 -
Upload Qwen2-VL-72B-Instruct/model-00037-of-00038.safetensors with huggingface_hub
Verified signaturefba65bf -
Upload Qwen2-VL-72B-Instruct/model-00036-of-00038.safetensors with huggingface_hub
Verified signaturee2610fb -
Upload Qwen2-VL-72B-Instruct/model-00035-of-00038.safetensors with huggingface_hub
Verified signature678edd7 -
Upload Qwen2-VL-72B-Instruct/model-00034-of-00038.safetensors with huggingface_hub
Verified signature3fdac87 -
Upload Qwen2-VL-72B-Instruct/model-00033-of-00038.safetensors with huggingface_hub
Verified signatured5803aa -
Upload Qwen2-VL-72B-Instruct/model-00032-of-00038.safetensors with huggingface_hub
Verified signaturec22b14d -
Upload Qwen2-VL-72B-Instruct/model-00031-of-00038.safetensors with huggingface_hub
Verified signaturedb3763a -
Upload Qwen2-VL-72B-Instruct/model-00030-of-00038.safetensors with huggingface_hub
Verified signatureb2aa80d -
Upload Qwen2-VL-72B-Instruct/model-00029-of-00038.safetensors with huggingface_hub
Verified signature5453b1b -
Upload Qwen2-VL-72B-Instruct/model-00028-of-00038.safetensors with huggingface_hub
Verified signature180c509 -
Upload Qwen2-VL-72B-Instruct/model-00027-of-00038.safetensors with huggingface_hub
Verified signature9191384 -
Upload Qwen2-VL-72B-Instruct/model-00026-of-00038.safetensors with huggingface_hub
Verified signature0905761 -
Upload Qwen2-VL-72B-Instruct/model-00025-of-00038.safetensors with huggingface_hub
Verified signature2a3dc59 -
Upload Qwen2-VL-72B-Instruct/model-00024-of-00038.safetensors with huggingface_hub
Verified signature1516d58 -
Upload Qwen2-VL-72B-Instruct/model-00023-of-00038.safetensors with huggingface_hub
Verified signature5d79b6d -
Upload Qwen2-VL-72B-Instruct/model-00022-of-00038.safetensors with huggingface_hub
Verified signatured9de1e2 -
Upload Qwen2-VL-72B-Instruct/model-00021-of-00038.safetensors with huggingface_hub
Verified signature76d7374 -
Upload Qwen2-VL-72B-Instruct/model-00020-of-00038.safetensors with huggingface_hub
Verified signaturebceb439 -
Upload Qwen2-VL-72B-Instruct/model-00019-of-00038.safetensors with huggingface_hub
Verified signaturebfc5882 -
Upload Qwen2-VL-72B-Instruct/model-00018-of-00038.safetensors with huggingface_hub
Verified signature5e7e15f -
Upload Qwen2-VL-72B-Instruct/model-00017-of-00038.safetensors with huggingface_hub
Verified signature7908047 -
Upload Qwen2-VL-72B-Instruct/model-00016-of-00038.safetensors with huggingface_hub
Verified signatureb5faa2d -
Upload Qwen2-VL-72B-Instruct/model-00015-of-00038.safetensors with huggingface_hub
Verified signatureffde93c -
Upload Qwen2-VL-72B-Instruct/model-00014-of-00038.safetensors with huggingface_hub
Verified signaturec99ef40 -
Upload Qwen2-VL-72B-Instruct/model-00013-of-00038.safetensors with huggingface_hub
Verified signaturefb3a932 -
Upload Qwen2-VL-72B-Instruct/model-00012-of-00038.safetensors with huggingface_hub
Verified signaturec00162d -
Upload Qwen2-VL-72B-Instruct/model-00011-of-00038.safetensors with huggingface_hub
Verified signature00cb123 -
Upload Qwen2-VL-72B-Instruct/model-00010-of-00038.safetensors with huggingface_hub
Verified signatureb51894a -
Upload Qwen2-VL-72B-Instruct/model-00009-of-00038.safetensors with huggingface_hub
Verified signature352bcc8 -
Upload Qwen2-VL-72B-Instruct/model-00008-of-00038.safetensors with huggingface_hub
Verified signature68b5bec -
Upload Qwen2-VL-72B-Instruct/model-00007-of-00038.safetensors with huggingface_hub
Verified signatureda2d5a9 -
Upload Qwen2-VL-72B-Instruct/model-00006-of-00038.safetensors with huggingface_hub
Verified signatureef50e68 -
Upload Qwen2-VL-72B-Instruct/model-00005-of-00038.safetensors with huggingface_hub
Verified signatureb731e93 -
Upload Qwen2-VL-72B-Instruct/model-00004-of-00038.safetensors with huggingface_hub
Verified signature332420a -
Upload Qwen2-VL-72B-Instruct/model-00003-of-00038.safetensors with huggingface_hub
Verified signatured366c1b -
Upload Qwen2-VL-72B-Instruct/model-00002-of-00038.safetensors with huggingface_hub
Verified signature16d5424 -
Upload Qwen2-VL-72B-Instruct/model-00001-of-00038.safetensors with huggingface_hub
Verified signature61fcf67 -
Upload Qwen2-VL-72B-Instruct/merges.txt with huggingface_hub
Verified signaturebe1cab5 -
Upload Qwen2-VL-72B-Instruct/generation_config.json with huggingface_hub
Verified signaturef3059cc -
Upload Qwen2-VL-72B-Instruct/config.json with huggingface_hub
Verified signature26e2ba4 -
Upload Qwen2-VL-72B-Instruct/chat_template.json with huggingface_hub
Verified signature0a32a36 -
Upload Qwen2.5-32B-Instruct/vocab.json with huggingface_hub
Verified signature2d975b0 -
Upload Qwen2.5-32B-Instruct/tokenizer_config.json with huggingface_hub
Verified signature8f6fbc8 -
Upload Qwen2.5-32B-Instruct/tokenizer.json with huggingface_hub
Verified signature3395796