Instructions to use meihant/AnonymousModel-mht with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use meihant/AnonymousModel-mht with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="meihant/AnonymousModel-mht")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("meihant/AnonymousModel-mht", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use meihant/AnonymousModel-mht with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "meihant/AnonymousModel-mht" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/meihant/AnonymousModel-mht
- SGLang
How to use meihant/AnonymousModel-mht with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "meihant/AnonymousModel-mht" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "meihant/AnonymousModel-mht" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use meihant/AnonymousModel-mht with Docker Model Runner:
docker model run hf.co/meihant/AnonymousModel-mht
Commit History
Today
-
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/16B
Verified signaturec577de0 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/16B artifacts 0-5
Verified signaturec2e2817 -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/14B
Verified signaturefde7b79 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/14B artifacts 0-5
Verified signature8c0ae56 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/20B
Verified signature073eced -
Add models/FCP-SmolLM2-360M-20B/checkpoints/20B artifacts 0-6
Verified signaturea911b6a -
Finalize verified models/FCP-SmolLM2-360M-20B
Verified signature6a76125 -
Add models/FCP-SmolLM2-360M-20B artifacts 0-5
Verified signature1c6b9f2 -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/12B
Verified signatured1e74f9 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/12B artifacts 0-5
Verified signature1d5793d -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/10B
Verified signaturec8533e4 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/10B artifacts 0-5
Verified signature1fc76ef -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/8B
Verified signatureadd31a2 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/8B artifacts 0-5
Verified signature1db83a6 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/18B
Verified signatureb972e48 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/18B artifacts 0-6
Verified signaturea6577cd -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/6B
Verified signature385518d -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/6B artifacts 0-5
Verified signature358ec08 -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/4B
Verified signature65e1159 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/4B artifacts 0-5
Verified signature9ff75ff -
Finalize verified models/KLLM-SmolLM2-360M-20B/checkpoints/2B
Verified signature99a0629 -
Add models/KLLM-SmolLM2-360M-20B/checkpoints/2B artifacts 0-5
Verified signature19a3e6d -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/16B
Verified signatureb224605 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/16B artifacts 0-6
Verified signature7d6df34
Yesterday
-
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/14B
Verified signature44e25f6 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/14B artifacts 0-6
Verified signaturee748f22 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/12B
Verified signature6ce0bb5 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/12B artifacts 0-6
Verified signature88fb691 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/10B
Verified signature1588300 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/10B artifacts 0-6
Verified signatured67f5ae -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/20B
Verified signaturead34762 -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/20B artifacts 0-6
Verified signature9db6739 -
Finalize verified models/Vanilla-SmolLM2-360M-20B
Verified signature91723b7 -
Add models/Vanilla-SmolLM2-360M-20B artifacts 0-5
Verified signature249ceb9 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/8B
Verified signaturec30a6e4 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/8B artifacts 0-6
Verified signature8207895 -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/18B
Verified signaturecf13a6b -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/18B artifacts 0-6
Verified signature2faef0c -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/16B
Verified signaturea6db599 -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/16B artifacts 0-6
Verified signature9a30ab1
2 days ago
-
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/6B
Verified signature9498ebd -
Add models/FCP-SmolLM2-360M-20B/checkpoints/6B artifacts 0-6
Verified signature3f6c0ff -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/14B
Verified signature1cf5620 -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/14B artifacts 0-6
Verified signature403a678 -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/12B
Verified signature4657fda -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/12B artifacts 0-6
Verified signature7f7d690 -
Finalize verified models/Vanilla-SmolLM2-360M-20B/checkpoints/10B
Verified signature3808078 -
Add models/Vanilla-SmolLM2-360M-20B/checkpoints/10B artifacts 0-6
Verified signatureaca6fd6 -
Finalize verified models/FCP-SmolLM2-360M-20B/checkpoints/4B
Verified signaturece5cca2 -
Add models/FCP-SmolLM2-360M-20B/checkpoints/4B artifacts 0-6
Verified signature4e6ea75