Instructions to use meihant/AnonymousModel-mht with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use meihant/AnonymousModel-mht with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="meihant/AnonymousModel-mht")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("meihant/AnonymousModel-mht", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use meihant/AnonymousModel-mht with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "meihant/AnonymousModel-mht" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/meihant/AnonymousModel-mht
- SGLang
How to use meihant/AnonymousModel-mht with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "meihant/AnonymousModel-mht" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "meihant/AnonymousModel-mht" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meihant/AnonymousModel-mht", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use meihant/AnonymousModel-mht with Docker Model Runner:
docker model run hf.co/meihant/AnonymousModel-mht
Add datasets/FCP-20B artifacts 104-111
Browse files- datasets/FCP-20B/encoded/020/supervised.bin +3 -0
- datasets/FCP-20B/encoded/021/body.bin +3 -0
- datasets/FCP-20B/encoded/021/ids.bin +3 -0
- datasets/FCP-20B/encoded/021/labels.bin +3 -0
- datasets/FCP-20B/encoded/021/offsets.bin +3 -0
- datasets/FCP-20B/encoded/021/supervised.bin +3 -0
- datasets/FCP-20B/encoded/022/ids.bin +3 -0
- datasets/FCP-20B/encoded/022/labels.bin +3 -0
datasets/FCP-20B/encoded/020/supervised.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6128a240bb295dbd9aa53e10f28c3d5a0e10484ad51d1f387bfa4050c3065d2b
|
| 3 |
+
size 4130336
|
datasets/FCP-20B/encoded/021/body.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4df00606766c8eccefc5d0cd084866eb1961ccd859628946984e7625f225207
|
| 3 |
+
size 4112232
|
datasets/FCP-20B/encoded/021/ids.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d12f1a07c0e14c06250cd04d05fdee2fed475e5c8ca316fda6890e2f7adec69e
|
| 3 |
+
size 2081601072
|
datasets/FCP-20B/encoded/021/labels.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:36d77655c0459def98ab884b3b2f62924bedf39795b59c4721a65121ec731696
|
| 3 |
+
size 2081601072
|
datasets/FCP-20B/encoded/021/offsets.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:590867b37da23c09ba7a7fae031068cc8e781082f0b93907b565ddac78b14ecd
|
| 3 |
+
size 4112240
|
datasets/FCP-20B/encoded/021/supervised.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a6f53b97c328687270d53f9a91bb053a80164ef2de35f83f3a08626cdd617b16
|
| 3 |
+
size 4112232
|
datasets/FCP-20B/encoded/022/ids.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4fce2517fafc365a7749ed04e37a7a3ab51a6bde7ff60fa23edcf6c3c0ed5972
|
| 3 |
+
size 2076974020
|
datasets/FCP-20B/encoded/022/labels.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c221aaf610ea2dc40be890c74f32557d83ae1e3f0d1bf4736f74cf9f10d2b5a3
|
| 3 |
+
size 2076974020
|