Instructions to use SurjoLabs/Surjo-100m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SurjoLabs/Surjo-100m with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="SurjoLabs/Surjo-100m", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("SurjoLabs/Surjo-100m", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use SurjoLabs/Surjo-100m with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SurjoLabs/Surjo-100m"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SurjoLabs/Surjo-100m",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/SurjoLabs/Surjo-100m

SGLang

How to use SurjoLabs/Surjo-100m with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "SurjoLabs/Surjo-100m" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SurjoLabs/Surjo-100m",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "SurjoLabs/Surjo-100m" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SurjoLabs/Surjo-100m",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use SurjoLabs/Surjo-100m with Docker Model Runner:
```
docker model run hf.co/SurjoLabs/Surjo-100m
```

Surjo-100m

Commit History

Add Transformers library (#1)

bd2dd85

spitfire4794

FlameF0X commited on 18 days ago

Create README.md

48c6cd9
verified

spitfire4794 commited on 25 days ago

Upload banner.png

2cdeeb3
verified

spitfire4794 commited on 25 days ago

Delete banner.png

64bd1af
verified

spitfire4794 commited on 25 days ago

Upload banner.png

9e243ec
verified

spitfire4794 commited on 25 days ago

Clean up: Delete 37 training checkpoint directories

09564b2
verified

spitfire4794 commited on 25 days ago

Deploy: Copy checkpoint-19999 files to repository root

e62b629
verified

spitfire4794 commited on 25 days ago

Squash history to single initial commit

345bcad

spitfire4794 commited on 25 days ago

Commit History

Add Transformers library (#1) bd2dd85

Create README.md 48c6cd9 verified

Upload banner.png 2cdeeb3 verified

Delete banner.png 64bd1af verified

Upload banner.png 9e243ec verified

Clean up: Delete 37 training checkpoint directories 09564b2 verified

Deploy: Copy checkpoint-19999 files to repository root e62b629 verified

Squash history to single initial commit 345bcad

Add Transformers library (#1)

bd2dd85

Create README.md

48c6cd9
verified

Upload banner.png

2cdeeb3
verified

Delete banner.png

64bd1af
verified

Upload banner.png

9e243ec
verified

Clean up: Delete 37 training checkpoint directories

09564b2
verified

Deploy: Copy checkpoint-19999 files to repository root

e62b629
verified

Squash history to single initial commit

345bcad