Instructions to use luffycodes/tutorbot-spock-bio-llama-diff with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use luffycodes/tutorbot-spock-bio-llama-diff with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="luffycodes/tutorbot-spock-bio-llama-diff")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("luffycodes/tutorbot-spock-bio-llama-diff")
model = AutoModelForCausalLM.from_pretrained("luffycodes/tutorbot-spock-bio-llama-diff", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use luffycodes/tutorbot-spock-bio-llama-diff with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "luffycodes/tutorbot-spock-bio-llama-diff"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "luffycodes/tutorbot-spock-bio-llama-diff",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/luffycodes/tutorbot-spock-bio-llama-diff

SGLang

How to use luffycodes/tutorbot-spock-bio-llama-diff with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "luffycodes/tutorbot-spock-bio-llama-diff" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "luffycodes/tutorbot-spock-bio-llama-diff",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "luffycodes/tutorbot-spock-bio-llama-diff" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "luffycodes/tutorbot-spock-bio-llama-diff",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use luffycodes/tutorbot-spock-bio-llama-diff with Docker Model Runner:
```
docker model run hf.co/luffycodes/tutorbot-spock-bio-llama-diff
```

tutorbot-spock-bio-llama-diff

Commit History

May 23, 2025

13:45
Adding `safetensors` variant of this model⁠

SFconvertbot

Verified signature
cf547b9

Jun 8, 2023

01:19
Update README.md

luffycodes

7e51eb2
01:18
Update README.md

luffycodes

6e2f7e2

Jun 2, 2023

13:55
Update README.md

luffycodes

06f2b68

Jun 1, 2023

01:24
Update README.md

luffycodes

8fe24ab
01:24
Update README.md

luffycodes

79a1498
01:23
Update README.md

luffycodes

9d2f7b8

May 31, 2023

20:17
Update README.md

luffycodes

879ed32
19:19
Update README.md

luffycodes

604be03
18:13
Update README.md

luffycodes

ca866fd
18:13
Update README.md

luffycodes

eca15ed
18:12
Update README.md

luffycodes

a2c76a0
18:12
Update README.md

luffycodes

7f8bb1c
17:43
Create README.md

luffycodes

d2df1d1
17:42
Upload tokenizer

luffycodes

4a0520e
17:41
Upload LlamaForCausalLM

luffycodes

8ff8f54
17:36
initial commit

luffycodes

9c48958

Commit History

May 23, 2025

Adding `safetensors` variant of this model⁠

Jun 8, 2023

Update README.md

Update README.md

Jun 2, 2023

Update README.md

Jun 1, 2023

Update README.md

Update README.md

Update README.md

May 31, 2023

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Create README.md

Upload tokenizer

Upload LlamaForCausalLM

initial commit