Instructions to use Notbobjoe/TalkT2-0.1b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Notbobjoe/TalkT2-0.1b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Notbobjoe/TalkT2-0.1b")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Notbobjoe/TalkT2-0.1b")
model = AutoModelForCausalLM.from_pretrained("Notbobjoe/TalkT2-0.1b", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Notbobjoe/TalkT2-0.1b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Notbobjoe/TalkT2-0.1b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Notbobjoe/TalkT2-0.1b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Notbobjoe/TalkT2-0.1b

SGLang

How to use Notbobjoe/TalkT2-0.1b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Notbobjoe/TalkT2-0.1b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Notbobjoe/TalkT2-0.1b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Notbobjoe/TalkT2-0.1b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Notbobjoe/TalkT2-0.1b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Notbobjoe/TalkT2-0.1b with Docker Model Runner:
```
docker model run hf.co/Notbobjoe/TalkT2-0.1b
```

Notbobjoe commited on Aug 12, 2025

Commit

3077c43

verified ·

1 Parent(s): f7275c2

Update README.md

Browse files

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -106,9 +106,9 @@ You: Thanks
 usability = 10/10 - easy to set up and use small model aswell so dosnt require a beefy computer it just runs on almost anything
-smartness = 6/10 - general human knowledge and likes poetry and exploring its own questions about the univers
-human alikeness = 8/10  - somtimes inconsistant but makes it sound more human
 emotional awareness = 9/10 - really good and it critises itself somtimes
@@ -120,6 +120,8 @@ Coherence & Stability = 8 - as i said somtimes inconsistant but makes it feel mo
 overall = 9.5/10
 ### 🧪 What Makes TalkT2 Interesting
 - Emotional aware

 usability = 10/10 - easy to set up and use small model aswell so dosnt require a beefy computer it just runs on almost anything
+smartness (general human) = 9/10 - general human knowledge and likes poetry and exploring its own questions about the univers
+human alikeness = 9.5/10  - somtimes inconsistant but makes it sound more human and has general human knowledge making it more relatable
 emotional awareness = 9/10 - really good and it critises itself somtimes
 overall = 9.5/10
+when compairing this too outher models i noticed that this is the modst like a human some models might speak like a human but this one is the most relatable to a human as it knows as much as a general person dose and adds emotional awareness to its chat and personality an outher models responces feel stuck or repeated where as this model almost never has the same convo with the user
 ### 🧪 What Makes TalkT2 Interesting
 - Emotional aware