Instructions to use pthinc/Asena_ESP32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use pthinc/Asena_ESP32 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="pthinc/Asena_ESP32")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("pthinc/Asena_ESP32")
model = AutoModelForCausalLM.from_pretrained("pthinc/Asena_ESP32", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use pthinc/Asena_ESP32 with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf pthinc/Asena_ESP32:F16
# Run inference directly in the terminal:
llama cli -hf pthinc/Asena_ESP32:F16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf pthinc/Asena_ESP32:F16
# Run inference directly in the terminal:
llama cli -hf pthinc/Asena_ESP32:F16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf pthinc/Asena_ESP32:F16
# Run inference directly in the terminal:
./llama-cli -hf pthinc/Asena_ESP32:F16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf pthinc/Asena_ESP32:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf pthinc/Asena_ESP32:F16

Use Docker

docker model run hf.co/pthinc/Asena_ESP32:F16

Llama new
LM Studio
Jan

vLLM

How to use pthinc/Asena_ESP32 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "pthinc/Asena_ESP32"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/Asena_ESP32",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/pthinc/Asena_ESP32:F16

SGLang

How to use pthinc/Asena_ESP32 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "pthinc/Asena_ESP32" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/Asena_ESP32",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "pthinc/Asena_ESP32" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/Asena_ESP32",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Ollama
How to use pthinc/Asena_ESP32 with Ollama:
```
ollama run hf.co/pthinc/Asena_ESP32:F16
```
Unsloth Desktop
Docker Model Runner
How to use pthinc/Asena_ESP32 with Docker Model Runner:
```
docker model run hf.co/pthinc/Asena_ESP32:F16
```

Lemonade

How to use pthinc/Asena_ESP32 with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull pthinc/Asena_ESP32:F16

Run and chat with the model

lemonade run user.Asena_ESP32-F16

List all available models

lemonade list

Atomic Chat

Asena_ESP32

Commit History

May 4

17:06
Update README.md

prometechinc

Verified signature
f15c827
10:54
Update README.md

prometechinc

Verified signature
d94f90d

May 3

12:23
Update README.md

prometechinc

Verified signature
5520752
12:21
Update README.md

prometechinc

Verified signature
4735e92
12:05
Update README.md

prometechinc

Verified signature
ade7480
02:53
Update README.md

prometechinc

Verified signature
49932ec

May 2

08:27
Update README.md

prometechinc

Verified signature
e4db59b
08:13
Update README.md

prometechinc

Verified signature
792463e
05:31
Update README.md

prometechinc

Verified signature
5c29a13

May 1

18:44
Update README.md

prometechinc

Verified signature
07c7ee2
09:18
Update README.md

prometechinc

Verified signature
e8e9a17
09:02
Update README.md

prometechinc

Verified signature
f06998c
08:54
Update README.md

prometechinc

Verified signature
c4c6568
08:24
Update README.md

prometechinc

Verified signature
7b30693
08:21
Update README.md

prometechinc

Verified signature
041be64
08:21
Update README.md

prometechinc

Verified signature
dc95d7b
08:20
Update README.md

prometechinc

Verified signature
8f52d9e
08:20
Update README.md

prometechinc

Verified signature
e1e591d
08:17
Update README.md

prometechinc

Verified signature
5a201ab
08:09
Update README.md

prometechinc

Verified signature
da60fa6
08:07
Update README.md

prometechinc

Verified signature
54f04d7
07:29
Update README.md

prometechinc

Verified signature
a4382c6
07:28
Update README.md

prometechinc

Verified signature
8f8fadb
07:27
Update README.md

prometechinc

Verified signature
c4d29f9

Apr 30

21:40
Update README.md

prometechinc

Verified signature
d182e36
21:39
Update README.md

prometechinc

Verified signature
c7d5427
21:38
Update README.md

prometechinc

Verified signature
302058b
21:22
Upload folder using huggingface_hub

prometechinc

Verified signature
c9f4162
21:21
Upload folder using huggingface_hub

prometechinc

Verified signature
20f63d5
21:17
Update README.md

prometechinc

Verified signature
7a64d09
20:48
Update README.md

prometechinc

Verified signature
5d2b430
20:47
Update README.md

prometechinc

Verified signature
075fbbf
20:16
Update README.md

prometechinc

Verified signature
ea8c4d6
20:16
Update README.md

prometechinc

Verified signature
57555ff
20:15
Update README.md

prometechinc

Verified signature
209b7a0
19:50
Update README.md

prometechinc

Verified signature
0e0b700
19:45
Update README.md

prometechinc

Verified signature
d08c8cd
19:24
Update README.md

prometechinc

Verified signature
fe00e84
19:20
Create license.md

prometechinc

Verified signature
041899b
19:14
Update README.md

prometechinc

Verified signature
177d003
19:06
Update README.md

prometechinc

Verified signature
c8b8162
19:04
Update README.md

prometechinc

Verified signature
1fbdcfe
19:02
Update README.md

prometechinc

Verified signature
bae4dbd
18:40
initial commit

prometechinc

Verified signature
bd71205

Commit History

May 4

Update README.md

Update README.md

May 3

Update README.md

Update README.md

Update README.md

Update README.md

May 2

Update README.md

Update README.md

Update README.md

May 1

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Apr 30

Update README.md

Update README.md

Update README.md

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Create license.md

Update README.md

Update README.md

Update README.md

Update README.md

initial commit