How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
# Run inference directly in the terminal:
llama cli -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
# Run inference directly in the terminal:
llama cli -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
# Run inference directly in the terminal:
./build/bin/llama cli -hf chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
Use Docker
docker model run hf.co/chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF:F16
Quick Links

gemma-3-270m-text2sql-oracle-postgres-GGUF

GGUF builds of chabab/gemma-3-270m-text2sql-oracle-postgres β€” Gemma-3 270M fine-tuned for Oracle / PostgreSQL text-to-SQL.

File Quant Size
gemma-3-270m-text2sql-f16.gguf f16 543 MB
gemma-3-270m-text2sql-q8_0.gguf q8_0 292 MB

Ollama

huggingface-cli download chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF gemma-3-270m-text2sql-q8_0.gguf Modelfile --local-dir .
ollama create text2sql -f Modelfile
ollama run text2sql "Schema:
employees(employee_id INTEGER PK, first_name VARCHAR(50), last_name VARCHAR(50), salary NUMERIC(12,2))

Question:
Show the five employees with the largest salary. Return only the SQL."

llama.cpp

llama-cli -m gemma-3-270m-text2sql-q8_0.gguf --temp 0 -p "<your schema + question>"

Use greedy decoding (temperature 0). The model is trained to emit exactly one SQL statement with no fences or commentary.

Downloads last month
32
GGUF
Model size
0.3B params
Architecture
gemma3
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for chabab/gemma-3-270m-text2sql-oracle-postgres-GGUF

Quantized
(1)
this model