Text Generation
Transformers
Safetensors
llama
text-generation-inference
8-bit precision
bitsandbytes
Instructions to use samadpls/querypls-prompt2sql with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use samadpls/querypls-prompt2sql with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="samadpls/querypls-prompt2sql")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("samadpls/querypls-prompt2sql") model = AutoModelForCausalLM.from_pretrained("samadpls/querypls-prompt2sql", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use samadpls/querypls-prompt2sql with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "samadpls/querypls-prompt2sql" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "samadpls/querypls-prompt2sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/samadpls/querypls-prompt2sql
- SGLang
How to use samadpls/querypls-prompt2sql with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "samadpls/querypls-prompt2sql" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "samadpls/querypls-prompt2sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "samadpls/querypls-prompt2sql" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "samadpls/querypls-prompt2sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use samadpls/querypls-prompt2sql with Docker Model Runner:
docker model run hf.co/samadpls/querypls-prompt2sql
Commit History
-
Update README.md
Verified signature5247a1d
-
Update README.md
Verified signaturee7de413
-
Create handler.py
Verified signature7480316
-
Update README.md
fdd2e4f -
Update README.md
809b315 -
Update README.md
45b8b5f -
Update README.md
0758a6a -
Update README.md
77af3c6 -
Refactored the README (#7)
- Refactored the README (a3749a70dec690474b5bd3b4e657a0863983ecc3)12639aa -
Upload tokenizer
7319fb8 -
Upload LlamaForCausalLM
19a2008
-
Delete tokenizer_config.json
1285357 -
Delete tokenizer.json
d48d742 -
Delete special_tokens_map.json
0944ecc -
Delete model.safetensors.index.json
57c50e4 -
Delete model-00002-of-00002.safetensors
e82aca7 -
Delete model-00001-of-00002.safetensors
0026967 -
Delete generation_config.json
31d28c8 -
Delete config.json
213a76e
-
Upload tokenizer
d8bf0e3 -
Upload GPTNeoXForCausalLM
e0068c6 -
Delete tokenizer_config.json
25eb7a5 -
Delete tokenizer.json
02f5b7a -
Delete special_tokens_map.json
2f667ed -
Delete model.safetensors.index.json
4ebb113 -
Delete model-00002-of-00002.safetensors
ff2c003 -
Delete model-00001-of-00002.safetensors
c94e2d5 -
Delete generation_config.json
b9ad6ae -
Delete config.json
b5da0ab -
Upload tokenizer
21a122d -
basic training
e60aeb9
-
Delete tokenizer_config.json
1ee0861 -
Delete tokenizer.json
76dfc2d -
Delete special_tokens_map.json
4c0bae7 -
Delete model.safetensors.index.json
114fccc -
Delete model-00002-of-00002.safetensors
2e1e4e5 -
Delete model-00001-of-00002.safetensors
85023f6 -
Delete generation_config.json
2c11c99 -
Delete config.json
a329639
-
Upload tokenizer
b23ff8f -
Upload LlamaForCausalLM
31dcc0a -
Delete tokenizer_config.json
a1304fb -
Delete tokenizer.json
1b03d72 -
Delete special_tokens_map.json
1890cf0 -
Delete pytorch_model.bin.index.json
cfb7a94 -
Delete pytorch_model-00002-of-00002.bin
c9eef28 -
Delete pytorch_model-00001-of-00002.bin
628e16d -
Delete generation_config.json
07b059b -
Delete config.json
4756da6 -
Update README.md
b8faf4b