Text Generation
PEFT
Safetensors
Transformers
lora
promptcot
chain-of-thought
mathematical-reasoning
unsloth
Instructions to use PanzerBread/PromptCoT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use PanzerBread/PromptCoT with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/deepseek-r1-distill-qwen-7b-unsloth-bnb-4bit") model = PeftModel.from_pretrained(base_model, "PanzerBread/PromptCoT") - Transformers
How to use PanzerBread/PromptCoT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="PanzerBread/PromptCoT")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("PanzerBread/PromptCoT", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use PanzerBread/PromptCoT with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PanzerBread/PromptCoT" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PanzerBread/PromptCoT", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/PanzerBread/PromptCoT
- SGLang
How to use PanzerBread/PromptCoT with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "PanzerBread/PromptCoT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PanzerBread/PromptCoT", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "PanzerBread/PromptCoT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PanzerBread/PromptCoT", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Desktop
- Docker Model Runner
How to use PanzerBread/PromptCoT with Docker Model Runner:
docker model run hf.co/PanzerBread/PromptCoT
Commit History
-
Upload folder using huggingface_hub
Verified signature54d45b6 -
Upload folder using huggingface_hub
Verified signature4da84c3 -
Upload folder using huggingface_hub
Verified signaturefec4649 -
Delete coding-0.2/p/iter-4
Verified signaturedd209a2 -
Delete coding-0.2/q/iter-5
Verified signature3b8d311 -
Delete coding-0.2/p/iter-5
Verified signature2cbdf39 -
Upload folder using huggingface_hub
Verified signaturee9f91d1 -
Upload folder using huggingface_hub
Verified signature5a8250b -
Upload folder using huggingface_hub
Verified signatureedf574d -
Upload folder using huggingface_hub
Verified signaturebe8543b -
Upload folder using huggingface_hub
Verified signaturec11b64b -
Upload folder using huggingface_hub
Verified signaturef80ca1f -
Upload folder using huggingface_hub
Verified signature3ba608b -
Upload folder using huggingface_hub
Verified signature5d23c95 -
Upload folder using huggingface_hub
Verified signature18df2f1 -
Upload folder using huggingface_hub
Verified signaturea3a583c -
Upload folder using huggingface_hub
Verified signatureb87e110 -
Upload folder using huggingface_hub
Verified signaturefea98f8 -
Upload folder using huggingface_hub
Verified signature7dc29fe -
Upload folder using huggingface_hub
Verified signature9f11147 -
Upload folder using huggingface_hub
Verified signature5fd4c0e -
Upload folder using huggingface_hub
Verified signatureec81976
-
Upload folder using huggingface_hub
Verified signaturec37b26f -
Upload folder using huggingface_hub
Verified signature867cd8d -
Upload folder using huggingface_hub
Verified signature2172b87 -
Upload folder using huggingface_hub
Verified signatureb9b60aa -
Upload folder using huggingface_hub
Verified signature111d5ff -
Upload folder using huggingface_hub
Verified signaturece1f11b -
Delete coding-0.2/p
Verified signature11b04eb -
Upload folder using huggingface_hub
Verified signaturec028ccf -
Upload folder using huggingface_hub
Verified signaturef6009e5 -
Upload folder using huggingface_hub
Verified signature87f81c7 -
Upload folder using huggingface_hub
Verified signature869e277 -
Upload folder using huggingface_hub
Verified signaturec255564 -
Upload folder using huggingface_hub
Verified signatureebf7d7d -
Upload folder using huggingface_hub
Verified signature03672e4 -
Upload folder using huggingface_hub
Verified signature55711d2 -
Upload folder using huggingface_hub
Verified signature3cb4965 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster640197a -
Delete coding-0.2
Verified signature115861d -
Upload folder using huggingface_hub
Verified signature94e232b -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster731ce61
-
Update README.md
Verified signaturead5ae36 -
Update README.md
Verified signature8278bb4 -
Update README.md
Verified signature4cef487 -
Create README.md
Verified signature1641c45 -
Upload folder using huggingface_hub
Verified signaturefed4c4c -
Upload folder using huggingface_hub
Verified signature7fd8ae4 -
Upload folder using huggingface_hub
Verified signature6e0cf79 -
Upload folder using huggingface_hub
Verified signaturecc9fb4f