Spaces:
Sleeping
Sleeping
File size: 222 Bytes
4b6ac7a | 1 2 3 4 5 6 7 8 9 10 | from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained(
"zoltanctoth/orca_mini_3B-GGUF", model_file="orca-mini-3b.q4_0.gguf"
)
prompt = "Hi! What is your dog's"
print(llm(prompt))
|