Spaces:
Runtime error
Runtime error
Commit History
-
Update Dockerfile
Verified signature815117f -
Update requirements.txt
Verified signature5e5987a -
Update app.py
Verified signatureacc073e -
Update requirements.txt
Verified signaturef1dbd91 -
Update requirements.txt
Verified signature3c61cd5 -
Update requirements.txt
Verified signatured7dc58a -
Update requirements.txt
Verified signature8f4948c -
Create Dockerfile
Verified signature28744e3 -
Create app.py
Verified signature6520c83 -
app.py
Verified signaturefrom transformers import AutoModelForCausalLM, AutoTokenizer from fastapi import FastAPI app = FastAPI() @app.get("/") def greet_json(): model_name = "Qwen/QwQ-32B-Preview" model = AutoModelForCausalLM.from_pretrained( model_name, torch_dtype="auto", device_map="auto" ) tokenizer = AutoTokenizer.from_pretrained(model_name) prompt = "How many r in strawberry." messages = [ {"role": "system", "content": "You are a helpful and harmless assistant. You are Qwen developed by Alibaba. You should think step-by-step."}, {"role": "user", "content": prompt} ] text = tokenizer.apply_chat_template( messages, tokenize=False, add_generation_prompt=True ) model_inputs = tokenizer([text], return_tensors="pt").to(model.device) generated_ids = model.generate( **model_inputs, max_new_tokens=512 ) generated_ids = [ output_ids[len(input_ids):] for input_ids, output…6976e86 -
initial commit
Verified signature6872533