datedgptAgent commited on
Commit
6bcbb3e
·
verified ·
1 Parent(s): 22ed8ac

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -6
README.md CHANGED
@@ -56,12 +56,6 @@ output = model.generate(**inputs, max_new_tokens=128, do_sample=True,
56
  print(tokenizer.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
57
  ```
58
 
59
- ## Serving on HF Inference Endpoints
60
-
61
- This repo ships a `handler.py` that applies the chat template server-side —
62
- clients send plain text (or a messages list for multi-turn). Deploy with the
63
- Default container on a bf16-capable GPU (A10G or better).
64
-
65
  ## Limitations
66
 
67
  - Knowledge limited to the 2014 data vintage.
 
56
  print(tokenizer.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
57
  ```
58
 
 
 
 
 
 
 
59
  ## Limitations
60
 
61
  - Knowledge limited to the 2014 data vintage.