Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -56,12 +56,6 @@ output = model.generate(**inputs, max_new_tokens=128, do_sample=True,
|
|
| 56 |
print(tokenizer.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
|
| 57 |
```
|
| 58 |
|
| 59 |
-
## Serving on HF Inference Endpoints
|
| 60 |
-
|
| 61 |
-
This repo ships a `handler.py` that applies the chat template server-side —
|
| 62 |
-
clients send plain text (or a messages list for multi-turn). Deploy with the
|
| 63 |
-
Default container on a bf16-capable GPU (A10G or better).
|
| 64 |
-
|
| 65 |
## Limitations
|
| 66 |
|
| 67 |
- Knowledge limited to the 2014 data vintage.
|
|
|
|
| 56 |
print(tokenizer.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
|
| 57 |
```
|
| 58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
## Limitations
|
| 60 |
|
| 61 |
- Knowledge limited to the 2014 data vintage.
|