Instructions to use jla25/squareV3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jla25/squareV3 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("jla25/squareV3") model = AutoModelForSeq2SeqLM.from_pretrained("jla25/squareV3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update handler.py
Browse files- handler.py +1 -1
handler.py
CHANGED
|
@@ -30,7 +30,7 @@ class EndpointHandler:
|
|
| 30 |
generate_kwargs = {
|
| 31 |
"max_length": 1024,
|
| 32 |
"num_beams": 5,
|
| 33 |
-
"do_sample":
|
| 34 |
"temperature": 0.3,
|
| 35 |
"top_k": 50,
|
| 36 |
"top_p": 0.8,
|
|
|
|
| 30 |
generate_kwargs = {
|
| 31 |
"max_length": 1024,
|
| 32 |
"num_beams": 5,
|
| 33 |
+
"do_sample": False,
|
| 34 |
"temperature": 0.3,
|
| 35 |
"top_k": 50,
|
| 36 |
"top_p": 0.8,
|