HardbanAI / inference.py
HardbanRecordsLab's picture
Create inference.py
1980206 verified
Raw History Blame Contribute Delete
542 Bytes
---
### 6. `inference.py`
```python
import torch
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
def main():
model_name = "hardbanai-model"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
text = input("Wpisz tekst: ")
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs)
result = tokenizer.decode(outputs[0], skip_special_tokens=True)
print("Wynik:", result)
if __name__ == "__main__":
main()