Summarization
Transformers
PyTorch
TensorFlow
Vietnamese
t5
text2text-generation
text-generation-inference
Instructions to use polieste/fastAbs_large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use polieste/fastAbs_large with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("summarization", model="polieste/fastAbs_large")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("polieste/fastAbs_large") model = AutoModelForSeq2SeqLM.from_pretrained("polieste/fastAbs_large", device_map="auto") - Notebooks
- Google Colab
- Kaggle
metadata
language: vi
datasets:
- Yuhthe/vietnews
tags:
- summarization
license: mit
widget:
- text: Input text.
fastAbs-large Finetuned on vietnews Abstractive Summarization
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("polieste/fastAbs_large")
model = AutoModelForSeq2SeqLM.from_pretrained("polieste/fastAbs_large")
model.cuda()
sentence = "Input text"
text = "vietnews: " + sentence + " </s>"
encoding = tokenizer(text, return_tensors="pt")
input_ids, attention_masks = encoding["input_ids"].to("cuda"), encoding["attention_mask"].to("cuda")
outputs = model.generate(
input_ids=input_ids, attention_mask=attention_masks,
max_length=512,
early_stopping=True
)
for output in outputs:
line = tokenizer.decode(output, skip_special_tokens=True, clean_up_tokenization_spaces=True)
print(line)