File size: 1,176 Bytes
7f07224 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
# Dataset Card for Custom Text Dataset
## Dataset Name
Custom CNN/DailyMail Text Summarization Dataset
## Overview
This dataset is a custom subset and extension of the CNN/DailyMail dataset, consisting of news articles and their corresponding summaries.
## Composition
Train Dataset: A custom train dataset consisting of one long news article with its manually written summary.
Test Dataset: A test dataset sampled from the original CNN/DailyMail dataset, consisting of 100 articles and their corresponding highlights.
## Collection Process
The custom train dataset was crafted using news articles from the CNN/DailyMail dataset.
## Preprocessing
The intput text was tokenized.
## How to Use
```python
from datasets import load_from_disk
# Load the custom dataset
train_dataset = load_from_disk("./results/custom_dataset/train")
test_dataset = load_from_disk("./results/custom_dataset/test")
```
## Evaluation
This dataset can be evaluated using metrics such as ROUGE or BLEU.
## Limitations
The train dataset consists of only one example.
## Ethical Considerations
The data originates from news sources, which may contain sensitive or politically biased contents.
|