Instructions to use ml6team/keyphrase-generation-keybart-inspec with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ml6team/keyphrase-generation-keybart-inspec with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("ml6team/keyphrase-generation-keybart-inspec") model = AutoModelForSeq2SeqLM.from_pretrained("ml6team/keyphrase-generation-keybart-inspec", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
139ebab
1
Parent(s): 3ffb2cc
Update README.md
Browse files
README.md
CHANGED
|
@@ -38,9 +38,11 @@ Keyphrase extraction is a technique in text analysis where you extract the impor
|
|
| 38 |
Currently, classical machine learning methods, that use statistics and linguistics, are widely used for the extraction process. The fact that these methods have been widely used in the community has the advantage that there are many easy-to-use libraries.
|
| 39 |
Now with the recent innovations in deep learning methods (such as recurrent neural networks and transformers, GANS, …), keyphrase extraction can be improved. These new methods also focus on the semantics and context of a document, which is quite an improvement.
|
| 40 |
|
|
|
|
| 41 |
|
| 42 |
## 📓 Model Description
|
| 43 |
This model is a fine-tuned KeyBART model on the Inspec dataset.
|
|
|
|
| 44 |
You can find more information about the architecture in this paper: https://arxiv.org/abs/2112.08547.
|
| 45 |
|
| 46 |
Kulkarni, Mayank, Debanjan Mahata, Ravneet Arora, and Rajarshi Bhowmik. "Learning Rich Representation of Keyphrases from Text." arXiv preprint arXiv:2112.08547 (2021).
|
|
@@ -50,7 +52,7 @@ Kulkarni, Mayank, Debanjan Mahata, Ravneet Arora, and Rajarshi Bhowmik. "Learnin
|
|
| 50 |
* This keyphrase generation model is very domain-specific and will perform very well on abstracts of scientific papers. It's not recommended to use this model for other domains, but you are free to test it out.
|
| 51 |
* Only works for English documents.
|
| 52 |
* For a custom model, please consult the training notebook for more information (link incoming).
|
| 53 |
-
* Sometimes the output
|
| 54 |
|
| 55 |
### ❓ How to use
|
| 56 |
```python
|
|
|
|
| 38 |
Currently, classical machine learning methods, that use statistics and linguistics, are widely used for the extraction process. The fact that these methods have been widely used in the community has the advantage that there are many easy-to-use libraries.
|
| 39 |
Now with the recent innovations in deep learning methods (such as recurrent neural networks and transformers, GANS, …), keyphrase extraction can be improved. These new methods also focus on the semantics and context of a document, which is quite an improvement.
|
| 40 |
|
| 41 |
+
Thanks to the introduction of neural networks, it's also possible to generate related keyphrases based on a given text document. This is useful, for example, when an author wants to make his work findable.
|
| 42 |
|
| 43 |
## 📓 Model Description
|
| 44 |
This model is a fine-tuned KeyBART model on the Inspec dataset.
|
| 45 |
+
KeyBART focuses on learning a better representation of keyphrases in a generative setting. It produces the keyphrases associated with the input. This is accomplished by predicting the original input based on a changed input. The input is changed by token masking, keyphrase masking and keyphrase replacement. [10] This model can already be used without any fine-tuning, but can be fine-tuned if needed.
|
| 46 |
You can find more information about the architecture in this paper: https://arxiv.org/abs/2112.08547.
|
| 47 |
|
| 48 |
Kulkarni, Mayank, Debanjan Mahata, Ravneet Arora, and Rajarshi Bhowmik. "Learning Rich Representation of Keyphrases from Text." arXiv preprint arXiv:2112.08547 (2021).
|
|
|
|
| 52 |
* This keyphrase generation model is very domain-specific and will perform very well on abstracts of scientific papers. It's not recommended to use this model for other domains, but you are free to test it out.
|
| 53 |
* Only works for English documents.
|
| 54 |
* For a custom model, please consult the training notebook for more information (link incoming).
|
| 55 |
+
* Sometimes the output doesn't make any sense.
|
| 56 |
|
| 57 |
### ❓ How to use
|
| 58 |
```python
|