Text Classification
Transformers
Safetensors
English
roberta
economics
finance
inflation
inflation-expectations
reddit
distilroberta
Eval Results (legacy)
text-embeddings-inference
Instructions to use andreadm/reddit-pulse-bert with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use andreadm/reddit-pulse-bert with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="andreadm/reddit-pulse-bert")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("andreadm/reddit-pulse-bert") model = AutoModelForSequenceClassification.from_pretrained("andreadm/reddit-pulse-bert", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Rename to reddit-pulse-bert: title and repository id in the card
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ widget:
|
|
| 30 |
- text: Gas prices fall for the sixth straight week as demand cools
|
| 31 |
example_title: Down (prices)
|
| 32 |
model-index:
|
| 33 |
-
- name:
|
| 34 |
results:
|
| 35 |
- task:
|
| 36 |
type: text-classification
|
|
@@ -54,9 +54,9 @@ model-index:
|
|
| 54 |
name: ROC-AUC (macro, one-vs-rest)
|
| 55 |
---
|
| 56 |
|
| 57 |
-
#
|
| 58 |
|
| 59 |
-
**
|
| 60 |
classifier for short English texts about the economy, fine-tuned on Reddit
|
| 61 |
submission titles. Given a title (or any sentence-length text), it predicts
|
| 62 |
whether the text conveys that inflation / prices are going **up**, going
|
|
@@ -86,7 +86,7 @@ The fine-tuning and full-corpus inference code lives at
|
|
| 86 |
| Pre-training | [`distilroberta-base`](https://huggingface.co/distilroberta-base) | 6-layer distilled RoBERTa, 82.1 M parameters |
|
| 87 |
| Domain adaptation | [`mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis`](https://huggingface.co/mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis) | Financial-news sentiment |
|
| 88 |
| Task adaptation | [`MAPAi/InflaBERT`](https://huggingface.co/MAPAi/InflaBERT) | Inflation-news sentiment (negative / neutral / positive) |
|
| 89 |
-
| **This checkpoint** | **`andreadm/
|
| 90 |
|
| 91 |
Architecture: `RobertaForSequenceClassification`, 6 hidden layers, hidden
|
| 92 |
size 768, 12 attention heads, 50 265-token byte-level BPE vocabulary, 512-token
|
|
@@ -106,7 +106,7 @@ classification head was re-initialised for the three directional classes.
|
|
| 106 |
```python
|
| 107 |
from transformers import pipeline
|
| 108 |
|
| 109 |
-
clf = pipeline("text-classification", model="andreadm/
|
| 110 |
clf("Fed officials warn prices will keep climbing as CPI hits 40-year high")
|
| 111 |
# [{'label': 'up', 'score': 0.999}]
|
| 112 |
```
|
|
@@ -117,7 +117,7 @@ Batched, with the paper's `-1 / 0 / +1` encoding:
|
|
| 117 |
import torch
|
| 118 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|
| 119 |
|
| 120 |
-
name = "andreadm/
|
| 121 |
tokenizer = AutoTokenizer.from_pretrained(name)
|
| 122 |
model = AutoModelForSequenceClassification.from_pretrained(name).eval()
|
| 123 |
encoding = {"down": -1, "neutral": 0, "up": 1}
|
|
|
|
| 30 |
- text: Gas prices fall for the sixth straight week as demand cools
|
| 31 |
example_title: Down (prices)
|
| 32 |
model-index:
|
| 33 |
+
- name: Reddit-pulse InflaBERT
|
| 34 |
results:
|
| 35 |
- task:
|
| 36 |
type: text-classification
|
|
|
|
| 54 |
name: ROC-AUC (macro, one-vs-rest)
|
| 55 |
---
|
| 56 |
|
| 57 |
+
# Reddit-pulse InflaBERT
|
| 58 |
|
| 59 |
+
**Reddit-pulse InflaBERT** is a three-way *directional* inflation-expectation
|
| 60 |
classifier for short English texts about the economy, fine-tuned on Reddit
|
| 61 |
submission titles. Given a title (or any sentence-length text), it predicts
|
| 62 |
whether the text conveys that inflation / prices are going **up**, going
|
|
|
|
| 86 |
| Pre-training | [`distilroberta-base`](https://huggingface.co/distilroberta-base) | 6-layer distilled RoBERTa, 82.1 M parameters |
|
| 87 |
| Domain adaptation | [`mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis`](https://huggingface.co/mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis) | Financial-news sentiment |
|
| 88 |
| Task adaptation | [`MAPAi/InflaBERT`](https://huggingface.co/MAPAi/InflaBERT) | Inflation-news sentiment (negative / neutral / positive) |
|
| 89 |
+
| **This checkpoint** | **`andreadm/reddit-pulse-bert`** | Full fine-tuning on Reddit titles, labels re-mapped to **down / neutral / up** |
|
| 90 |
|
| 91 |
Architecture: `RobertaForSequenceClassification`, 6 hidden layers, hidden
|
| 92 |
size 768, 12 attention heads, 50 265-token byte-level BPE vocabulary, 512-token
|
|
|
|
| 106 |
```python
|
| 107 |
from transformers import pipeline
|
| 108 |
|
| 109 |
+
clf = pipeline("text-classification", model="andreadm/reddit-pulse-bert")
|
| 110 |
clf("Fed officials warn prices will keep climbing as CPI hits 40-year high")
|
| 111 |
# [{'label': 'up', 'score': 0.999}]
|
| 112 |
```
|
|
|
|
| 117 |
import torch
|
| 118 |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
|
| 119 |
|
| 120 |
+
name = "andreadm/reddit-pulse-bert"
|
| 121 |
tokenizer = AutoTokenizer.from_pretrained(name)
|
| 122 |
model = AutoModelForSequenceClassification.from_pretrained(name).eval()
|
| 123 |
encoding = {"down": -1, "neutral": 0, "up": 1}
|