Update README.md
Browse files
README.md
CHANGED
|
@@ -9,15 +9,19 @@ tags:
|
|
| 9 |
|
| 10 |
# bert-rubriques
|
| 11 |
|
| 12 |
-
CamemBERT-base fine-tuned
|
| 13 |
-
An article relating to political, social or economic events outside France should be classified in international - so that politics contains only French politics, etc.
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
| 15 |
is larger, and we might want to control for that. More generally, press corpora are really meta-corpora, and lexicometrics/cultural analytics shouldn't mix sports with politics.
|
| 16 |
|
| 17 |
-
This model has been trained on 960 articles of Le Monde,
|
|
|
|
| 18 |
|
| 19 |
## Training details
|
| 20 |
-
|
| 21 |
- Base model: camembert/camembert-base
|
| 22 |
- Epochs: 5
|
| 23 |
- Batch size: 4 (gradient accumulation: 4)
|
|
|
|
| 9 |
|
| 10 |
# bert-rubriques
|
| 11 |
|
| 12 |
+
CamemBERT-base fine-tuned to annotate the section of French news article. 6 categories are allowed: politics, society, international, sport, culture and economics.
|
| 13 |
+
An article relating to political, social or economic events outside France should be classified in international - so that politics contains only French politics, etc. Culture has no borders, so a Bob Dylan album should end up in the culture section. Economics includes both business news (e.g., some company making profit) or macroeconomics news (e.g. a recession).
|
| 14 |
+
Politics is strictly about political actors -- even though everything is political, of course.
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
This has been developed for the [Gallicagram](gallicagram.com) project, to avoid 'structure effects': a word could be more present in a corpus or a time period because the section where it tends to appear
|
| 18 |
is larger, and we might want to control for that. More generally, press corpora are really meta-corpora, and lexicometrics/cultural analytics shouldn't mix sports with politics.
|
| 19 |
|
| 20 |
+
This model has been trained on 960 articles of Le Monde archives (1945-...) with the wonderful ActiveTigger, using active learning.
|
| 21 |
+
It is meant to work more broadly on any post-war French news articles - and in our experience, it does work. It is probably not as accurate outside of high-brow printed press - I would not use it on tabloid, social media or TV transcript.
|
| 22 |
|
| 23 |
## Training details
|
| 24 |
+
|
| 25 |
- Base model: camembert/camembert-base
|
| 26 |
- Epochs: 5
|
| 27 |
- Batch size: 4 (gradient accumulation: 4)
|