regicid commited on
Commit
3b633cc
·
verified ·
1 Parent(s): 1d83bb7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -9,15 +9,19 @@ tags:
9
 
10
  # bert-rubriques
11
 
12
- CamemBERT-base fine-tuned for to classify the section of French news article. 6 categories are allowed: politics, society, international, sport, culture and economics.
13
- An article relating to political, social or economic events outside France should be classified in international - so that politics contains only French politics, etc.
14
- Developed for the [Gallicagram](gallicagram.com) project, to avoid 'structure effects': a word could be more present in a corpus or a time period because the section where it tends to appear
 
 
 
15
  is larger, and we might want to control for that. More generally, press corpora are really meta-corpora, and lexicometrics/cultural analytics shouldn't mix sports with politics.
16
 
17
- This model has been trained on 960 articles of Le Monde,
 
18
 
19
  ## Training details
20
- Trained with the wonderful ActiveTigger, using active learning.
21
  - Base model: camembert/camembert-base
22
  - Epochs: 5
23
  - Batch size: 4 (gradient accumulation: 4)
 
9
 
10
  # bert-rubriques
11
 
12
+ CamemBERT-base fine-tuned to annotate the section of French news article. 6 categories are allowed: politics, society, international, sport, culture and economics.
13
+ An article relating to political, social or economic events outside France should be classified in international - so that politics contains only French politics, etc. Culture has no borders, so a Bob Dylan album should end up in the culture section. Economics includes both business news (e.g., some company making profit) or macroeconomics news (e.g. a recession).
14
+ Politics is strictly about political actors -- even though everything is political, of course.
15
+
16
+
17
+ This has been developed for the [Gallicagram](gallicagram.com) project, to avoid 'structure effects': a word could be more present in a corpus or a time period because the section where it tends to appear
18
  is larger, and we might want to control for that. More generally, press corpora are really meta-corpora, and lexicometrics/cultural analytics shouldn't mix sports with politics.
19
 
20
+ This model has been trained on 960 articles of Le Monde archives (1945-...) with the wonderful ActiveTigger, using active learning.
21
+ It is meant to work more broadly on any post-war French news articles - and in our experience, it does work. It is probably not as accurate outside of high-brow printed press - I would not use it on tabloid, social media or TV transcript.
22
 
23
  ## Training details
24
+
25
  - Base model: camembert/camembert-base
26
  - Epochs: 5
27
  - Batch size: 4 (gradient accumulation: 4)