KseniiaY commited on
Commit
0c22615
·
verified ·
1 Parent(s): a34ee09

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - allenai/specter2_base
5
+ pipeline_tag: text-classification
6
+ library_name: transformers
7
+ ---
8
+
9
+ # Technical Domain Classifier
10
+
11
+ This model is a fine-tuned version of **allenai/specter2_base** for multilabel scientific domain classification aligned with **ERC panel taxonomy**.
12
+ It achieves the following results on the held-out test set:
13
+
14
+ - **Best validation loss:** 0.0372
15
+ - **Micro F1:** 0.74
16
+
17
+ ---
18
+
19
+ ## Model description
20
+
21
+ This model is a fine-tuned variant of **SPECTER2** (`allenai/specter2_base`) adapted for **multilabel classification of scientific documents** into S3 technical domains.
22
+
23
+ The model takes as input the **title and abstract** of a scientific project or publication and predicts **one or more domains**.
24
+ Since scientific outputs may legitimately span multiple domains, the model is trained using **sigmoid activation** with **binary cross-entropy loss**, allowing independent assignment of multiple labels.