Update README.md
Browse files
README.md
CHANGED
|
@@ -42,11 +42,6 @@ The pretraining corpus includes over **11 billion tokens** from Spanish academic
|
|
| 42 |
- Open-access repositories of Colombian universities (Universidad de los Andes, Universidad Nacional, Universidad Javeriana, Universidad del Rosario).
|
| 43 |
- CORE API and institutional repositories (theses, dissertations, working papers).
|
| 44 |
- Tax Statutes in Colombia
|
| 45 |
-
- Filtered and cleaned with:
|
| 46 |
-
- Language detection using FastText,
|
| 47 |
-
- Deduplication,
|
| 48 |
-
- Abstract and reference removal,
|
| 49 |
-
- Normalization of encoding and special symbols.
|
| 50 |
|
| 51 |
The final dataset covers multiple disciplines (economics, medicine, engineering, humanities), ensuring representation across scientific domains.
|
| 52 |
|
|
|
|
| 42 |
- Open-access repositories of Colombian universities (Universidad de los Andes, Universidad Nacional, Universidad Javeriana, Universidad del Rosario).
|
| 43 |
- CORE API and institutional repositories (theses, dissertations, working papers).
|
| 44 |
- Tax Statutes in Colombia
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
The final dataset covers multiple disciplines (economics, medicine, engineering, humanities), ensuring representation across scientific domains.
|
| 47 |
|