Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
rtferraz
/
domainTokenizer
Like
0
arxiv:
9 papers
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
domainTokenizer
/
src
/
domain_tokenizer
/
training
15.6 kB
Ctrl+K
Ctrl+K
1 contributor
History:
6 commits
rtferraz
Update training init with finetune exports
64d55e2
verified
7 months ago
__init__.py
520 Bytes
Update training init with finetune exports
7 months ago
data_pipeline.py
3.65 kB
Add data_pipeline.py โ tokenize_user_sequences, pack_sequences, prepare_clm_dataset
7 months ago
finetune.py
3.35 kB
Add finetune.py โ finetune_domain_model (HF Trainer Pattern A, auto tabular_features passthrough)
7 months ago
finetune_data.py
3.45 kB
Phase 2D: Fine-tuning pipeline โ DomainFinetuneDataset, finetune_domain_model, 139 total tests passing
7 months ago
pretrain.py
4.62 kB
Add pretrain.py โ pretrain_domain_model with HF Trainer, cosine schedule, DataCollatorForLanguageModeling
7 months ago