Token Classification
Transformers
ONNX
Safetensors
English
Japanese
Chinese
bert
anime
filename-parsing
Eval Results (legacy)
Instructions to use ModerRAS/AniFileBERT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ModerRAS/AniFileBERT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="ModerRAS/AniFileBERT")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("ModerRAS/AniFileBERT") model = AutoModelForTokenClassification.from_pretrained("ModerRAS/AniFileBERT", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Verify low-frequency DMHY generated output
93f322e -
Add low-frequency DMHY audit gate
494b24c -
Refine DMHY template labeling rules
79b4d87 -
Ignore generated reports
01e4424 -
Add Rust DMHY template clustering
736c211 -
Add Rust DMHY template recipe applier
7f87a1d
-
Add DMHY prefix graph annotation workflow
33bb11c -
Export DMHY metadata list
4248c69 -
Add DMHY digit-dedup list export
beb7665 -
Update relabel artifacts and pathfix export
5af16a8 -
chore: update AnimeName submodule after relabel chunks
a4c7b01 -
chore: update AnimeName submodule after relabel chunks
d535b94 -
chore: update AnimeName submodule after relabel chunks
7bb297e -
chore: update AnimeName submodule after relabel chunks
0c430e6 -
chore: update AnimeName submodule after relabel chunks
832202f -
chore: update AnimeName submodule after relabel chunks
a95994b -
chore: update AnimeName submodule after relabel chunks
ac82693 -
chore: update AnimeName submodule after relabel chunks
7f2cd6b -
chore: update AnimeName submodule after relabel chunks
29aea48 -
chore: update AnimeName submodule after relabel chunks
feea690
-
chore: update AnimeName submodule after relabel chunks
edb03a6 -
chore: update AnimeName submodule after relabel chunks
3dd0093 -
chore: update AnimeName submodule after relabel chunks
e7fc63a -
chore: update AnimeName submodule after relabel chunks
87c7b59 -
Advance AnimeName relabel submodule after additional batches
fb5c9c2 -
Advance AnimeName relabel submodule after next batches
aaa7735 -
Advance AnimeName relabel submodule batches
ac7e795 -
Add robust LLM relabel pipeline and enforce contiguous title
fed9d99 -
set gpt-5.4-mini default token pricing
8165cc3 -
feat: add concurrency and token/cost telemetry for llm relabel runs
7c5b41e -
feat: add tool-call based llm relabel pipeline and update dataset pointer
e964ae5 -
chore: update AnimeName submodule checkpoint
1804249 -
chore: checkpoint current training and manual relabel progress
efb213a
-
Add tests for combo generator
1bef818 -
Add balanced focus dataset generator
651ad49 -
Add path-aware focus dataset support
1e1bc1f
-
Train virtual-shard anime parser
359ff82
-
Train augmented anime filename parser
be6a29a
-
Organize parser modules and tools
8c50d16 -
Clean stale local scripts
f95ce71 -
Remove structural parser rule assists
116c87c -
Document training lineage
f2ec095 -
Train thin anime filename parser
f712f4b
-
Remove stale diagnostics reports
76e084f -
Add inference performance benchmark
ce3a60d -
Polish Hugging Face repository docs
376db19
-
Clean special code parsing
e8412e3 -
Fix GM-Team bilingual title parsing
adf92db -
Improve anime filename parser model
e63569d
-
Add parser diagnostics and inference debugging
- add diagnose_pipeline.py for BIO validation, tokenizer alignment, entity stats, truncation, UNK, and confusion analysis - add diagnostics reports for char and regex DMHY datasets - add inference debug output, constrained BIO decoding, checkpoint max-length handling, and rule-assisted parsingb57780c