Instructions to use AbstractPhil/captionbert-8192-rotary with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AbstractPhil/captionbert-8192-rotary with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="AbstractPhil/captionbert-8192-rotary", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AbstractPhil/captionbert-8192-rotary", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download THIRD_PARTY.md from AbstractPhil/captionbert-8192-rotary: direct link, hf CLI and curl.
- Browser
- Download file 1.44 kB
-
https://huggingface.co/AbstractPhil/captionbert-8192-rotary/resolve/main/THIRD_PARTY.md
- Command line
-
hf download hf://AbstractPhil/captionbert-8192-rotary/THIRD_PARTY.md
-
curl -L -o THIRD_PARTY.md https://huggingface.co/AbstractPhil/captionbert-8192-rotary/resolve/main/THIRD_PARTY.md
Reference provenance
reference/pretrain_trainer.py, modeling_captionbert.py, full_benchmark.py,
early_eval.py, and config.json were downloaded unchanged from
AbstractPhil/captionbert-8192-v2,
revision ed468fe5aed64a3d03a56a7f7811131d20f81ddb.
The model card declares MIT; the repository does not contain a separate LICENSE file.
Copyright belongs to AbstractPhil. The extracted CaptionEncoder class in
captionbert_rotary/_v2.py is verbatim and checked against that source by tests.
The caption dataset is CC BY-SA 4.0, as identified in the supplied build brief. Downloaded captions, consensus targets, and trained weights are excluded from Git. Source data revisions and file checksums are recorded in every prepared manifest.
Structured rotary source
The structured address layout, whole-key binding and record-pair norm follow geolip-nano-beatrix-trainer v0.1.103 by AbstractPhil. The CaptionBERT implementation explicitly adapts its causal byte keys/record frames to bidirectional WordPiece inputs and natural repeated-word records, and changes the squared-norm floor for finite padded derivatives. The technical companion specifies the changes and the scope of the source result. This model is not the source byte checkpoint.