Feature Extraction
Transformers
TensorBoard
Safetensors
English
captionbert_v2
sentence-similarity
consensus-distillation
geometric-deep-learning
amoe
custom_code
Instructions to use AbstractPhil/captionbert-8192-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AbstractPhil/captionbert-8192-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="AbstractPhil/captionbert-8192-v2", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AbstractPhil/captionbert-8192-v2", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
link the technical companion from the card
Browse files
README.md
CHANGED
|
@@ -16,6 +16,8 @@ model, 768-d L2-normalized output.
|
|
| 16 |
|
| 17 |
12 layers, 512-d, 8 heads, FFN 2048, 8192 position capacity. **0.53x bert-base.**
|
| 18 |
|
|
|
|
|
|
|
| 19 |
```python
|
| 20 |
from transformers import AutoModel, AutoTokenizer
|
| 21 |
model = AutoModel.from_pretrained("AbstractPhil/captionbert-8192-v2", trust_remote_code=True)
|
|
|
|
| 16 |
|
| 17 |
12 layers, 512-d, 8 heads, FFN 2048, 8192 position capacity. **0.53x bert-base.**
|
| 18 |
|
| 19 |
+
> 📄 **Technical companion:** [TECHNICAL.md](https://huggingface.co/AbstractPhil/captionbert-8192-v2/blob/main/TECHNICAL.md) — the full training recipe, per-task tables, geometry gauges, adapter-library numerics, and the laws this family earned.
|
| 20 |
+
|
| 21 |
```python
|
| 22 |
from transformers import AutoModel, AutoTokenizer
|
| 23 |
model = AutoModel.from_pretrained("AbstractPhil/captionbert-8192-v2", trust_remote_code=True)
|