Instructions to use adsabs/astroBERT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use adsabs/astroBERT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="adsabs/astroBERT")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("adsabs/astroBERT") model = AutoModelForPreTraining.from_pretrained("adsabs/astroBERT", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Remove ` "add_special_tokens"` tokenizer config key
Verified signature`"add_special_tokens"` now conflicts with a method of the same name in the Transformers library, preventing successful deserialization of the model. The behavior of the model, leading up to the breaking change, was not impacted by this config key.a4a1c6d
-
Merge branch 'main' of https://huggingface.co/adsabs/astroBERT into main
551138e -
SciX Categorizer tutorial and updated readme
3bf62ed
-
Adding `safetensors` variant of this model (#1)
- Adding `safetensors` variant of this model (224ef1d23ad4d8b87270c9027dd7981469ea0811) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>d00da3e
-
updated readme
799e70a -
added ner tuto and removed auth check
49e56e4
-
tokenizer max len and NER labels added
fdbc193
-
Revert "astroBERT model ner model all_labeled_data_run01 checkpoint-169600"
This reverts commit e0c9e48487cc3c13021c03807116d83a86e44e35.1565f86 -
astroBERT model ner model all_labeled_data_run01 checkpoint-169600
e0c9e48
-
removed non ipynb tutorials, minor updates to 0,1 tutorials
c4956a2 -
added external links to tutorials
3af7965
-
added astro sentences
4d671c9 -
astroBERT model nsp+mlm chkp 10350000 with return dict for fill-mask
dd6ed16 -
html tutorials
a0c0bd6 -
markdown tutorials
1814b9a -
Merge branch 'main' of https://huggingface.co/fgrezes/astroBERT into main
84e3253 -
added tutorials
9839ba6
-
added bibtext
99ad8f2 -
Update README.md
a7443dd -
Update README.md
14889f9 -
Update README.md
bb650b1 -
added fill-mask task
5eedd06 -
Update README.md
10e9957
-
astroBERT tokenizer nsp+mlm chkp 10350000
99bf156 -
astroBERT model nsp+mlm chkp 10350000
59905c1
-
initial commit
6231ca9