Instructions to use binwang/roberta-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use binwang/roberta-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="binwang/roberta-base")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("binwang/roberta-base") model = AutoModelForMaskedLM.from_pretrained("binwang/roberta-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 570 Bytes
ce8dfb5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | ---
tags:
- historical-research
- sbert-wk
---
# Historical research checkpoint — SBERT-WK (2020)
**No longer actively maintained. Retained for reproducibility of the original work.**
This repository hosts the original 12-layer RoBERTa checkpoint used in the SBERT-WK experiments. It is a supporting checkpoint for the sentence embedding method.
For the paper, original software environment, and reproduction instructions, see [SBERT-WK: A Sentence Embedding Method by Dissecting BERT-based Word Models](https://github.com/BinWang28/SBERT-WK-Sentence-Embedding).
|