Feature Extraction
Transformers
Safetensors
English
bert
tadse
sentence-embeddings
contrastive-learning
model-merge
text-embeddings-inference
Instructions to use minsik-oh/template-dialogue-embedding with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use minsik-oh/template-dialogue-embedding with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="minsik-oh/template-dialogue-embedding")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("minsik-oh/template-dialogue-embedding") model = AutoModel.from_pretrained("minsik-oh/template-dialogue-embedding", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Name the release for dialogue representation learning
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
- model-merge
|
| 11 |
- bert
|
| 12 |
---
|
| 13 |
-
#
|
| 14 |
|
| 15 |
TaDSE produces **768-dimensional embeddings** for dialogue utterances. This
|
| 16 |
release combines two TaDSE checkpoints with a fixed 50/50 weight average and
|
|
@@ -28,7 +28,7 @@ import torch
|
|
| 28 |
import torch.nn.functional as F
|
| 29 |
from transformers import AutoModel, AutoTokenizer
|
| 30 |
|
| 31 |
-
model_id = "minsik-oh/
|
| 32 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 33 |
model = AutoModel.from_pretrained(model_id).eval()
|
| 34 |
tokens = tokenizer(["Book a table for two", "Reserve a restaurant"],
|
|
@@ -49,7 +49,7 @@ Intent classification uses utterance-only cosine nearest-neighbour retrieval
|
|
| 49 |
against each dataset's training references. The same released model is used
|
| 50 |
for every dataset.
|
| 51 |
|
| 52 |
-
| Dataset | Test examples | SimCSE |
|
| 53 |
| --- | ---: | ---: | ---: |
|
| 54 |
| SNIPS | 700 | 92.00 | 96.00 |
|
| 55 |
| ATIS | 893 | 85.67 | 89.59 |
|
|
@@ -65,9 +65,9 @@ model selection. Exact results are in `evaluation.json`.
|
|
| 65 |
|
| 66 |
## Training
|
| 67 |
|
| 68 |
-
Training data: [
|
| 69 |
-
|
| 70 |
-
|
| 71 |
|
| 72 |
Both checkpoints initialize from `princeton-nlp/unsup-simcse-bert-base-uncased`,
|
| 73 |
revision `218baf6bc48c463a53f5b4e1c568299537fab124`, including its trained shared
|
|
|
|
| 10 |
- model-merge
|
| 11 |
- bert
|
| 12 |
---
|
| 13 |
+
# Template Dialogue Embedding
|
| 14 |
|
| 15 |
TaDSE produces **768-dimensional embeddings** for dialogue utterances. This
|
| 16 |
release combines two TaDSE checkpoints with a fixed 50/50 weight average and
|
|
|
|
| 28 |
import torch.nn.functional as F
|
| 29 |
from transformers import AutoModel, AutoTokenizer
|
| 30 |
|
| 31 |
+
model_id = "minsik-oh/template-dialogue-embedding"
|
| 32 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 33 |
model = AutoModel.from_pretrained(model_id).eval()
|
| 34 |
tokens = tokenizer(["Book a table for two", "Reserve a restaurant"],
|
|
|
|
| 49 |
against each dataset's training references. The same released model is used
|
| 50 |
for every dataset.
|
| 51 |
|
| 52 |
+
| Dataset | Test examples | SimCSE | Template Dialogue Embedding |
|
| 53 |
| --- | ---: | ---: | ---: |
|
| 54 |
| SNIPS | 700 | 92.00 | 96.00 |
|
| 55 |
| ATIS | 893 | 85.67 | 89.59 |
|
|
|
|
| 65 |
|
| 66 |
## Training
|
| 67 |
|
| 68 |
+
Training data: [Template Dialogue Pairs](https://huggingface.co/datasets/minsik-oh/template-dialogue-pairs),
|
| 69 |
+
utterance-template pairs from SNIPS, ATIS, MASSIVE, HWU and CLINC.
|
| 70 |
+
Detailed generation settings are recorded in the dataset provenance.
|
| 71 |
|
| 72 |
Both checkpoints initialize from `princeton-nlp/unsup-simcse-bert-base-uncased`,
|
| 73 |
revision `218baf6bc48c463a53f5b4e1c568299537fab124`, including its trained shared
|