minsik-oh commited on
Commit
f374f63
·
verified ·
1 Parent(s): 40f8598

Name the release for dialogue representation learning

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -10,7 +10,7 @@ tags:
10
  - model-merge
11
  - bert
12
  ---
13
- # TaDSE BERT Base — Dialogue Embeddings
14
 
15
  TaDSE produces **768-dimensional embeddings** for dialogue utterances. This
16
  release combines two TaDSE checkpoints with a fixed 50/50 weight average and
@@ -28,7 +28,7 @@ import torch
28
  import torch.nn.functional as F
29
  from transformers import AutoModel, AutoTokenizer
30
 
31
- model_id = "minsik-oh/tadse-bert-base-uncased"
32
  tokenizer = AutoTokenizer.from_pretrained(model_id)
33
  model = AutoModel.from_pretrained(model_id).eval()
34
  tokens = tokenizer(["Book a table for two", "Reserve a restaurant"],
@@ -49,7 +49,7 @@ Intent classification uses utterance-only cosine nearest-neighbour retrieval
49
  against each dataset's training references. The same released model is used
50
  for every dataset.
51
 
52
- | Dataset | Test examples | SimCSE | TaDSE BERT Base |
53
  | --- | ---: | ---: | ---: |
54
  | SNIPS | 700 | 92.00 | 96.00 |
55
  | ATIS | 893 | 85.67 | 89.59 |
@@ -65,9 +65,9 @@ model selection. Exact results are in `evaluation.json`.
65
 
66
  ## Training
67
 
68
- Training data: [TaDSE Dialogue Pairs](https://huggingface.co/datasets/minsik-oh/tadse-top2-dialogue-pairs),
69
- **785,870 utterance-template pairs** from SNIPS, ATIS, MASSIVE, HWU and CLINC.
70
- The dataset card documents per-source augmentation settings and counts.
71
 
72
  Both checkpoints initialize from `princeton-nlp/unsup-simcse-bert-base-uncased`,
73
  revision `218baf6bc48c463a53f5b4e1c568299537fab124`, including its trained shared
 
10
  - model-merge
11
  - bert
12
  ---
13
+ # Template Dialogue Embedding
14
 
15
  TaDSE produces **768-dimensional embeddings** for dialogue utterances. This
16
  release combines two TaDSE checkpoints with a fixed 50/50 weight average and
 
28
  import torch.nn.functional as F
29
  from transformers import AutoModel, AutoTokenizer
30
 
31
+ model_id = "minsik-oh/template-dialogue-embedding"
32
  tokenizer = AutoTokenizer.from_pretrained(model_id)
33
  model = AutoModel.from_pretrained(model_id).eval()
34
  tokens = tokenizer(["Book a table for two", "Reserve a restaurant"],
 
49
  against each dataset's training references. The same released model is used
50
  for every dataset.
51
 
52
+ | Dataset | Test examples | SimCSE | Template Dialogue Embedding |
53
  | --- | ---: | ---: | ---: |
54
  | SNIPS | 700 | 92.00 | 96.00 |
55
  | ATIS | 893 | 85.67 | 89.59 |
 
65
 
66
  ## Training
67
 
68
+ Training data: [Template Dialogue Pairs](https://huggingface.co/datasets/minsik-oh/template-dialogue-pairs),
69
+ utterance-template pairs from SNIPS, ATIS, MASSIVE, HWU and CLINC.
70
+ Detailed generation settings are recorded in the dataset provenance.
71
 
72
  Both checkpoints initialize from `princeton-nlp/unsup-simcse-bert-base-uncased`,
73
  revision `218baf6bc48c463a53f5b4e1c568299537fab124`, including its trained shared