File size: 2,518 Bytes
9dee3f8
c3dba1e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9dee3f8
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="icon" href="data:,">
<title>Next Ask</title>
<link rel="stylesheet" href="style.css">
</head>
<body>
<main>
  <header>
    <h1>Next Ask</h1>
    <p>Which example should be labeled next? The selector asks you for labels, then a small classifier retrains in your browser and is scored on 360 held-out digits.</p>
    <div class="badges"><span class="badge">Live in-browser training</span><span class="badge">UCI handwritten digits (CC BY 4.0)</span><a class="badge" href="https://huggingface.co/thelamapi/Next-Ask">Model repo</a></div>
  </header>
  <div class="grid">
    <section class="card">
      <h2>Selector</h2>
      <label for="strategy">Selection strategy</label>
      <select id="strategy">
        <option value="hybrid">Uncertainty + diversity (Next Ask)</option>
        <option value="uncertainty">Uncertainty only</option>
        <option value="random">Random</option>
      </select>
      <div class="row" style="margin-top:10px">
        <button id="reset">Restart from 10 labels</button>
        <button id="auto" class="ghost">Fill batch with dataset labels</button>
      </div>
      <label><input type="checkbox" id="hint"> Show dataset label as a hint</label>
      <div class="kpi" style="margin-top:10px">
        <div><b id="acc">–</b><span>test accuracy</span></div>
        <div><b id="nlab">–</b><span>labels used</span></div>
        <div><b id="round">–</b><span>batches labeled</span></div>
      </div>
    </section>
    <section class="card">
      <h2>Accuracy vs labels</h2>
      <canvas id="chart"></canvas>
      <div id="legend"></div>
    </section>
  </div>
  <section class="card" style="margin-top:12px">
    <h2>Label these digits</h2>
    <p class="status" id="status">Loading…</p>
    <div class="grid" id="queue" style="grid-template-columns:repeat(auto-fit,minmax(150px,1fr))"></div>
  </section>
  <section class="card" style="margin-top:12px">
    <h2>Recorded benchmark</h2>
    <img src="preview.png" alt="Learning curves from the notebook benchmark" style="width:100%;border-radius:8px">
  </section>
  <footer>Wrong labels are allowed: they show how noisy annotation affects the model. Benchmark numbers come from the notebook, not from this page.</footer>
</main>
<script src="nlrt.js"></script>
<script src="nlui.js"></script>
<script src="core.js"></script>
<script src="app.js"></script>
</body>
</html>