rishanthrajendhran commited on
Commit
2bacc34
·
verified ·
1 Parent(s): 1675061

Card: run without a GPU on Tinker

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -82,6 +82,23 @@ another. Each record also carries verdicts at every calibrated false-positive ra
82
  per-topic schemes. The [package README](https://github.com/RishanthRajendhran/IdeaLens#ways-to-use-idealens) covers batch jobs, scoring outlines you already have and calibrating
83
  on your own data.
84
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
  ### Mix and match: extract with the package, score with your own code
86
 
87
  ```python
 
82
  per-topic schemes. The [package README](https://github.com/RishanthRajendhran/IdeaLens#ways-to-use-idealens) covers batch jobs, scoring outlines you already have and calibrating
83
  on your own data.
84
 
85
+ ### Without a GPU: Tinker
86
+
87
+ IdeaLens is also published on [Tinker](https://thinkingmachines.ai/tinker/), which runs it on its own servers, so any
88
+ laptop works. Sign up at [auth.thinkingmachines.ai/sign-up](https://auth.thinkingmachines.ai/sign-up), create an API key in
89
+ the Tinker console, and run:
90
+
91
+ ```bash
92
+ pip install "idealens[tinker]"
93
+ export TINKER_API_KEY=...
94
+ export GEMINI_API_KEY=... # for outline extraction
95
+ idealens run docs.jsonl -o scores.jsonl --model IdeaLens --backend tinker
96
+ ```
97
+
98
+ Tinker bills your account per token: about $0.50 per 1,000 documents for scoring at list price
99
+ (`--dry-run` gives an estimate). The checkpoint is `tinker://9f500a21-df39-5716-89e5-e65f9390fb14:train:0/sampler_weights/nemo_full_v1m_r64_ep1_final`; on our checks its scores
100
+ agree with the weights in this repo to about 0.002 in P(human).
101
+
102
  ### Mix and match: extract with the package, score with your own code
103
 
104
  ```python