kaarelsh commited on
Commit
de59ba1
·
verified ·
1 Parent(s): 11cce6e

Pocket TTS ONNX and Whisper q5, Estonian

Browse files
README.md CHANGED
@@ -1,3 +1,61 @@
1
  ---
2
  license: cc-by-sa-4.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-sa-4.0
3
+ language:
4
+ - et
5
+ tags:
6
+ - text-to-speech
7
+ - automatic-speech-recognition
8
+ - onnx
9
+ - whisper.cpp
10
+ - robotics
11
  ---
12
+
13
+ # Go2 dock models
14
+
15
+ Estonian speech models that Meridein's Unitree Go2 EDU docks run: the
16
+ voice (Pocket TTS) and speech recognition (Whisper). Both are derived from
17
+ public models, converted for the dock's Jetson. A dock downloads them at a
18
+ pinned commit and checks each file's sha256 before using it.
19
+
20
+ **Files are never overwritten here.** A new version gets a new file name, so
21
+ a release that pins a commit and a sha256 keeps working.
22
+
23
+ | file | what | size | sha256 |
24
+ |---|---|---|---|
25
+ | `pocket-cpp-et.tar.gz` | Pocket TTS, Estonian, as ONNX for PocketTTS.cpp (one folder, `pocket-cpp-et/`) | 436 064 256 | `1cf3ae8b3eab0724a023a8e5852272e0a870fccbd5fe7bc61a48940a680cd3ca` |
26
+ | `ggml-whisper-large-v3-turbo-et-verbatim-2604-q5_0.bin` | Whisper large-v3-turbo, Estonian, q5_0 for whisper.cpp | 574 041 195 | `ec401581b6ac1788b4eff8b92c5257a65bf24b50be1e488387fd9760166a1ad7` |
27
+
28
+ ## `pocket-cpp-et.tar.gz`: Pocket TTS, Estonian (ONNX)
29
+
30
+ - **Run by** [PocketTTS.cpp](https://github.com/VolgaGerm/PocketTTS.cpp) at
31
+ `e801e7d`, with `--precision int8`. The int8 set is what runs; the fp32
32
+ files are kept beside it.
33
+ - **Made from** [cbentes/pocket-tts-estonian](https://huggingface.co/cbentes/pocket-tts-estonian):
34
+ the weights and tokenizer at `e8d2fd9cc01ae6e4e505269adcc1d9bdaecbea0f`,
35
+ the config and the six voice clips at
36
+ `b37e49dd65514fb79a05cff2ace696e24af15d66`. Exported with pocket-tts
37
+ 2.1.0 and PocketTTS.cpp's `export_onnx.py` at `e801e7d`; the
38
+ beginning-of-sequence before the voice is in `mimi_encoder.onnx`.
39
+ `export_info.json` inside records the same.
40
+ - **Licence:** CC BY-SA 4.0, as the weights it is made from, which were
41
+ trained on the TalTech Estonian Speech Dataset 1.0. Credit:
42
+ cbentes/pocket-tts-estonian and TalTech. Changes: converted to ONNX and
43
+ quantised to int8. Share-alike: this derivative is under the same licence.
44
+
45
+ ## `ggml-whisper-large-v3-turbo-et-verbatim-2604-q5_0.bin`: Whisper, Estonian
46
+
47
+ - **Run by** `whisper-server` ([whisper.cpp](https://github.com/ggml-org/whisper.cpp)),
48
+ language `et`.
49
+ - **Made from** [TalTechNLP/whisper-large-v3-turbo-et-verbatim-2604](https://huggingface.co/TalTechNLP/whisper-large-v3-turbo-et-verbatim-2604),
50
+ its ggml model (`ggml/ggml-model.bin`, sha256 `4e231f931f029850d7ca497efe4223f85c495a27d986d955f9a577ac1cd02edb`),
51
+ quantised to `q5_0` with whisper.cpp's quantize tool (whisper.cpp
52
+ `60c0be6`). The quantised model needs about 1 GB less memory.
53
+ - **Licence:** that of TalTechNLP's model, which this file is derived from.
54
+ See their model card; credit: TalTech (Tallinn University of Technology).
55
+ The repository's `cc-by-sa-4.0` tag is the Pocket model's.
56
+
57
+ ## Checking a download
58
+
59
+ ```bash
60
+ sha256sum -c SHA256SUMS
61
+ ```
SHA256SUMS ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ 1cf3ae8b3eab0724a023a8e5852272e0a870fccbd5fe7bc61a48940a680cd3ca pocket-cpp-et.tar.gz
2
+ ec401581b6ac1788b4eff8b92c5257a65bf24b50be1e488387fd9760166a1ad7 ggml-whisper-large-v3-turbo-et-verbatim-2604-q5_0.bin
ggml-whisper-large-v3-turbo-et-verbatim-2604-q5_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec401581b6ac1788b4eff8b92c5257a65bf24b50be1e488387fd9760166a1ad7
3
+ size 574041195
pocket-cpp-et.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cf3ae8b3eab0724a023a8e5852272e0a870fccbd5fe7bc61a48940a680cd3ca
3
+ size 436064256