AEmotionStudio commited on
Commit
e1b9fef
·
verified ·
1 Parent(s): 549d3a3

Mirror Underdog Bark 3.0 Plus / Clean / Pro (CC-BY-4.0)

Browse files
NOTICE ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ AEmotionStudio/underdog-bark-models — a mirror of the Underdog Bark 3.0 family
2
+
3
+ plus/ ConwayResearch/Underdog-Bark-3.0-Plus @ d4fab2f8b95681e5ad3cfb4e8c5f4e0c009b3deb
4
+ clean/ ConwayResearch/Underdog-Bark-3.0-Clean @ 6d34ed8639b2b9a33e764acf06748519bbb950cf
5
+ pro/ ConwayResearch/Underdog-Bark-3.0-Pro @ 4b5c51e04aa8d16dda9ecdff71bc29f7360149e4
6
+ processor/ nvidia/parakeet-tdt-0.6b-v3 @ 541d1f99c6b0c3cd0b11a95167540bb8edefd82b
7
+
8
+ Underdog Bark 3.0, (c) Conway Research, CC-BY-4.0. It derives from:
9
+
10
+ nvidia/parakeet-tdt-0.6b-v3, (c) NVIDIA Corporation, CC-BY-4.0
11
+ https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3
12
+ moondream/parakeet-ultra, (c) Moondream, CC-BY-4.0
13
+ https://huggingface.co/moondream/parakeet-ultra
14
+
15
+ License: https://creativecommons.org/licenses/by/4.0/
16
+
17
+ Changes by Conway Research: post-trained and compressed. The FastConformer
18
+ encoder architecture, TDT decoder, tokenizer and feature-extractor
19
+ configuration derive from the models above and remain under CC-BY-4.0.
20
+
21
+ Changes by Æmotion Studio in this mirror: plus/ and clean/ were decoded
22
+ from Conway's entropy-coded model.bark into safetensors (exact decode;
23
+ tensors stored as fp16 where that is bit-identical, fp32 otherwise). pro/
24
+ and processor/ are byte-identical copies. No weights were otherwise altered.
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ library_name: pytorch
6
+ pipeline_tag: automatic-speech-recognition
7
+ tags:
8
+ - automatic-speech-recognition
9
+ - parakeet
10
+ - tdt
11
+ - safetensors
12
+ base_model:
13
+ - ConwayResearch/Underdog-Bark-3.0-Plus
14
+ - ConwayResearch/Underdog-Bark-3.0-Clean
15
+ - ConwayResearch/Underdog-Bark-3.0-Pro
16
+ ---
17
+
18
+ # Underdog Bark 3.0 — MAESTRO mirror
19
+
20
+ Mirror of the three [Underdog Bark 3.0](https://huggingface.co/ConwayResearch) English speech-recognition
21
+ checkpoints that MAESTRO ships, with the NVIDIA feature-extractor and tokenizer files they share, so the
22
+ in-app downloader has one stable, self-contained, offline-capable source.
23
+
24
+ | folder | source | what it is |
25
+ |---|---|---|
26
+ | `plus/` | [ConwayResearch/Underdog-Bark-3.0-Plus](https://huggingface.co/ConwayResearch/Underdog-Bark-3.0-Plus) | verbatim — every word as spoken, fillers kept |
27
+ | `clean/` | [ConwayResearch/Underdog-Bark-3.0-Clean](https://huggingface.co/ConwayResearch/Underdog-Bark-3.0-Clean) | fillers, false starts and repeats removed |
28
+ | `pro/` | [ConwayResearch/Underdog-Bark-3.0-Pro](https://huggingface.co/ConwayResearch/Underdog-Bark-3.0-Pro) | the larger-download verbatim checkpoint |
29
+ | `processor/` | [nvidia/parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3) | feature extractor + tokenizer (shared) |
30
+
31
+ Each variant folder is a standard `ParakeetForTDT` checkpoint (`config.json`, `generation_config.json`,
32
+ `model.safetensors`). Exact source revisions and the sha256 of every file are in `sha256.json`.
33
+
34
+ ## Attribution (CC-BY-4.0)
35
+
36
+ Underdog Bark 3.0 is © **Conway Research**, CC BY 4.0. It derives from **nvidia/parakeet-tdt-0.6b-v3**
37
+ (© NVIDIA Corporation, CC BY 4.0) by way of **moondream/parakeet-ultra** (© Moondream, CC BY 4.0).
38
+ License: https://creativecommons.org/licenses/by/4.0/ — full chain in `NOTICE`.
39
+
40
+ ## Changes in this mirror
41
+
42
+ - `plus/` and `clean/`: Conway publishes these as an entropy-coded `model.bark` that needs the
43
+ `constriction` ANS decoder and transformers ≥ 5.19 to load. They were decoded once with Conway's own
44
+ decode routine and written as safetensors. The decode is exact and so is the storage: each tensor is
45
+ fp16 where that is bit-identical to the decoded value (the level-coded encoder weights, 604M params)
46
+ and fp32 otherwise (23M params). No values were changed.
47
+ - `pro/` and `processor/`: byte-identical copies.
48
+
49
+ ## Use
50
+
51
+ MAESTRO loads these with a vendored Parakeet-TDT graph (AI › Transcribe › Underdog Bark). With
52
+ transformers ≥ 5.19 the folders also load directly:
53
+
54
+ ```python
55
+ from transformers import AutoProcessor, ParakeetForTDT
56
+ model = ParakeetForTDT.from_pretrained("AEmotionStudio/underdog-bark-models", subfolder="plus")
57
+ processor = AutoProcessor.from_pretrained("AEmotionStudio/underdog-bark-models", subfolder="processor")
58
+ ```
59
+
60
+ Prepend 0.25 s of silence for Plus and Pro (Conway's evaluated setting; Clean uses none). Prefer fp16 or
61
+ fp32: in MAESTRO's parity runs bf16 changed the transcript on 3 of 10 clips for Pro.
clean/config.json ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "ParakeetForTDT"
4
+ ],
5
+ "blank_token_id": 8192,
6
+ "decoder_hidden_size": 640,
7
+ "dtype": "float32",
8
+ "durations": [
9
+ 0,
10
+ 1,
11
+ 2,
12
+ 3,
13
+ 4
14
+ ],
15
+ "encoder_config": {
16
+ "activation_dropout": 0.1,
17
+ "attention_bias": false,
18
+ "attention_dropout": 0.1,
19
+ "conv_kernel_size": 9,
20
+ "convolution_bias": false,
21
+ "dropout": 0.1,
22
+ "dropout_positions": 0.0,
23
+ "dtype": "float32",
24
+ "hidden_act": "silu",
25
+ "hidden_size": 1024,
26
+ "initializer_range": 0.02,
27
+ "intermediate_size": 4096,
28
+ "layerdrop": 0.1,
29
+ "max_position_embeddings": 5000,
30
+ "model_type": "parakeet_encoder",
31
+ "num_attention_heads": 8,
32
+ "num_hidden_layers": 24,
33
+ "num_key_value_heads": 8,
34
+ "num_mel_bins": 128,
35
+ "scale_input": false,
36
+ "subsampling_conv_channels": 256,
37
+ "subsampling_conv_kernel_size": 3,
38
+ "subsampling_conv_stride": 2,
39
+ "subsampling_factor": 8
40
+ },
41
+ "hidden_act": "relu",
42
+ "initializer_range": 0.02,
43
+ "is_encoder_decoder": true,
44
+ "max_symbols_per_step": 10,
45
+ "model_type": "parakeet_tdt",
46
+ "num_decoder_layers": 2,
47
+ "pad_token_id": 2,
48
+ "transformers_version": "5.19.0",
49
+ "vocab_size": 8193
50
+ }
clean/generation_config.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 8192,
4
+ "eos_token_id": 3,
5
+ "output_attentions": false,
6
+ "output_hidden_states": false,
7
+ "pad_token_id": 2,
8
+ "suppress_tokens": [
9
+ 8193,
10
+ 8194,
11
+ 8195,
12
+ 8196,
13
+ 8197
14
+ ],
15
+ "transformers_version": "5.6.0.dev0"
16
+ }
clean/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f56b3239f5afaa23263e04af8d8ca7d3ab83b53058ef24dcc22d6c5bc099023
3
+ size 1299506732
plus/config.json ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "ParakeetForTDT"
4
+ ],
5
+ "blank_token_id": 8192,
6
+ "decoder_hidden_size": 640,
7
+ "dtype": "float32",
8
+ "durations": [
9
+ 0,
10
+ 1,
11
+ 2,
12
+ 3,
13
+ 4
14
+ ],
15
+ "encoder_config": {
16
+ "activation_dropout": 0.1,
17
+ "attention_bias": false,
18
+ "attention_dropout": 0.1,
19
+ "conv_kernel_size": 9,
20
+ "convolution_bias": false,
21
+ "dropout": 0.1,
22
+ "dropout_positions": 0.0,
23
+ "dtype": "float32",
24
+ "hidden_act": "silu",
25
+ "hidden_size": 1024,
26
+ "initializer_range": 0.02,
27
+ "intermediate_size": 4096,
28
+ "layerdrop": 0.1,
29
+ "max_position_embeddings": 5000,
30
+ "model_type": "parakeet_encoder",
31
+ "num_attention_heads": 8,
32
+ "num_hidden_layers": 24,
33
+ "num_key_value_heads": 8,
34
+ "num_mel_bins": 128,
35
+ "scale_input": false,
36
+ "subsampling_conv_channels": 256,
37
+ "subsampling_conv_kernel_size": 3,
38
+ "subsampling_conv_stride": 2,
39
+ "subsampling_factor": 8
40
+ },
41
+ "hidden_act": "relu",
42
+ "initializer_range": 0.02,
43
+ "is_encoder_decoder": true,
44
+ "max_symbols_per_step": 10,
45
+ "model_type": "parakeet_tdt",
46
+ "num_decoder_layers": 2,
47
+ "pad_token_id": 2,
48
+ "transformers_version": "5.19.0",
49
+ "vocab_size": 8193
50
+ }
plus/generation_config.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 8192,
4
+ "eos_token_id": 3,
5
+ "output_attentions": false,
6
+ "output_hidden_states": false,
7
+ "pad_token_id": 2,
8
+ "suppress_tokens": [
9
+ 8193,
10
+ 8194,
11
+ 8195,
12
+ 8196,
13
+ 8197
14
+ ],
15
+ "transformers_version": "5.6.0.dev0"
16
+ }
plus/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4fb681ad5f806a533222b29224d64b5f1cdbbeca1cf6e53b34e442e7372e01c
3
+ size 1299506732
pro/config.json ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "ParakeetForTDT"
4
+ ],
5
+ "blank_token_id": 8192,
6
+ "decoder_hidden_size": 640,
7
+ "dtype": "bfloat16",
8
+ "durations": [
9
+ 0,
10
+ 1,
11
+ 2,
12
+ 3,
13
+ 4
14
+ ],
15
+ "encoder_config": {
16
+ "activation_dropout": 0.1,
17
+ "attention_bias": false,
18
+ "attention_dropout": 0.1,
19
+ "conv_kernel_size": 9,
20
+ "convolution_bias": false,
21
+ "dropout": 0.1,
22
+ "dropout_positions": 0.0,
23
+ "dtype": "float32",
24
+ "hidden_act": "silu",
25
+ "hidden_size": 1024,
26
+ "initializer_range": 0.02,
27
+ "intermediate_size": 4096,
28
+ "layerdrop": 0.1,
29
+ "max_position_embeddings": 5000,
30
+ "model_type": "parakeet_encoder",
31
+ "num_attention_heads": 8,
32
+ "num_hidden_layers": 24,
33
+ "num_key_value_heads": 8,
34
+ "num_mel_bins": 128,
35
+ "scale_input": false,
36
+ "subsampling_conv_channels": 256,
37
+ "subsampling_conv_kernel_size": 3,
38
+ "subsampling_conv_stride": 2,
39
+ "subsampling_factor": 8
40
+ },
41
+ "hidden_act": "relu",
42
+ "initializer_range": 0.02,
43
+ "is_encoder_decoder": true,
44
+ "max_symbols_per_step": 10,
45
+ "model_type": "parakeet_tdt",
46
+ "num_decoder_layers": 2,
47
+ "pad_token_id": 2,
48
+ "transformers_version": "5.19.0",
49
+ "vocab_size": 8193
50
+ }
pro/generation_config.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 8192,
4
+ "eos_token_id": 3,
5
+ "output_attentions": false,
6
+ "output_hidden_states": false,
7
+ "pad_token_id": 2,
8
+ "suppress_tokens": [
9
+ 8193,
10
+ 8194,
11
+ 8195,
12
+ 8196,
13
+ 8197
14
+ ],
15
+ "transformers_version": "5.19.0"
16
+ }
pro/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f84b33e63ebd1851e910e8b2fe299d29f5e0efc6f57e84d92d2f79af464e0e5
3
+ size 1254196636
processor/processor_config.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "blank_token": "<blank>",
3
+ "feature_extractor": {
4
+ "feature_extractor_type": "ParakeetFeatureExtractor",
5
+ "feature_size": 128,
6
+ "hop_length": 160,
7
+ "n_fft": 512,
8
+ "padding_side": "right",
9
+ "padding_value": 0.0,
10
+ "preemphasis": 0.97,
11
+ "return_attention_mask": true,
12
+ "sampling_rate": 16000,
13
+ "win_length": 400
14
+ },
15
+ "processor_class": "ParakeetProcessor"
16
+ }
processor/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
processor/tokenizer_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "backend": "tokenizers",
3
+ "clean_up_tokenization_spaces": false,
4
+ "eos_token": "<|endoftext|>",
5
+ "model_max_length": 1000000000000000019884624838656,
6
+ "pad_token": "<pad>",
7
+ "processor_class": "ParakeetProcessor",
8
+ "tokenizer_class": "ParakeetTokenizer",
9
+ "unk_token": "<unk>"
10
+ }
sha256.json ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "files": {
3
+ "NOTICE": "fbab25d9ef392a9e0ec8b58e9792be2ac5de42ebc7b44208c2c000a1362e70f7",
4
+ "README.md": "f8e814f38be9e6f198fae2a022c35ae75af0da096ab5319ad21f4c1293a07169",
5
+ "clean/config.json": "3daa160911a59090325b95a91a4c28e2ff191780f61f025b41484e9cc64675cf",
6
+ "clean/generation_config.json": "b141de6ec6d7f982ece13f98f604e3fe1807ea9c0e839185d0ab7064604209d0",
7
+ "clean/model.safetensors": "8f56b3239f5afaa23263e04af8d8ca7d3ab83b53058ef24dcc22d6c5bc099023",
8
+ "plus/config.json": "3daa160911a59090325b95a91a4c28e2ff191780f61f025b41484e9cc64675cf",
9
+ "plus/generation_config.json": "b141de6ec6d7f982ece13f98f604e3fe1807ea9c0e839185d0ab7064604209d0",
10
+ "plus/model.safetensors": "d4fb681ad5f806a533222b29224d64b5f1cdbbeca1cf6e53b34e442e7372e01c",
11
+ "pro/config.json": "269282621d92eb22c3590fe0340530fec8a092d0387169bcd895c65541fa1ce0",
12
+ "pro/generation_config.json": "96e230a759fa74e65c36f654e5f9c909a426459d105e752f9003ddd7d328f8f3",
13
+ "pro/model.safetensors": "6f84b33e63ebd1851e910e8b2fe299d29f5e0efc6f57e84d92d2f79af464e0e5",
14
+ "processor/processor_config.json": "8346a93a3b987fa1dec57a78f045cd0817d21786589a5a096b41a57a446fd1d7",
15
+ "processor/tokenizer.json": "bd321b096832a3f270bd3b2a88823957920f1a5c5ada71114a26ea729d0cbe91",
16
+ "processor/tokenizer_config.json": "0b2fe0037599ee335f0b972fa682bf0ece74e4ccfec755cb7daa3405d3d3e874"
17
+ },
18
+ "provenance": {
19
+ "plus": {
20
+ "repo": "ConwayResearch/Underdog-Bark-3.0-Plus",
21
+ "revision": "d4fab2f8b95681e5ad3cfb4e8c5f4e0c009b3deb",
22
+ "source_file": "model.bark",
23
+ "source_sha256": "fdd9f1052e4fdead07d71e8cd2138813eb0c209fd6ff8b1b6f47737e1e501857",
24
+ "fp16_params": 604401926,
25
+ "fp32_params": 22655360
26
+ },
27
+ "clean": {
28
+ "repo": "ConwayResearch/Underdog-Bark-3.0-Clean",
29
+ "revision": "6d34ed8639b2b9a33e764acf06748519bbb950cf",
30
+ "source_file": "model.bark",
31
+ "source_sha256": "b67ca90d94b79a36af4616f1cb3f241884925de7aa9f3e673a8d5c6c4cfd3436",
32
+ "fp16_params": 604401926,
33
+ "fp32_params": 22655360
34
+ },
35
+ "pro": {
36
+ "repo": "ConwayResearch/Underdog-Bark-3.0-Pro",
37
+ "revision": "4b5c51e04aa8d16dda9ecdff71bc29f7360149e4",
38
+ "copied_verbatim": [
39
+ "model.safetensors",
40
+ "config.json",
41
+ "generation_config.json"
42
+ ]
43
+ },
44
+ "processor": {
45
+ "repo": "nvidia/parakeet-tdt-0.6b-v3",
46
+ "revision": "541d1f99c6b0c3cd0b11a95167540bb8edefd82b",
47
+ "copied_verbatim": [
48
+ "processor_config.json",
49
+ "tokenizer.json",
50
+ "tokenizer_config.json"
51
+ ]
52
+ }
53
+ }
54
+ }