Instructions to use harpertoken/talk with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use harpertoken/talk with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="harpertoken/talk")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("harpertoken/talk") model = AutoModelForSpeechSeq2Seq.from_pretrained("harpertoken/talk", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -17,16 +17,16 @@ A `whisper-small` encoder-decoder, fine-tuned on short passages of live micropho
|
|
| 17 |
|
| 18 |
Two corrections to the previous version of this card, both of which pointed at the wrong model. The metadata claimed a Wav2Vec2 lineage — `facebook/wav2vec2-base-960h` as a base model, and `facebook/multilingual_librispeech` as the training set. Neither is true of the published checkpoint: `config.json` records `_name_or_path: openai/whisper-small` with `WhisperForConditionalGeneration`, and the documented training signal was live recordings, not a fixed corpus. The earlier card also described `main.py`, `train.py`, `test_transcription.py` and a `requirements.txt`; none of those files have ever been in this repository, so the instructions it gave could not be followed.
|
| 19 |
|
| 20 |
-
The
|
| 21 |
|
| 22 |
## Usage
|
| 23 |
|
| 24 |
```python
|
| 25 |
import torch
|
| 26 |
-
from transformers import WhisperForConditionalGeneration,
|
| 27 |
|
| 28 |
model = WhisperForConditionalGeneration.from_pretrained("harpertoken/talk")
|
| 29 |
-
processor =
|
| 30 |
|
| 31 |
transcriber = pipeline(
|
| 32 |
"automatic-speech-recognition",
|
|
|
|
| 17 |
|
| 18 |
Two corrections to the previous version of this card, both of which pointed at the wrong model. The metadata claimed a Wav2Vec2 lineage — `facebook/wav2vec2-base-960h` as a base model, and `facebook/multilingual_librispeech` as the training set. Neither is true of the published checkpoint: `config.json` records `_name_or_path: openai/whisper-small` with `WhisperForConditionalGeneration`, and the documented training signal was live recordings, not a fixed corpus. The earlier card also described `main.py`, `train.py`, `test_transcription.py` and a `requirements.txt`; none of those files have ever been in this repository, so the instructions it gave could not be followed.
|
| 19 |
|
| 20 |
+
The tokenizer and the feature extractor are now present in the repository, taken from [`openai/whisper-small`](https://huggingface.co/openai/whisper-small) — the same 51865-token vocabulary and 80-bin mel filterbank the checkpoint expects, since that is what it was fine-tuned from. An earlier version of this repository shipped neither, and `AutoProcessor.from_pretrained` failed outright while `AutoTokenizer` returned a one-token vocabulary. Both are fixed; `WhisperForConditionalGeneration`, `AutoProcessor` and the `automatic-speech-recognition` pipeline now all load from this identifier alone. The repository's own `generation_config.json` was kept as fine-tuned rather than replaced with the upstream one. `training_log.pt` in the root is 761 bytes of leftover debug state and can be ignored. `pytorch_model.bin` duplicates `model.safetensors`.
|
| 21 |
|
| 22 |
## Usage
|
| 23 |
|
| 24 |
```python
|
| 25 |
import torch
|
| 26 |
+
from transformers import WhisperForConditionalGeneration, AutoProcessor, pipeline
|
| 27 |
|
| 28 |
model = WhisperForConditionalGeneration.from_pretrained("harpertoken/talk")
|
| 29 |
+
processor = AutoProcessor.from_pretrained("harpertoken/talk")
|
| 30 |
|
| 31 |
transcriber = pipeline(
|
| 32 |
"automatic-speech-recognition",
|