Automatic Speech Recognition
Transformers
PyTorch
TensorFlow
JAX
Safetensors
whisper
audio
hf-asr-leaderboard
Instructions to use patrol90/whisper-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use patrol90/whisper-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="patrol90/whisper-large")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("patrol90/whisper-large") model = AutoModelForSpeechSeq2Seq.from_pretrained("patrol90/whisper-large", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 983 Bytes
b8500cb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 | from typing import Dict
from transformers.pipelines.audio_utils import ffmpeg_read
import whisper
import torch
SAMPLE_RATE = 16000
class EndpointHandler():
def __init__(self, path=""):
# load the model
self.model = whisper.load_model("large")
def __call__(self, data: Dict[str, bytes]) -> Dict[str, str]:
"""
Args:
data (:obj:):
includes the deserialized audio file as bytes
Return:
A :obj:`dict`:. base64 encoded image
"""
# process input
inputs = data.pop("inputs", data)
audio_nparray = ffmpeg_read(inputs, SAMPLE_RATE)
audio_tensor= torch.from_numpy(audio_nparray)
# run inference pipeline
result = self.model.transcribe(audio_nparray)
# postprocess the prediction
return {
"segments": result["segments"],
"language_code": result["language"],
"text": result["text"],
}
|