Instructions to use unity/inference-engine-whisper-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- unity-sentis
How to use unity/inference-engine-whisper-tiny with unity-sentis:
string modelName = "[Your model name here].sentis"; Model model = ModelLoader.Load(Application.streamingAssetsPath + "/" + modelName); IWorker engine = WorkerFactory.CreateWorker(BackendType.GPUCompute, model); // Please see provided C# file for more details
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,8 @@ This is the [Whisper Tiny](https://huggingface.co/openai/whisper-tiny) model tes
|
|
| 11 |
* Open a new scene in Unity 2023
|
| 12 |
* Put the `RunWhisper.cs` on the Main Camera
|
| 13 |
* Put the *.sentis files and the `vocab.json` in the Assets/StreamingAssets folder
|
| 14 |
-
* Add a 16kHz mono audio file up to 30 seconds long to your project and drag on to the audioClip field.
|
|
|
|
| 15 |
* You can add a step to convert 44kHz or 22kHz audio to 16kHz with [this model](https://huggingface.co/unity/sentis-audio-frequency-to-16khz)
|
| 16 |
|
| 17 |
When you press play the transcription of the audio will be displayed in the console window.
|
|
|
|
| 11 |
* Open a new scene in Unity 2023
|
| 12 |
* Put the `RunWhisper.cs` on the Main Camera
|
| 13 |
* Put the *.sentis files and the `vocab.json` in the Assets/StreamingAssets folder
|
| 14 |
+
* Add a 16kHz mono audio file up to 30 seconds long to your project and drag on to the audioClip field.
|
| 15 |
+
* **IMPORTANT:** The audio must be 16kHz. In the audio inspector select "Force Mono". And "Decompress on Load".
|
| 16 |
* You can add a step to convert 44kHz or 22kHz audio to 16kHz with [this model](https://huggingface.co/unity/sentis-audio-frequency-to-16khz)
|
| 17 |
|
| 18 |
When you press play the transcription of the audio will be displayed in the console window.
|