Any-to-Any
Transformers
ONNX
Safetensors
English
Chinese
multimodal
audio
video
speech
streaming
full-duplex
long-video
custom-code
Instructions to use inclusionAI/Realtime-Venus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use inclusionAI/Realtime-Venus with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("inclusionAI/Realtime-Venus", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Realtime-Venus local preparation commited on
Commit ·
ddbeee6
1
Parent(s): a1c592b
Refine public model documentation
Browse files- README.md +1 -1
- README_zh.md +2 -2
README.md
CHANGED
|
@@ -705,4 +705,4 @@ libraries, and any data used with this checkpoint.
|
|
| 705 |
|
| 706 |
Model release: `03b5c2919dd684900bdf6852272ac6a8f30fab74`. Root configuration: `15d5b420cd8557e9582d41a57a80af3e4de18e47`.
|
| 707 |
|
| 708 |
-
Root `config.yaml`
|
|
|
|
| 705 |
|
| 706 |
Model release: `03b5c2919dd684900bdf6852272ac6a8f30fab74`. Root configuration: `15d5b420cd8557e9582d41a57a80af3e4de18e47`.
|
| 707 |
|
| 708 |
+
Root `config.yaml` contains the Audio and Omni configurations. Each model directory's `config.json` references a fixed version through `venus_config_ref`. Load the selected model directory with Transformers; weights, Tokenizer, Processor and TTS resources reside in that directory. For offline use, retain the configuration, custom code and all model resources.
|
README_zh.md
CHANGED
|
@@ -127,7 +127,7 @@ hf download inclusionAI/Realtime-Venus Realtime-Venus-Omni/requirements.txt --re
|
|
| 127 |
python -m pip install -r Realtime-Venus-Omni/requirements.txt
|
| 128 |
```
|
| 129 |
|
| 130 |
-
也可以在包含 `download_models.py` 的目录中,通过 Python
|
| 131 |
|
| 132 |
```python
|
| 133 |
from download_models import download_models
|
|
@@ -616,4 +616,4 @@ print("Saved generated speech to output/audio_full_duplex.wav")
|
|
| 616 |
|
| 617 |
模型发布版本:`03b5c2919dd684900bdf6852272ac6a8f30fab74`。根配置版本:`15d5b420cd8557e9582d41a57a80af3e4de18e47`。
|
| 618 |
|
| 619 |
-
根 `config.yaml`
|
|
|
|
| 127 |
python -m pip install -r Realtime-Venus-Omni/requirements.txt
|
| 128 |
```
|
| 129 |
|
| 130 |
+
也可以在包含 `download_models.py` 的目录中,通过 Python 下载模型:
|
| 131 |
|
| 132 |
```python
|
| 133 |
from download_models import download_models
|
|
|
|
| 616 |
|
| 617 |
模型发布版本:`03b5c2919dd684900bdf6852272ac6a8f30fab74`。根配置版本:`15d5b420cd8557e9582d41a57a80af3e4de18e47`。
|
| 618 |
|
| 619 |
+
根 `config.yaml` 保存 Audio/Omni 模型配置,子目录 `config.json` 通过 `venus_config_ref` 引用固定版本。使用 Transformers 从对应模型子目录加载,权重、Tokenizer、Processor 和 TTS 资源均位于该目录。离线使用需同时保留配置、自定义代码及模型配套资源。
|