Any-to-Any
Transformers
ONNX
Safetensors
English
Chinese
multimodal
audio
video
speech
streaming
full-duplex
long-video
custom-code
Instructions to use inclusionAI/Realtime-Venus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use inclusionAI/Realtime-Venus with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("inclusionAI/Realtime-Venus", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Realtime-Venus local preparation commited on
Commit ·
fb49076
1
Parent(s): 42945e5
Refine public model documentation
Browse files- README.md +4 -0
- README_zh.md +4 -0
README.md
CHANGED
|
@@ -201,6 +201,10 @@ modelscope download --model inclusionAI/Realtime-Venus --local_dir .
|
|
| 201 |
|
| 202 |
This mirror command is separate from the Hugging Face downloader above.
|
| 203 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 204 |
## 7. 🎙️ Realtime-Venus-Omni Usages
|
| 205 |
|
| 206 |
Runnable standalone versions of these examples live in the
|
|
|
|
| 201 |
|
| 202 |
This mirror command is separate from the Hugging Face downloader above.
|
| 203 |
|
| 204 |
+
### Data
|
| 205 |
+
|
| 206 |
+
[HEARTBEAT Challenge](./data/HEARTBEAT_Challenge/README.md) contains audio and video task data; see the data README for partitions, formats, and loading instructions.
|
| 207 |
+
|
| 208 |
## 7. 🎙️ Realtime-Venus-Omni Usages
|
| 209 |
|
| 210 |
Runnable standalone versions of these examples live in the
|
README_zh.md
CHANGED
|
@@ -146,6 +146,10 @@ modelscope download --model inclusionAI/Realtime-Venus --local_dir .
|
|
| 146 |
|
| 147 |
该镜像命令与上述 Hugging Face 下载器相互独立。
|
| 148 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 149 |
## 7. 🎙️ Realtime-Venus-Omni 使用方法
|
| 150 |
|
| 151 |
这些示例的独立可运行脚本位于 GitHub 上的 [Omni cookbook](https://github.com/inclusionAI/Realtime-Venus/tree/main/frontend/Realtime-Venus-Omni)。
|
|
|
|
| 146 |
|
| 147 |
该镜像命令与上述 Hugging Face 下载器相互独立。
|
| 148 |
|
| 149 |
+
### Data
|
| 150 |
+
|
| 151 |
+
[HEARTBEAT Challenge](./data/HEARTBEAT_Challenge/README_zh.md) 包含音频与视频任务数据,数据分区、格式和读取方式请参阅数据说明。
|
| 152 |
+
|
| 153 |
## 7. 🎙️ Realtime-Venus-Omni 使用方法
|
| 154 |
|
| 155 |
这些示例的独立可运行脚本位于 GitHub 上的 [Omni cookbook](https://github.com/inclusionAI/Realtime-Venus/tree/main/frontend/Realtime-Venus-Omni)。
|