File size: 988 Bytes
a6b690f
6d15985
 
a6b690f
6d15985
 
 
 
 
a6b690f
6d15985
 
 
 
 
 
f530837
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
library_name: transformers
pipeline_tag: audio-text-to-text
license: apache-2.0
tags:
  - audio
  - multimodal
  - robobrain
  - openmoss-audio
---

# GaussianMind

GaussianMind is an audio-language model developed based on RoboBrain and OpenMOSS Audio.

This model is the result of joint research by Hao Tang's team at the School of Computer Science, Peking University, and the Beijing Academy of Artificial Intelligence (BAAI).

## Usage

The repository includes custom Transformers code. Load the model and processor with `trust_remote_code=True`:

```python
from transformers import AutoModelForCausalLM, AutoProcessor

model_id = "BAAI/GaussianMind"
processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    trust_remote_code=True,
    device_map="auto",
)
```

## Acknowledgements

GaussianMind builds upon RoboBrain and OpenMOSS Audio. We thank their contributors for making this work possible.