Audio-Text-to-Text
PEFT
Safetensors
qwen3_omni_moe
audio
audio-language-model
audio-text-alignment
rubric-based-evaluation
judge-model
lora
Instructions to use Zixchen/FineAudio-Judge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Zixchen/FineAudio-Judge with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-Omni-30B-A3B-Instruct") model = PeftModel.from_pretrained(base_model, "Zixchen/FineAudio-Judge") - Notebooks
- Google Colab
- Kaggle
Add framework introduction, resource links, and model tags
Browse files
README.md
CHANGED
|
@@ -3,18 +3,48 @@ base_model: Qwen/Qwen3-Omni-30B-A3B-Instruct
|
|
| 3 |
library_name: peft
|
| 4 |
license: apache-2.0
|
| 5 |
pipeline_tag: audio-text-to-text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
# FineAudio-Judge
|
| 9 |
|
| 10 |
-
|
| 11 |
-
or audio-generation instructions through prompt-derived rubric questions.
|
| 12 |
-
Given an audio sample and a rubric question, it predicts a yes/no answer.
|
| 13 |
|
| 14 |
-
|
| 15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
[Qwen3-Omni-30B-A3B-Instruct](https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct).
|
| 17 |
-
The adapter
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
## Files
|
| 20 |
|
|
|
|
| 3 |
library_name: peft
|
| 4 |
license: apache-2.0
|
| 5 |
pipeline_tag: audio-text-to-text
|
| 6 |
+
tags:
|
| 7 |
+
- qwen3_omni_moe
|
| 8 |
+
- audio
|
| 9 |
+
- audio-language-model
|
| 10 |
+
- audio-text-alignment
|
| 11 |
+
- rubric-based-evaluation
|
| 12 |
+
- judge-model
|
| 13 |
+
- lora
|
| 14 |
---
|
| 15 |
|
| 16 |
# FineAudio-Judge
|
| 17 |
|
| 18 |
+
> A Fine-Grained Evaluation Framework for Complex Text-to-Audio Generation
|
|
|
|
|
|
|
| 19 |
|
| 20 |
+
[Code](https://github.com/QwenAudio/FunResearch/tree/main/FineAudio-Judge) |
|
| 21 |
+
[Benchmark](https://huggingface.co/datasets/Zixchen/FineAudio-Judge-Benchmark)
|
| 22 |
+
|
| 23 |
+
FineAudio-Judge is a fine-grained evaluation framework for assessing
|
| 24 |
+
whether audio matches text descriptions or generation instructions
|
| 25 |
+
for complex audio scenes.
|
| 26 |
+
|
| 27 |
+
Given an audio–text pair, the framework first structurally decomposes
|
| 28 |
+
the text into events, attributes, and inter-event relations, then
|
| 29 |
+
converts them into atomic binary rubric questions. The audio judge
|
| 30 |
+
answers each question with yes or no based on the audio, assessing
|
| 31 |
+
whether the audio matches the corresponding aspect of the text
|
| 32 |
+
description. The proportion of yes answers forms the overall
|
| 33 |
+
audio–text consistency score.
|
| 34 |
+
|
| 35 |
+
To train the audio judge, we construct a multi-route corpus covering
|
| 36 |
+
real, composed, and generated audio. Rubric-guided prompt/audio
|
| 37 |
+
perturbations and cross-sample mismatches provide fine-grained
|
| 38 |
+
supervision across varying levels of audio–text consistency.
|
| 39 |
+
|
| 40 |
+
This repository releases the resulting LoRA adapter, obtained by
|
| 41 |
+
supervised fine-tuning of
|
| 42 |
[Qwen3-Omni-30B-A3B-Instruct](https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct).
|
| 43 |
+
The adapter needs to be loaded together with the base model.
|
| 44 |
+
Rubric decomposition uses a separately configured language-model
|
| 45 |
+
backend in the
|
| 46 |
+
[code repository](https://github.com/QwenAudio/FunResearch/tree/main/FineAudio-Judge),
|
| 47 |
+
while the released adapter performs audio-based rubric judgments.
|
| 48 |
|
| 49 |
## Files
|
| 50 |
|