Zixchen commited on
Commit
8f55826
·
verified ·
1 Parent(s): b5acfa3

Add framework introduction, resource links, and model tags

Browse files
Files changed (1) hide show
  1. README.md +36 -6
README.md CHANGED
@@ -3,18 +3,48 @@ base_model: Qwen/Qwen3-Omni-30B-A3B-Instruct
3
  library_name: peft
4
  license: apache-2.0
5
  pipeline_tag: audio-text-to-text
 
 
 
 
 
 
 
 
6
  ---
7
 
8
  # FineAudio-Judge
9
 
10
- FineAudio-Judge evaluates consistency between audio and text descriptions
11
- or audio-generation instructions through prompt-derived rubric questions.
12
- Given an audio sample and a rubric question, it predicts a yes/no answer.
13
 
14
- This repository releases a LoRA adapter obtained by supervised fine-tuning
15
- the Thinker language model of
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  [Qwen3-Omni-30B-A3B-Instruct](https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct).
17
- The adapter must be loaded together with the base model.
 
 
 
 
18
 
19
  ## Files
20
 
 
3
  library_name: peft
4
  license: apache-2.0
5
  pipeline_tag: audio-text-to-text
6
+ tags:
7
+ - qwen3_omni_moe
8
+ - audio
9
+ - audio-language-model
10
+ - audio-text-alignment
11
+ - rubric-based-evaluation
12
+ - judge-model
13
+ - lora
14
  ---
15
 
16
  # FineAudio-Judge
17
 
18
+ > A Fine-Grained Evaluation Framework for Complex Text-to-Audio Generation
 
 
19
 
20
+ [Code](https://github.com/QwenAudio/FunResearch/tree/main/FineAudio-Judge) |
21
+ [Benchmark](https://huggingface.co/datasets/Zixchen/FineAudio-Judge-Benchmark)
22
+
23
+ FineAudio-Judge is a fine-grained evaluation framework for assessing
24
+ whether audio matches text descriptions or generation instructions
25
+ for complex audio scenes.
26
+
27
+ Given an audio–text pair, the framework first structurally decomposes
28
+ the text into events, attributes, and inter-event relations, then
29
+ converts them into atomic binary rubric questions. The audio judge
30
+ answers each question with yes or no based on the audio, assessing
31
+ whether the audio matches the corresponding aspect of the text
32
+ description. The proportion of yes answers forms the overall
33
+ audio–text consistency score.
34
+
35
+ To train the audio judge, we construct a multi-route corpus covering
36
+ real, composed, and generated audio. Rubric-guided prompt/audio
37
+ perturbations and cross-sample mismatches provide fine-grained
38
+ supervision across varying levels of audio–text consistency.
39
+
40
+ This repository releases the resulting LoRA adapter, obtained by
41
+ supervised fine-tuning of
42
  [Qwen3-Omni-30B-A3B-Instruct](https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct).
43
+ The adapter needs to be loaded together with the base model.
44
+ Rubric decomposition uses a separately configured language-model
45
+ backend in the
46
+ [code repository](https://github.com/QwenAudio/FunResearch/tree/main/FineAudio-Judge),
47
+ while the released adapter performs audio-based rubric judgments.
48
 
49
  ## Files
50