Helloworld628 commited on
Commit
185516c
·
verified ·
1 Parent(s): f53c678

Upload qwen3vl_sft_v16 excluding caches

Browse files
.gitattributes CHANGED
@@ -55,3 +55,4 @@ sft/qwen3vl_sft_v7_vit/evaluate_best/evaluation_detail.json filter=lfs diff=lfs
55
  sft/qwen3vl_sft_v8_multitask/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
56
  sft/qwen3vl_sft_v9_multitask_llava/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
57
  sft/qwen3vl_sft_v18/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
 
 
55
  sft/qwen3vl_sft_v8_multitask/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
56
  sft/qwen3vl_sft_v9_multitask_llava/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
57
  sft/qwen3vl_sft_v18/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
58
+ sft/qwen3vl_sft_v16/evaluate_best/evaluation_detail.json filter=lfs diff=lfs merge=lfs -text
sft/qwen3vl_sft_v16/evaluate_best/.evaluation.lock ADDED
File without changes
sft/qwen3vl_sft_v16/evaluate_best/evaluation.text ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 书法 bbox 召回率与参考文本相似度评测(0–5)
2
+ judge:gpt-6-luna
3
+ 已保存样本:2188/2188;状态:{"ok":2188}
4
+ 中断:False;全局 API 错误:None
5
+ 局部分数仅评 IoU 命中的文本;主均值先逐图平均再跨图平均,只有该字段完成评分的图像计入。
6
+ 分数表示与参考的语义、内容覆盖及专业概念一致性,不是图像事实准确性。
7
+ 参考字段缺失则跳过;预测字段为空得 0;API 失败不当作 0。
8
+ 严格联合成功要求命中 bbox 且每个必要 LLM judge 字段均 ≥ 4;ROUGE-L/BERTScore 不参与合格判定。
9
+ 整体评论与 IoU 阈值无关,每字评一次。
10
+
11
+ ========== IoU ≥ 0.3 ==========
12
+ 笔法
13
+ 参考 4588,命中 2654;无效参考框 0
14
+ 召回率:57.85%;逐图宏召回率:62.14%;匹配平均 IoU:0.7935
15
+ 严格联合成功:171 条;联合成功率:3.73%;命中后合格率:6.44%;未合格命中 2483,未完成评分命中 0
16
+ visual_evidence:逐图均值 2.9319/5;区域均值 2.9461/5;已评 2654/2654,缺失评审 0,无参考跳过 0
17
+ rouge_l_f1:逐图均值 0.3725;区域均值 0.3732;已评 2654,缺失 0
18
+ bertscore_precision:逐图均值 0.7761;区域均值 0.7761;已评 2654,缺失 0
19
+ bertscore_recall:逐图均值 0.7682;区域均值 0.7685;已评 2654,缺失 0
20
+ bertscore_f1:逐图均值 0.7719;区域均值 0.7720;已评 2654,缺失 0
21
+ technique:逐图均值 1.8739/5;区域均值 1.8787/5;已评 2654/2654,缺失评审 0,无参考跳过 0
22
+ rouge_l_f1:逐图均值 0.7326;区域均值 0.7301;已评 2654,缺失 0
23
+ bertscore_precision:逐图均值 0.8536;区域均值 0.8525;已评 2654,缺失 0
24
+ bertscore_recall:逐图均值 0.8417;区域均值 0.8407;已评 2654,缺失 0
25
+ bertscore_f1:逐图均值 0.8471;区域均值 0.8461;已评 2654,缺失 0
26
+ technical_explanation:逐图均值 2.6203/5;区域均值 2.6089/5;已评 2654/2654,缺失评审 0,无参考跳过 0
27
+ rouge_l_f1:逐图均值 0.3434;区域均值 0.3426;已评 2654,缺失 0
28
+ bertscore_precision:逐图均值 0.7676;区域均值 0.7665;已评 2654,缺失 0
29
+ bertscore_recall:逐图均值 0.7579;区域均值 0.7574;已评 2654,缺失 0
30
+ bertscore_f1:逐图均值 0.7625;区域均值 0.7617;已评 2654,缺失 0
31
+ 算法指标(该类型全部局部文本字段合计):
32
+ rouge_l_f1:区域均值 0.4819;字段-图像均值 0.4828;已评 7962,缺失 0
33
+ bertscore_precision:区域均值 0.7984;字段-图像均值 0.7991;已评 7962,缺失 0
34
+ bertscore_recall:区域均值 0.7889;字段-图像均值 0.7893;已评 7962,缺失 0
35
+ bertscore_f1:区域均值 0.7933;字段-图像均值 0.7938;已评 7962,缺失 0
36
+
37
+ 字法
38
+ 参考 4540,命中 1744;无效参考框 0
39
+ 召回率:38.41%;逐图宏召回率:39.22%;匹配平均 IoU:0.7413
40
+ 严格联合成功:73 条;联合成功率:1.61%;命中后合格率:4.19%;未合格命中 1671,未完成评分命中 0
41
+ evidence:逐图均值 2.0406/5;区域均值 2.0080/5;已评 1744/1744,缺失评审 0,无参考跳过 0
42
+ rouge_l_f1:逐图均值 0.2962;区域均值 0.2902;已评 1744,缺失 0
43
+ bertscore_precision:逐图均值 0.7349;区域均值 0.7322;已评 1744,缺失 0
44
+ bertscore_recall:逐图均值 0.7302;区域均值 0.7270;已评 1744,缺失 0
45
+ bertscore_f1:逐图均值 0.7322;区域均值 0.7293;已评 1744,缺失 0
46
+ description:逐图均值 2.0066/5;区域均值 1.9685/5;已评 1744/1744,缺失评审 0,无参考跳过 0
47
+ rouge_l_f1:逐图均值 0.3027;区域均值 0.2932;已评 1744,缺失 0
48
+ bertscore_precision:逐图均值 0.7130;区域均值 0.7072;已评 1744,缺失 0
49
+ bertscore_recall:逐图均值 0.7129;区域均值 0.7066;已评 1744,缺失 0
50
+ bertscore_f1:逐图均值 0.7122;区域均值 0.7061;已评 1744,缺失 0
51
+ feature:逐图均值 1.6767/5;区域均值 1.6766/5;已评 1744/1744,缺失评审 0,无参考跳过 0
52
+ rouge_l_f1:逐图均值 0.1682;区域均值 0.1702;已评 1744,缺失 0
53
+ bertscore_precision:逐图均值 0.6341;区域均值 0.6337;已评 1744,缺失 0
54
+ bertscore_recall:逐图均值 0.6269;区域均值 0.6240;已评 1744,缺失 0
55
+ bertscore_f1:逐图均值 0.6298;区域均值 0.6280;已评 1744,缺失 0
56
+ effect:逐图均值 2.1909/5;区域均值 2.1525/5;已评 1744/1744,缺失评审 0,无参考跳过 0
57
+ rouge_l_f1:逐图均值 0.3098;区域均值 0.2989;已评 1744,缺失 0
58
+ bertscore_precision:逐图均值 0.7320;区域均值 0.7254;已评 1744,缺失 0
59
+ bertscore_recall:逐图均值 0.7311;区域均值 0.7250;已评 1744,缺失 0
60
+ bertscore_f1:逐图均值 0.7311;区域均值 0.7247;已评 1744,缺失 0
61
+ 算法指标(该类型全部局部文本字段合计):
62
+ rouge_l_f1:区域均值 0.2631;字段-图像均值 0.2692;已评 6976,缺失 0
63
+ bertscore_precision:区域均值 0.6996;字段-图像均值 0.7035;已评 6976,缺失 0
64
+ bertscore_recall:区域均值 0.6957;字段-图像均值 0.7003;已评 6976,缺失 0
65
+ bertscore_f1:区域均值 0.6970;字段-图像均值 0.7013;已评 6976,缺失 0
66
+
67
+ 算法指标(笔法+字法全部局部字段合计):
68
+ rouge_l_f1:区域均值 0.3797;已评 14938,缺失 0
69
+ bertscore_precision:区域均值 0.7523;已评 14938,缺失 0
70
+ bertscore_recall:区域均值 0.7453;已评 14938,缺失 0
71
+ bertscore_f1:区域均值 0.7483;已评 14938,缺失 0
72
+ ========== IoU ≥ 0.5 ==========
73
+ 笔法
74
+ 参考 4588,命中 2258;无效参考框 0
75
+ 召回率:49.22%;逐图宏召回率:52.45%;匹配平均 IoU:0.8641
76
+ 严格联合成功:155 条;联合成功率:3.38%;命中后合格率:6.86%;未合格命中 2103,未完成评分命中 0
77
+ visual_evidence:逐图均值 3.0624/5;区域均值 3.0793/5;已评 2258/2258,缺失评审 0,无参考跳过 0
78
+ rouge_l_f1:逐图均值 0.3863;区域均值 0.3880;已评 2258,缺失 0
79
+ bertscore_precision:逐图均值 0.7810;区域均值 0.7818;已评 2258,缺失 0
80
+ bertscore_recall:逐图均值 0.7735;区域均值 0.7744;已评 2258,缺失 0
81
+ bertscore_f1:逐图均值 0.7770;区域均值 0.7779;已评 2258,缺失 0
82
+ technique:逐图均值 1.9439/5;区域均值 1.9411/5;已评 2258/2258,缺失评审 0,无参考跳过 0
83
+ rouge_l_f1:逐图均值 0.7384;区域均值 0.7367;已评 2258,缺失 0
84
+ bertscore_precision:逐图均值 0.8563;区域均值 0.8554;已评 2258,缺失 0
85
+ bertscore_recall:逐图均值 0.8450;区域均值 0.8443;已评 2258,缺失 0
86
+ bertscore_f1:逐图均值 0.8502;区域均值 0.8494;已评 2258,缺失 0
87
+ technical_explanation:逐图均值 2.7337/5;区域均值 2.7245/5;已评 2258/2258,缺失评审 0,无参考跳过 0
88
+ rouge_l_f1:逐图均值 0.3516;区域均值 0.3520;已评 2258,缺失 0
89
+ bertscore_precision:逐图均值 0.7713;区域均值 0.7710;已评 2258,缺失 0
90
+ bertscore_recall:逐图均值 0.7618;区域均值 0.7619;已评 2258,缺失 0
91
+ bertscore_f1:逐图均值 0.7663;区域均值 0.7662;已评 2258,缺失 0
92
+ 算法指标(该类型全部局部文本字段合计):
93
+ rouge_l_f1:区域均值 0.4922;字段-图像均值 0.4921;已评 6774,缺失 0
94
+ bertscore_precision:区域均值 0.8027;字段-图像均值 0.8029;已评 6774,缺失 0
95
+ bertscore_recall:区域均值 0.7935;字段-图像均值 0.7934;已评 6774,缺失 0
96
+ bertscore_f1:区域均值 0.7978;字段-图像均值 0.7978;已评 6774,缺失 0
97
+
98
+ 字法
99
+ 参考 4540,命中 1308;无效参考框 0
100
+ 召回率:28.81%;逐图宏召回率:27.94%;匹配平均 IoU:0.8584
101
+ 严格联合成功:71 条;联合成功率:1.56%;命中后合格率:5.43%;未合格命中 1237,未完成评分命中 0
102
+ evidence:逐图均值 2.1611/5;区域均值 2.1277/5;已评 1308/1308,缺失评审 0,无参考跳过 0
103
+ rouge_l_f1:逐图均值 0.3076;区域均值 0.3009;已评 1308,缺失 0
104
+ bertscore_precision:逐图均值 0.7390;区域均值 0.7362;已评 1308,缺失 0
105
+ bertscore_recall:逐图均值 0.7336;区域均值 0.7309;已评 1308,缺失 0
106
+ bertscore_f1:逐图均值 0.7359;区域均值 0.7332;已评 1308,缺失 0
107
+ description:逐图均值 2.1852/5;区域均值 2.1346/5;已评 1308/1308,缺失评审 0,无参考跳过 0
108
+ rouge_l_f1:逐图均值 0.3151;区域均值 0.3053;已评 1308,缺失 0
109
+ bertscore_precision:逐图均值 0.7171;区域均值 0.7112;已评 1308,缺失 0
110
+ bertscore_recall:逐图均值 0.7177;区域均值 0.7112;已评 1308,缺失 0
111
+ bertscore_f1:逐图均值 0.7166;区域均值 0.7104;已评 1308,缺失 0
112
+ feature:逐图均值 1.7806/5;区域均值 1.7844/5;已评 1308/1308,缺失评审 0,无参考跳过 0
113
+ rouge_l_f1:逐图均值 0.1928;区域均值 0.1977;已评 1308,缺失 0
114
+ bertscore_precision:逐图均值 0.6442;区域均值 0.6456;已评 1308,缺失 0
115
+ bertscore_recall:逐图均值 0.6362;区域均值 0.6353;已评 1308,缺失 0
116
+ bertscore_f1:逐图均值 0.6395;区域均值 0.6396;已评 1308,缺失 0
117
+ effect:逐图均值 2.2444/5;区域均值 2.2118/5;已评 1308/1308,缺失评审 0,无参考跳过 0
118
+ rouge_l_f1:逐图均值 0.3220;区域均值 0.3102;已评 1308,缺失 0
119
+ bertscore_precision:逐图均值 0.7361;区域均值 0.7288;已评 1308,缺失 0
120
+ bertscore_recall:逐图均值 0.7354;区域均值 0.7290;已评 1308,缺失 0
121
+ bertscore_f1:逐图均值 0.7353;区域均值 0.7284;已评 1308,缺失 0
122
+ 算法指标(该类型全部局部文本字段合计):
123
+ rouge_l_f1:区域均值 0.2785;字段-图像均值 0.2844;已评 5232,缺失 0
124
+ bertscore_precision:区域均值 0.7055;字段-图像均值 0.7091;已评 5232,缺失 0
125
+ bertscore_recall:区域均值 0.7016;字段-图像均值 0.7057;已评 5232,缺失 0
126
+ bertscore_f1:区域均值 0.7029;字段-图像均值 0.7068;已评 5232,缺失 0
127
+
128
+ 算法指标(笔法+字法全部局部字段合计):
129
+ rouge_l_f1:区域均值 0.3991;已评 12006,缺失 0
130
+ bertscore_precision:区域均值 0.7603;已评 12006,缺失 0
131
+ bertscore_recall:区域均值 0.7535;已评 12006,缺失 0
132
+ bertscore_f1:区域均值 0.7565;已评 12006,缺失 0
133
+ ========== IoU ≥ 0.75 ==========
134
+ 笔法
135
+ 参考 4588,命中 1792;无效参考框 0
136
+ 召回率:39.06%;逐图宏召回率:41.37%;匹配平均 IoU:0.9263
137
+ 严格联合成功:129 条;联合成功率:2.81%;命中后合格率:7.20%;未合格命中 1663,未完成评分命中 0
138
+ visual_evidence:逐图均值 3.1556/5;区域均值 3.1641/5;已评 1792/1792,缺失评审 0,无参考跳过 0
139
+ rouge_l_f1:逐图均值 0.3974;区域均值 0.3990;已评 1792,缺失 0
140
+ bertscore_precision:逐图均值 0.7855;区域均值 0.7863;已评 1792,缺失 0
141
+ bertscore_recall:逐图均值 0.7783;区域均值 0.7791;已评 1792,缺失 0
142
+ bertscore_f1:逐图均值 0.7817;区域均值 0.7824;已评 1792,缺失 0
143
+ technique:逐图均值 1.9697/5;区域均值 1.9766/5;已评 1792/1792,缺失评审 0,无参考跳过 0
144
+ rouge_l_f1:逐图均值 0.7420;区域均值 0.7413;已评 1792,缺失 0
145
+ bertscore_precision:逐图均值 0.8583;区域均值 0.8580;已评 1792,缺失 0
146
+ bertscore_recall:逐图均值 0.8471;区域均值 0.8470;已评 1792,缺失 0
147
+ bertscore_f1:逐图均值 0.8522;区域均值 0.8520;已评 1792,缺失 0
148
+ technical_explanation:逐图均值 2.7955/5;区域均值 2.7896/5;已评 1792/1792,缺失评审 0,无参考跳过 0
149
+ rouge_l_f1:逐图均值 0.3582;区域均值 0.3591;已评 1792,缺失 0
150
+ bertscore_precision:逐图均值 0.7740;区域均值 0.7741;已评 1792,缺失 0
151
+ bertscore_recall:逐图均值 0.7645;区域均值 0.7648;已评 1792,缺失 0
152
+ bertscore_f1:逐图均值 0.7690;区域均值 0.7692;已评 1792,缺失 0
153
+ 算法指标(该类型全部局部文本字段合计):
154
+ rouge_l_f1:区域均值 0.4998;字段-图像均值 0.4992;已评 5376,缺失 0
155
+ bertscore_precision:区域均值 0.8061;字段-图像均值 0.8059;已评 5376,缺失 0
156
+ bertscore_recall:区域均值 0.7970;字段-图像均值 0.7966;已评 5376,缺失 0
157
+ bertscore_f1:区域均值 0.8012;字段-图像均值 0.8010;已评 5376,缺失 0
158
+
159
+ 字法
160
+ 参考 4540,命中 947;无效参考框 0
161
+ 召回率:20.86%;逐图宏召回率:19.35%;匹配平均 IoU:0.9533
162
+ 严格联合成功:56 条;联合成功率:1.23%;命中后合格率:5.91%;未合格命中 891,未完成评分命中 0
163
+ evidence:逐图均值 2.2222/5;区域均值 2.1911/5;已评 947/947,缺失评审 0,无参考跳过 0
164
+ rouge_l_f1:逐图均值 0.3102;区域均值 0.3032;已评 947,缺失 0
165
+ bertscore_precision:逐图均值 0.7404;区域均值 0.7372;已评 947,缺失 0
166
+ bertscore_recall:逐图均值 0.7354;区域均值 0.7321;已评 947,缺失 0
167
+ bertscore_f1:逐图均值 0.7375;区域均值 0.7343;已评 947,缺失 0
168
+ description:逐图均值 2.2725/5;区域均值 2.2302/5;已评 947/947,缺失评审 0,无参考跳过 0
169
+ rouge_l_f1:逐图均值 0.3223;区域均值 0.3122;已评 947,缺失 0
170
+ bertscore_precision:逐图均值 0.7169;区域均值 0.7111;已评 947,缺失 0
171
+ bertscore_recall:逐图均值 0.7195;区域均值 0.7135;已评 947,缺失 0
172
+ bertscore_f1:逐图均值 0.7173;区域均值 0.7114;已评 947,缺失 0
173
+ feature:逐图均值 1.8682/5;区域均值 1.8522/5;已评 947/947,缺失评审 0,无参考跳过 0
174
+ rouge_l_f1:逐图均值 0.2272;区域均值 0.2298;已评 947,缺失 0
175
+ bertscore_precision:逐图均值 0.6580;区域均值 0.6590;已评 947,缺失 0
176
+ bertscore_recall:逐图均值 0.6491;区域均值 0.6485;已评 947,缺失 0
177
+ bertscore_f1:逐图均值 0.6528;区域均值 0.6529;已评 947,缺失 0
178
+ effect:逐图均值 2.3035/5;区域均值 2.2661/5;已评 947/947,缺失评审 0,无参考跳过 0
179
+ rouge_l_f1:逐图均值 0.3280;区域均值 0.3170;已评 947,缺失 0
180
+ bertscore_precision:逐图均值 0.7356;区域均值 0.7287;已评 947,缺失 0
181
+ bertscore_recall:逐图均值 0.7367;区域均值 0.7308;已评 947,缺失 0
182
+ bertscore_f1:逐图均值 0.7356;区域均值 0.7292;已评 947,缺失 0
183
+ 算法指标(该类型全部局部文本字段合计):
184
+ rouge_l_f1:区���均值 0.2905;字段-图像均值 0.2969;已评 3788,缺失 0
185
+ bertscore_precision:区域均值 0.7090;字段-图像均值 0.7127;已评 3788,缺失 0
186
+ bertscore_recall:区域均值 0.7062;字段-图像均值 0.7102;已评 3788,缺失 0
187
+ bertscore_f1:区域均值 0.7070;字段-图像均值 0.7108;已评 3788,缺失 0
188
+
189
+ 算法指标(笔法+字法全部局部字段合计):
190
+ rouge_l_f1:区域均值 0.4133;已评 9164,缺失 0
191
+ bertscore_precision:区域均值 0.7660;已评 9164,缺失 0
192
+ bertscore_recall:区域均值 0.7594;已评 9164,缺失 0
193
+ bertscore_f1:区域均值 0.7623;已评 9164,缺失 0
194
+ ========== 整体评论(所有阈值共享) ==========
195
+ overall_comment:2.6307/5;已评 2188,无参考跳过 0,未评 0
196
+ rouge_l_f1:均值 0.2560;已评 2188,缺失 0
197
+ bertscore_precision:均值 0.7496;已评 2188,缺失 0
198
+ bertscore_recall:均值 0.7402;已评 2188,缺失 0
199
+ bertscore_f1:均值 0.7448;已评 2188,缺失 0
sft/qwen3vl_sft_v16/evaluate_best/evaluation_detail.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2f3700822364215221f62571c6fe7c3a9287f098af290db9152d60c74909c0b
3
+ size 42794126
sft/qwen3vl_sft_v16/evaluate_best/evaluation_summary.json ADDED
@@ -0,0 +1,1104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "sample_count": 2188,
3
+ "requested_samples": 2188,
4
+ "interrupted": false,
5
+ "fatal_api_error": null,
6
+ "status_counts": {
7
+ "ok": 2188
8
+ },
9
+ "thresholds": {
10
+ "0.3": {
11
+ "bifa": {
12
+ "reference_count": 4588,
13
+ "hit_count": 2654,
14
+ "invalid_reference_bbox_count": 0,
15
+ "recall_micro": 0.5784655623365301,
16
+ "recall_image_macro": 0.6214461245266932,
17
+ "matched_iou_mean": 0.7935415741517535,
18
+ "qualification_rule": "all_required_fields",
19
+ "qualification_minimum_score": 4,
20
+ "qualified_analysis_count": 171,
21
+ "unqualified_hit_count": 2483,
22
+ "unscored_hit_count": 0,
23
+ "joint_success_rate": 0.03727114210985179,
24
+ "qualified_analysis_rate_on_bbox_hits": 0.06443104747550867,
25
+ "scores": {
26
+ "visual_evidence": {
27
+ "image_macro_mean": 2.9318743667679836,
28
+ "region_micro_mean": 2.9461190655614167,
29
+ "scored_regions": 2654,
30
+ "expected_matched_regions": 2654,
31
+ "missing_judge_scores": 0,
32
+ "skipped_missing_reference": 0,
33
+ "images_fully_scored": 1645,
34
+ "algorithm_metrics": {
35
+ "rouge_l_f1": {
36
+ "image_macro_mean": 0.3725120764604666,
37
+ "region_micro_mean": 0.3731893506926202,
38
+ "scored_regions": 2654,
39
+ "missing_scores": 0
40
+ },
41
+ "bertscore_precision": {
42
+ "image_macro_mean": 0.7760778162840531,
43
+ "region_micro_mean": 0.7760641787990018,
44
+ "scored_regions": 2654,
45
+ "missing_scores": 0
46
+ },
47
+ "bertscore_recall": {
48
+ "image_macro_mean": 0.7681581148707517,
49
+ "region_micro_mean": 0.7685323971146107,
50
+ "scored_regions": 2654,
51
+ "missing_scores": 0
52
+ },
53
+ "bertscore_f1": {
54
+ "image_macro_mean": 0.7718616823367435,
55
+ "region_micro_mean": 0.7720426083419587,
56
+ "scored_regions": 2654,
57
+ "missing_scores": 0
58
+ }
59
+ }
60
+ },
61
+ "technique": {
62
+ "image_macro_mean": 1.8738905775075987,
63
+ "region_micro_mean": 1.878673700075358,
64
+ "scored_regions": 2654,
65
+ "expected_matched_regions": 2654,
66
+ "missing_judge_scores": 0,
67
+ "skipped_missing_reference": 0,
68
+ "images_fully_scored": 1645,
69
+ "algorithm_metrics": {
70
+ "rouge_l_f1": {
71
+ "image_macro_mean": 0.7325599811995942,
72
+ "region_micro_mean": 0.7300501773647778,
73
+ "scored_regions": 2654,
74
+ "missing_scores": 0
75
+ },
76
+ "bertscore_precision": {
77
+ "image_macro_mean": 0.8535645349687597,
78
+ "region_micro_mean": 0.8524965175175541,
79
+ "scored_regions": 2654,
80
+ "missing_scores": 0
81
+ },
82
+ "bertscore_recall": {
83
+ "image_macro_mean": 0.8417483321873975,
84
+ "region_micro_mean": 0.8407375978498236,
85
+ "scored_regions": 2654,
86
+ "missing_scores": 0
87
+ },
88
+ "bertscore_f1": {
89
+ "image_macro_mean": 0.8471352425329349,
90
+ "region_micro_mean": 0.8461078749443233,
91
+ "scored_regions": 2654,
92
+ "missing_scores": 0
93
+ }
94
+ }
95
+ },
96
+ "technical_explanation": {
97
+ "image_macro_mean": 2.620293819655522,
98
+ "region_micro_mean": 2.608892238131123,
99
+ "scored_regions": 2654,
100
+ "expected_matched_regions": 2654,
101
+ "missing_judge_scores": 0,
102
+ "skipped_missing_reference": 0,
103
+ "images_fully_scored": 1645,
104
+ "algorithm_metrics": {
105
+ "rouge_l_f1": {
106
+ "image_macro_mean": 0.34337751722199517,
107
+ "region_micro_mean": 0.3425555574793207,
108
+ "scored_regions": 2654,
109
+ "missing_scores": 0
110
+ },
111
+ "bertscore_precision": {
112
+ "image_macro_mean": 0.7675970028133982,
113
+ "region_micro_mean": 0.7665316658354201,
114
+ "scored_regions": 2654,
115
+ "missing_scores": 0
116
+ },
117
+ "bertscore_recall": {
118
+ "image_macro_mean": 0.7578923038104143,
119
+ "region_micro_mean": 0.7573875704023653,
120
+ "scored_regions": 2654,
121
+ "missing_scores": 0
122
+ },
123
+ "bertscore_f1": {
124
+ "image_macro_mean": 0.7624980238777526,
125
+ "region_micro_mean": 0.7617207967255829,
126
+ "scored_regions": 2654,
127
+ "missing_scores": 0
128
+ }
129
+ }
130
+ }
131
+ },
132
+ "algorithm_metrics_total": {
133
+ "rouge_l_f1": {
134
+ "region_micro_mean": 0.48193169517890627,
135
+ "image_field_macro_mean": 0.48281652496068533,
136
+ "scored_regions": 7962,
137
+ "missing_scores": 0
138
+ },
139
+ "bertscore_precision": {
140
+ "region_micro_mean": 0.7983641207173253,
141
+ "image_field_macro_mean": 0.799079784688737,
142
+ "scored_regions": 7962,
143
+ "missing_scores": 0
144
+ },
145
+ "bertscore_recall": {
146
+ "region_micro_mean": 0.7888858551222665,
147
+ "image_field_macro_mean": 0.7892662502895211,
148
+ "scored_regions": 7962,
149
+ "missing_scores": 0
150
+ },
151
+ "bertscore_f1": {
152
+ "region_micro_mean": 0.7932904266706217,
153
+ "image_field_macro_mean": 0.793831649582477,
154
+ "scored_regions": 7962,
155
+ "missing_scores": 0
156
+ }
157
+ }
158
+ },
159
+ "zifa": {
160
+ "reference_count": 4540,
161
+ "hit_count": 1744,
162
+ "invalid_reference_bbox_count": 0,
163
+ "recall_micro": 0.3841409691629956,
164
+ "recall_image_macro": 0.39217099120349896,
165
+ "matched_iou_mean": 0.7412734126837894,
166
+ "qualification_rule": "all_required_fields",
167
+ "qualification_minimum_score": 4,
168
+ "qualified_analysis_count": 73,
169
+ "unqualified_hit_count": 1671,
170
+ "unscored_hit_count": 0,
171
+ "joint_success_rate": 0.016079295154185023,
172
+ "qualified_analysis_rate_on_bbox_hits": 0.041857798165137614,
173
+ "scores": {
174
+ "evidence": {
175
+ "image_macro_mean": 2.0405645226049947,
176
+ "region_micro_mean": 2.00802752293578,
177
+ "scored_regions": 1744,
178
+ "expected_matched_regions": 1744,
179
+ "missing_judge_scores": 0,
180
+ "skipped_missing_reference": 0,
181
+ "images_fully_scored": 1186,
182
+ "algorithm_metrics": {
183
+ "rouge_l_f1": {
184
+ "image_macro_mean": 0.29623887575757424,
185
+ "region_micro_mean": 0.2901867053749936,
186
+ "scored_regions": 1744,
187
+ "missing_scores": 0
188
+ },
189
+ "bertscore_precision": {
190
+ "image_macro_mean": 0.734926085052151,
191
+ "region_micro_mean": 0.7322318013928352,
192
+ "scored_regions": 1744,
193
+ "missing_scores": 0
194
+ },
195
+ "bertscore_recall": {
196
+ "image_macro_mean": 0.7301647277493118,
197
+ "region_micro_mean": 0.7270277670558987,
198
+ "scored_regions": 1744,
199
+ "missing_scores": 0
200
+ },
201
+ "bertscore_f1": {
202
+ "image_macro_mean": 0.7322036588200601,
203
+ "region_micro_mean": 0.7292943135450739,
204
+ "scored_regions": 1744,
205
+ "missing_scores": 0
206
+ }
207
+ }
208
+ },
209
+ "description": {
210
+ "image_macro_mean": 2.006622902111941,
211
+ "region_micro_mean": 1.9684633027522935,
212
+ "scored_regions": 1744,
213
+ "expected_matched_regions": 1744,
214
+ "missing_judge_scores": 0,
215
+ "skipped_missing_reference": 0,
216
+ "images_fully_scored": 1186,
217
+ "algorithm_metrics": {
218
+ "rouge_l_f1": {
219
+ "image_macro_mean": 0.3026969958683862,
220
+ "region_micro_mean": 0.2931688849888574,
221
+ "scored_regions": 1744,
222
+ "missing_scores": 0
223
+ },
224
+ "bertscore_precision": {
225
+ "image_macro_mean": 0.7129590764197826,
226
+ "region_micro_mean": 0.7071621390315918,
227
+ "scored_regions": 1744,
228
+ "missing_scores": 0
229
+ },
230
+ "bertscore_recall": {
231
+ "image_macro_mean": 0.7129324903988239,
232
+ "region_micro_mean": 0.7066000620022826,
233
+ "scored_regions": 1744,
234
+ "missing_scores": 0
235
+ },
236
+ "bertscore_f1": {
237
+ "image_macro_mean": 0.7121614018409528,
238
+ "region_micro_mean": 0.7061049249535853,
239
+ "scored_regions": 1744,
240
+ "missing_scores": 0
241
+ }
242
+ }
243
+ },
244
+ "feature": {
245
+ "image_macro_mean": 1.676724484060066,
246
+ "region_micro_mean": 1.676605504587156,
247
+ "scored_regions": 1744,
248
+ "expected_matched_regions": 1744,
249
+ "missing_judge_scores": 0,
250
+ "skipped_missing_reference": 0,
251
+ "images_fully_scored": 1186,
252
+ "algorithm_metrics": {
253
+ "rouge_l_f1": {
254
+ "image_macro_mean": 0.16816180908588,
255
+ "region_micro_mean": 0.17022153494445436,
256
+ "scored_regions": 1744,
257
+ "missing_scores": 0
258
+ },
259
+ "bertscore_precision": {
260
+ "image_macro_mean": 0.6341161635437423,
261
+ "region_micro_mean": 0.6336793304002339,
262
+ "scored_regions": 1744,
263
+ "missing_scores": 0
264
+ },
265
+ "bertscore_recall": {
266
+ "image_macro_mean": 0.6268627810177148,
267
+ "region_micro_mean": 0.6240429911215645,
268
+ "scored_regions": 1744,
269
+ "missing_scores": 0
270
+ },
271
+ "bertscore_f1": {
272
+ "image_macro_mean": 0.6297580548151903,
273
+ "region_micro_mean": 0.6280210387440176,
274
+ "scored_regions": 1744,
275
+ "missing_scores": 0
276
+ }
277
+ }
278
+ },
279
+ "effect": {
280
+ "image_macro_mean": 2.190939934152413,
281
+ "region_micro_mean": 2.1525229357798166,
282
+ "scored_regions": 1744,
283
+ "expected_matched_regions": 1744,
284
+ "missing_judge_scores": 0,
285
+ "skipped_missing_reference": 0,
286
+ "images_fully_scored": 1186,
287
+ "algorithm_metrics": {
288
+ "rouge_l_f1": {
289
+ "image_macro_mean": 0.3098365731806947,
290
+ "region_micro_mean": 0.29890201637818076,
291
+ "scored_regions": 1744,
292
+ "missing_scores": 0
293
+ },
294
+ "bertscore_precision": {
295
+ "image_macro_mean": 0.7320491825921377,
296
+ "region_micro_mean": 0.7254243068602106,
297
+ "scored_regions": 1744,
298
+ "missing_scores": 0
299
+ },
300
+ "bertscore_recall": {
301
+ "image_macro_mean": 0.7310704245901315,
302
+ "region_micro_mean": 0.7249602936208248,
303
+ "scored_regions": 1744,
304
+ "missing_scores": 0
305
+ },
306
+ "bertscore_f1": {
307
+ "image_macro_mean": 0.7310902176449541,
308
+ "region_micro_mean": 0.7247278529706351,
309
+ "scored_regions": 1744,
310
+ "missing_scores": 0
311
+ }
312
+ }
313
+ }
314
+ },
315
+ "algorithm_metrics_total": {
316
+ "rouge_l_f1": {
317
+ "region_micro_mean": 0.2631197854216215,
318
+ "image_field_macro_mean": 0.26923356347313376,
319
+ "scored_regions": 6976,
320
+ "missing_scores": 0
321
+ },
322
+ "bertscore_precision": {
323
+ "region_micro_mean": 0.6996243944212179,
324
+ "image_field_macro_mean": 0.7035126269019534,
325
+ "scored_regions": 6976,
326
+ "missing_scores": 0
327
+ },
328
+ "bertscore_recall": {
329
+ "region_micro_mean": 0.6956577784501426,
330
+ "image_field_macro_mean": 0.7002576059389954,
331
+ "scored_regions": 6976,
332
+ "missing_scores": 0
333
+ },
334
+ "bertscore_f1": {
335
+ "region_micro_mean": 0.697037032553328,
336
+ "image_field_macro_mean": 0.7013033332802893,
337
+ "scored_regions": 6976,
338
+ "missing_scores": 0
339
+ }
340
+ }
341
+ },
342
+ "all_local_algorithm_metrics": {
343
+ "rouge_l_f1": {
344
+ "region_micro_mean": 0.37974720713051835,
345
+ "scored_regions": 14938,
346
+ "missing_scores": 0
347
+ },
348
+ "bertscore_precision": {
349
+ "region_micro_mean": 0.752252972595646,
350
+ "scored_regions": 14938,
351
+ "missing_scores": 0
352
+ },
353
+ "bertscore_recall": {
354
+ "region_micro_mean": 0.7453486304024421,
355
+ "scored_regions": 14938,
356
+ "missing_scores": 0
357
+ },
358
+ "bertscore_f1": {
359
+ "region_micro_mean": 0.7483403880200499,
360
+ "scored_regions": 14938,
361
+ "missing_scores": 0
362
+ }
363
+ }
364
+ },
365
+ "0.5": {
366
+ "bifa": {
367
+ "reference_count": 4588,
368
+ "hit_count": 2258,
369
+ "invalid_reference_bbox_count": 0,
370
+ "recall_micro": 0.492153443766347,
371
+ "recall_image_macro": 0.5245452911724634,
372
+ "matched_iou_mean": 0.864130889601103,
373
+ "qualification_rule": "all_required_fields",
374
+ "qualification_minimum_score": 4,
375
+ "qualified_analysis_count": 155,
376
+ "unqualified_hit_count": 2103,
377
+ "unscored_hit_count": 0,
378
+ "joint_success_rate": 0.033783783783783786,
379
+ "qualified_analysis_rate_on_bbox_hits": 0.06864481842338352,
380
+ "scores": {
381
+ "visual_evidence": {
382
+ "image_macro_mean": 3.0623914495657982,
383
+ "region_micro_mean": 3.079273693534101,
384
+ "scored_regions": 2258,
385
+ "expected_matched_regions": 2258,
386
+ "missing_judge_scores": 0,
387
+ "skipped_missing_reference": 0,
388
+ "images_fully_scored": 1497,
389
+ "algorithm_metrics": {
390
+ "rouge_l_f1": {
391
+ "image_macro_mean": 0.3863336621696684,
392
+ "region_micro_mean": 0.3880111414398935,
393
+ "scored_regions": 2258,
394
+ "missing_scores": 0
395
+ },
396
+ "bertscore_precision": {
397
+ "image_macro_mean": 0.7810462667426562,
398
+ "region_micro_mean": 0.7818241487096326,
399
+ "scored_regions": 2258,
400
+ "missing_scores": 0
401
+ },
402
+ "bertscore_recall": {
403
+ "image_macro_mean": 0.7734972113259411,
404
+ "region_micro_mean": 0.7744185215504007,
405
+ "scored_regions": 2258,
406
+ "missing_scores": 0
407
+ },
408
+ "bertscore_f1": {
409
+ "image_macro_mean": 0.7770138133961755,
410
+ "region_micro_mean": 0.7778659320120478,
411
+ "scored_regions": 2258,
412
+ "missing_scores": 0
413
+ }
414
+ }
415
+ },
416
+ "technique": {
417
+ "image_macro_mean": 1.9438877755511021,
418
+ "region_micro_mean": 1.9410983170947742,
419
+ "scored_regions": 2258,
420
+ "expected_matched_regions": 2258,
421
+ "missing_judge_scores": 0,
422
+ "skipped_missing_reference": 0,
423
+ "images_fully_scored": 1497,
424
+ "algorithm_metrics": {
425
+ "rouge_l_f1": {
426
+ "image_macro_mean": 0.7384101763752221,
427
+ "region_micro_mean": 0.7366651428035073,
428
+ "scored_regions": 2258,
429
+ "missing_scores": 0
430
+ },
431
+ "bertscore_precision": {
432
+ "image_macro_mean": 0.8563289310759092,
433
+ "region_micro_mean": 0.8553766584744804,
434
+ "scored_regions": 2258,
435
+ "missing_scores": 0
436
+ },
437
+ "bertscore_recall": {
438
+ "image_macro_mean": 0.8449640559011408,
439
+ "region_micro_mean": 0.8442781144692055,
440
+ "scored_regions": 2258,
441
+ "missing_scores": 0
442
+ },
443
+ "bertscore_f1": {
444
+ "image_macro_mean": 0.8501584576136337,
445
+ "region_micro_mean": 0.8493554892795502,
446
+ "scored_regions": 2258,
447
+ "missing_scores": 0
448
+ }
449
+ }
450
+ },
451
+ "technical_explanation": {
452
+ "image_macro_mean": 2.733656201291472,
453
+ "region_micro_mean": 2.724534986713906,
454
+ "scored_regions": 2258,
455
+ "expected_matched_regions": 2258,
456
+ "missing_judge_scores": 0,
457
+ "skipped_missing_reference": 0,
458
+ "images_fully_scored": 1497,
459
+ "algorithm_metrics": {
460
+ "rouge_l_f1": {
461
+ "image_macro_mean": 0.35161893120957355,
462
+ "region_micro_mean": 0.352030968175649,
463
+ "scored_regions": 2258,
464
+ "missing_scores": 0
465
+ },
466
+ "bertscore_precision": {
467
+ "image_macro_mean": 0.7713067007307697,
468
+ "region_micro_mean": 0.7709574499839803,
469
+ "scored_regions": 2258,
470
+ "missing_scores": 0
471
+ },
472
+ "bertscore_recall": {
473
+ "image_macro_mean": 0.7618094214144701,
474
+ "region_micro_mean": 0.7619123883327623,
475
+ "scored_regions": 2258,
476
+ "missing_scores": 0
477
+ },
478
+ "bertscore_f1": {
479
+ "image_macro_mean": 0.7663158152502115,
480
+ "region_micro_mean": 0.7661986493293536,
481
+ "scored_regions": 2258,
482
+ "missing_scores": 0
483
+ }
484
+ }
485
+ }
486
+ },
487
+ "algorithm_metrics_total": {
488
+ "rouge_l_f1": {
489
+ "region_micro_mean": 0.4922357508063499,
490
+ "image_field_macro_mean": 0.492120923251488,
491
+ "scored_regions": 6774,
492
+ "missing_scores": 0
493
+ },
494
+ "bertscore_precision": {
495
+ "region_micro_mean": 0.8027194190560311,
496
+ "image_field_macro_mean": 0.8028939661831117,
497
+ "scored_regions": 6774,
498
+ "missing_scores": 0
499
+ },
500
+ "bertscore_recall": {
501
+ "region_micro_mean": 0.7935363414507894,
502
+ "image_field_macro_mean": 0.7934235628805173,
503
+ "scored_regions": 6774,
504
+ "missing_scores": 0
505
+ },
506
+ "bertscore_f1": {
507
+ "region_micro_mean": 0.7978066902069838,
508
+ "image_field_macro_mean": 0.7978293620866735,
509
+ "scored_regions": 6774,
510
+ "missing_scores": 0
511
+ }
512
+ }
513
+ },
514
+ "zifa": {
515
+ "reference_count": 4540,
516
+ "hit_count": 1308,
517
+ "invalid_reference_bbox_count": 0,
518
+ "recall_micro": 0.28810572687224667,
519
+ "recall_image_macro": 0.2794142218290825,
520
+ "matched_iou_mean": 0.8584477172295785,
521
+ "qualification_rule": "all_required_fields",
522
+ "qualification_minimum_score": 4,
523
+ "qualified_analysis_count": 71,
524
+ "unqualified_hit_count": 1237,
525
+ "unscored_hit_count": 0,
526
+ "joint_success_rate": 0.01563876651982379,
527
+ "qualified_analysis_rate_on_bbox_hits": 0.054281345565749234,
528
+ "scores": {
529
+ "evidence": {
530
+ "image_macro_mean": 2.1610749185667752,
531
+ "region_micro_mean": 2.1276758409785934,
532
+ "scored_regions": 1308,
533
+ "expected_matched_regions": 1308,
534
+ "missing_judge_scores": 0,
535
+ "skipped_missing_reference": 0,
536
+ "images_fully_scored": 921,
537
+ "algorithm_metrics": {
538
+ "rouge_l_f1": {
539
+ "image_macro_mean": 0.30759163346691576,
540
+ "region_micro_mean": 0.30090035347832783,
541
+ "scored_regions": 1308,
542
+ "missing_scores": 0
543
+ },
544
+ "bertscore_precision": {
545
+ "image_macro_mean": 0.7390089772768397,
546
+ "region_micro_mean": 0.7362448273266492,
547
+ "scored_regions": 1308,
548
+ "missing_scores": 0
549
+ },
550
+ "bertscore_recall": {
551
+ "image_macro_mean": 0.7335943409952616,
552
+ "region_micro_mean": 0.730904542342603,
553
+ "scored_regions": 1308,
554
+ "missing_scores": 0
555
+ },
556
+ "bertscore_f1": {
557
+ "image_macro_mean": 0.7359485218436917,
558
+ "region_micro_mean": 0.7332284442328532,
559
+ "scored_regions": 1308,
560
+ "missing_scores": 0
561
+ }
562
+ }
563
+ },
564
+ "description": {
565
+ "image_macro_mean": 2.1852334419109662,
566
+ "region_micro_mean": 2.1345565749235473,
567
+ "scored_regions": 1308,
568
+ "expected_matched_regions": 1308,
569
+ "missing_judge_scores": 0,
570
+ "skipped_missing_reference": 0,
571
+ "images_fully_scored": 921,
572
+ "algorithm_metrics": {
573
+ "rouge_l_f1": {
574
+ "image_macro_mean": 0.3151170021741892,
575
+ "region_micro_mean": 0.30530292934040537,
576
+ "scored_regions": 1308,
577
+ "missing_scores": 0
578
+ },
579
+ "bertscore_precision": {
580
+ "image_macro_mean": 0.7170926653094107,
581
+ "region_micro_mean": 0.7111795409283507,
582
+ "scored_regions": 1308,
583
+ "missing_scores": 0
584
+ },
585
+ "bertscore_recall": {
586
+ "image_macro_mean": 0.7176752599585199,
587
+ "region_micro_mean": 0.7111792842364821,
588
+ "scored_regions": 1308,
589
+ "missing_scores": 0
590
+ },
591
+ "bertscore_f1": {
592
+ "image_macro_mean": 0.7165799285692017,
593
+ "region_micro_mean": 0.7103813979148136,
594
+ "scored_regions": 1308,
595
+ "missing_scores": 0
596
+ }
597
+ }
598
+ },
599
+ "feature": {
600
+ "image_macro_mean": 1.7806369887803113,
601
+ "region_micro_mean": 1.7844036697247707,
602
+ "scored_regions": 1308,
603
+ "expected_matched_regions": 1308,
604
+ "missing_judge_scores": 0,
605
+ "skipped_missing_reference": 0,
606
+ "images_fully_scored": 921,
607
+ "algorithm_metrics": {
608
+ "rouge_l_f1": {
609
+ "image_macro_mean": 0.19277976467101576,
610
+ "region_micro_mean": 0.19765773910968032,
611
+ "scored_regions": 1308,
612
+ "missing_scores": 0
613
+ },
614
+ "bertscore_precision": {
615
+ "image_macro_mean": 0.6442463459730838,
616
+ "region_micro_mean": 0.645606781227873,
617
+ "scored_regions": 1308,
618
+ "missing_scores": 0
619
+ },
620
+ "bertscore_recall": {
621
+ "image_macro_mean": 0.6362332174522782,
622
+ "region_micro_mean": 0.6352985255898685,
623
+ "scored_regions": 1308,
624
+ "missing_scores": 0
625
+ },
626
+ "bertscore_f1": {
627
+ "image_macro_mean": 0.6394920476134213,
628
+ "region_micro_mean": 0.6396321585054426,
629
+ "scored_regions": 1308,
630
+ "missing_scores": 0
631
+ }
632
+ }
633
+ },
634
+ "effect": {
635
+ "image_macro_mean": 2.2443720593557726,
636
+ "region_micro_mean": 2.21177370030581,
637
+ "scored_regions": 1308,
638
+ "expected_matched_regions": 1308,
639
+ "missing_judge_scores": 0,
640
+ "skipped_missing_reference": 0,
641
+ "images_fully_scored": 921,
642
+ "algorithm_metrics": {
643
+ "rouge_l_f1": {
644
+ "image_macro_mean": 0.321965535166559,
645
+ "region_micro_mean": 0.31016338381082353,
646
+ "scored_regions": 1308,
647
+ "missing_scores": 0
648
+ },
649
+ "bertscore_precision": {
650
+ "image_macro_mean": 0.7361230188398917,
651
+ "region_micro_mean": 0.7288275216606415,
652
+ "scored_regions": 1308,
653
+ "missing_scores": 0
654
+ },
655
+ "bertscore_recall": {
656
+ "image_macro_mean": 0.7353959210910014,
657
+ "region_micro_mean": 0.7289652873161007,
658
+ "scored_regions": 1308,
659
+ "missing_scores": 0
660
+ },
661
+ "bertscore_f1": {
662
+ "image_macro_mean": 0.7352789311662689,
663
+ "region_micro_mean": 0.7284170144468273,
664
+ "scored_regions": 1308,
665
+ "missing_scores": 0
666
+ }
667
+ }
668
+ }
669
+ },
670
+ "algorithm_metrics_total": {
671
+ "rouge_l_f1": {
672
+ "region_micro_mean": 0.27850610143480925,
673
+ "image_field_macro_mean": 0.2843634838696699,
674
+ "scored_regions": 5232,
675
+ "missing_scores": 0
676
+ },
677
+ "bertscore_precision": {
678
+ "region_micro_mean": 0.7054646677858786,
679
+ "image_field_macro_mean": 0.7091177518498065,
680
+ "scored_regions": 5232,
681
+ "missing_scores": 0
682
+ },
683
+ "bertscore_recall": {
684
+ "region_micro_mean": 0.7015869098712636,
685
+ "image_field_macro_mean": 0.7057246848742652,
686
+ "scored_regions": 5232,
687
+ "missing_scores": 0
688
+ },
689
+ "bertscore_f1": {
690
+ "region_micro_mean": 0.7029147537749841,
691
+ "image_field_macro_mean": 0.7068248572981459,
692
+ "scored_regions": 5232,
693
+ "missing_scores": 0
694
+ }
695
+ }
696
+ },
697
+ "all_local_algorithm_metrics": {
698
+ "rouge_l_f1": {
699
+ "region_micro_mean": 0.39909619345903186,
700
+ "scored_regions": 12006,
701
+ "missing_scores": 0
702
+ },
703
+ "bertscore_precision": {
704
+ "region_micro_mean": 0.7603375384425514,
705
+ "scored_regions": 12006,
706
+ "missing_scores": 0
707
+ },
708
+ "bertscore_recall": {
709
+ "region_micro_mean": 0.7534664242407212,
710
+ "scored_regions": 12006,
711
+ "missing_scores": 0
712
+ },
713
+ "bertscore_f1": {
714
+ "region_micro_mean": 0.7564544820267222,
715
+ "scored_regions": 12006,
716
+ "missing_scores": 0
717
+ }
718
+ }
719
+ },
720
+ "0.75": {
721
+ "bifa": {
722
+ "reference_count": 4588,
723
+ "hit_count": 1792,
724
+ "invalid_reference_bbox_count": 0,
725
+ "recall_micro": 0.3905841325196164,
726
+ "recall_image_macro": 0.41366675861146635,
727
+ "matched_iou_mean": 0.9262921472871408,
728
+ "qualification_rule": "all_required_fields",
729
+ "qualification_minimum_score": 4,
730
+ "qualified_analysis_count": 129,
731
+ "unqualified_hit_count": 1663,
732
+ "unscored_hit_count": 0,
733
+ "joint_success_rate": 0.02811682650392328,
734
+ "qualified_analysis_rate_on_bbox_hits": 0.07198660714285714,
735
+ "scores": {
736
+ "visual_evidence": {
737
+ "image_macro_mean": 3.155581947743468,
738
+ "region_micro_mean": 3.1640625,
739
+ "scored_regions": 1792,
740
+ "expected_matched_regions": 1792,
741
+ "missing_judge_scores": 0,
742
+ "skipped_missing_reference": 0,
743
+ "images_fully_scored": 1263,
744
+ "algorithm_metrics": {
745
+ "rouge_l_f1": {
746
+ "image_macro_mean": 0.3974311548653963,
747
+ "region_micro_mean": 0.39896029492871465,
748
+ "scored_regions": 1792,
749
+ "missing_scores": 0
750
+ },
751
+ "bertscore_precision": {
752
+ "image_macro_mean": 0.7855282986610853,
753
+ "region_micro_mean": 0.7863037964728262,
754
+ "scored_regions": 1792,
755
+ "missing_scores": 0
756
+ },
757
+ "bertscore_recall": {
758
+ "image_macro_mean": 0.7783337423435834,
759
+ "region_micro_mean": 0.7790889839774796,
760
+ "scored_regions": 1792,
761
+ "missing_scores": 0
762
+ },
763
+ "bertscore_f1": {
764
+ "image_macro_mean": 0.7816691656647838,
765
+ "region_micro_mean": 0.7824349034843701,
766
+ "scored_regions": 1792,
767
+ "missing_scores": 0
768
+ }
769
+ }
770
+ },
771
+ "technique": {
772
+ "image_macro_mean": 1.9697149643705463,
773
+ "region_micro_mean": 1.9765625,
774
+ "scored_regions": 1792,
775
+ "expected_matched_regions": 1792,
776
+ "missing_judge_scores": 0,
777
+ "skipped_missing_reference": 0,
778
+ "images_fully_scored": 1263,
779
+ "algorithm_metrics": {
780
+ "rouge_l_f1": {
781
+ "image_macro_mean": 0.7420370238052878,
782
+ "region_micro_mean": 0.7412512023920593,
783
+ "scored_regions": 1792,
784
+ "missing_scores": 0
785
+ },
786
+ "bertscore_precision": {
787
+ "image_macro_mean": 0.8583050123908709,
788
+ "region_micro_mean": 0.8579554842186293,
789
+ "scored_regions": 1792,
790
+ "missing_scores": 0
791
+ },
792
+ "bertscore_recall": {
793
+ "image_macro_mean": 0.8470756439160281,
794
+ "region_micro_mean": 0.846960384598268,
795
+ "scored_regions": 1792,
796
+ "missing_scores": 0
797
+ },
798
+ "bertscore_f1": {
799
+ "image_macro_mean": 0.8522080704668135,
800
+ "region_micro_mean": 0.8520068100520543,
801
+ "scored_regions": 1792,
802
+ "missing_scores": 0
803
+ }
804
+ }
805
+ },
806
+ "technical_explanation": {
807
+ "image_macro_mean": 2.795526524148852,
808
+ "region_micro_mean": 2.7896205357142856,
809
+ "scored_regions": 1792,
810
+ "expected_matched_regions": 1792,
811
+ "missing_judge_scores": 0,
812
+ "skipped_missing_reference": 0,
813
+ "images_fully_scored": 1263,
814
+ "algorithm_metrics": {
815
+ "rouge_l_f1": {
816
+ "image_macro_mean": 0.35820826034425424,
817
+ "region_micro_mean": 0.35907138061508687,
818
+ "scored_regions": 1792,
819
+ "missing_scores": 0
820
+ },
821
+ "bertscore_precision": {
822
+ "image_macro_mean": 0.7739742027522392,
823
+ "region_micro_mean": 0.7741338476937797,
824
+ "scored_regions": 1792,
825
+ "missing_scores": 0
826
+ },
827
+ "bertscore_recall": {
828
+ "image_macro_mean": 0.7645089854254009,
829
+ "region_micro_mean": 0.7648152741936168,
830
+ "scored_regions": 1792,
831
+ "missing_scores": 0
832
+ },
833
+ "bertscore_f1": {
834
+ "image_macro_mean": 0.7689965291808545,
835
+ "region_micro_mean": 0.7692332061872419,
836
+ "scored_regions": 1792,
837
+ "missing_scores": 0
838
+ }
839
+ }
840
+ }
841
+ },
842
+ "algorithm_metrics_total": {
843
+ "rouge_l_f1": {
844
+ "region_micro_mean": 0.4997609593119536,
845
+ "image_field_macro_mean": 0.49922547967164616,
846
+ "scored_regions": 5376,
847
+ "missing_scores": 0
848
+ },
849
+ "bertscore_precision": {
850
+ "region_micro_mean": 0.8061310427950784,
851
+ "image_field_macro_mean": 0.8059358379347318,
852
+ "scored_regions": 5376,
853
+ "missing_scores": 0
854
+ },
855
+ "bertscore_recall": {
856
+ "region_micro_mean": 0.7969548809231215,
857
+ "image_field_macro_mean": 0.7966394572283375,
858
+ "scored_regions": 5376,
859
+ "missing_scores": 0
860
+ },
861
+ "bertscore_f1": {
862
+ "region_micro_mean": 0.801224973241222,
863
+ "image_field_macro_mean": 0.8009579217708173,
864
+ "scored_regions": 5376,
865
+ "missing_scores": 0
866
+ }
867
+ }
868
+ },
869
+ "zifa": {
870
+ "reference_count": 4540,
871
+ "hit_count": 947,
872
+ "invalid_reference_bbox_count": 0,
873
+ "recall_micro": 0.20859030837004405,
874
+ "recall_image_macro": 0.1935482087571871,
875
+ "matched_iou_mean": 0.9533419784565391,
876
+ "qualification_rule": "all_required_fields",
877
+ "qualification_minimum_score": 4,
878
+ "qualified_analysis_count": 56,
879
+ "unqualified_hit_count": 891,
880
+ "unscored_hit_count": 0,
881
+ "joint_success_rate": 0.012334801762114538,
882
+ "qualified_analysis_rate_on_bbox_hits": 0.059134107708553325,
883
+ "scores": {
884
+ "evidence": {
885
+ "image_macro_mean": 2.2221656976744186,
886
+ "region_micro_mean": 2.191129883843717,
887
+ "scored_regions": 947,
888
+ "expected_matched_regions": 947,
889
+ "missing_judge_scores": 0,
890
+ "skipped_missing_reference": 0,
891
+ "images_fully_scored": 688,
892
+ "algorithm_metrics": {
893
+ "rouge_l_f1": {
894
+ "image_macro_mean": 0.31018773878589295,
895
+ "region_micro_mean": 0.30323513280267383,
896
+ "scored_regions": 947,
897
+ "missing_scores": 0
898
+ },
899
+ "bertscore_precision": {
900
+ "image_macro_mean": 0.7404016569343417,
901
+ "region_micro_mean": 0.7371892366389161,
902
+ "scored_regions": 947,
903
+ "missing_scores": 0
904
+ },
905
+ "bertscore_recall": {
906
+ "image_macro_mean": 0.7353881237985089,
907
+ "region_micro_mean": 0.7321180295919038,
908
+ "scored_regions": 947,
909
+ "missing_scores": 0
910
+ },
911
+ "bertscore_f1": {
912
+ "image_macro_mean": 0.7375341200219222,
913
+ "region_micro_mean": 0.734297681572319,
914
+ "scored_regions": 947,
915
+ "missing_scores": 0
916
+ }
917
+ }
918
+ },
919
+ "description": {
920
+ "image_macro_mean": 2.2724806201550387,
921
+ "region_micro_mean": 2.2302006335797255,
922
+ "scored_regions": 947,
923
+ "expected_matched_regions": 947,
924
+ "missing_judge_scores": 0,
925
+ "skipped_missing_reference": 0,
926
+ "images_fully_scored": 688,
927
+ "algorithm_metrics": {
928
+ "rouge_l_f1": {
929
+ "image_macro_mean": 0.3222569561488327,
930
+ "region_micro_mean": 0.31222276249229064,
931
+ "scored_regions": 947,
932
+ "missing_scores": 0
933
+ },
934
+ "bertscore_precision": {
935
+ "image_macro_mean": 0.716869497547547,
936
+ "region_micro_mean": 0.7110878173753603,
937
+ "scored_regions": 947,
938
+ "missing_scores": 0
939
+ },
940
+ "bertscore_recall": {
941
+ "image_macro_mean": 0.7195136857168504,
942
+ "region_micro_mean": 0.7134514459838586,
943
+ "scored_regions": 947,
944
+ "missing_scores": 0
945
+ },
946
+ "bertscore_f1": {
947
+ "image_macro_mean": 0.7173433374209228,
948
+ "region_micro_mean": 0.7114299443858226,
949
+ "scored_regions": 947,
950
+ "missing_scores": 0
951
+ }
952
+ }
953
+ },
954
+ "feature": {
955
+ "image_macro_mean": 1.8681928294573644,
956
+ "region_micro_mean": 1.8521647307286166,
957
+ "scored_regions": 947,
958
+ "expected_matched_regions": 947,
959
+ "missing_judge_scores": 0,
960
+ "skipped_missing_reference": 0,
961
+ "images_fully_scored": 688,
962
+ "algorithm_metrics": {
963
+ "rouge_l_f1": {
964
+ "image_macro_mean": 0.2271657960066351,
965
+ "region_micro_mean": 0.22976620104996187,
966
+ "scored_regions": 947,
967
+ "missing_scores": 0
968
+ },
969
+ "bertscore_precision": {
970
+ "image_macro_mean": 0.6580212855971483,
971
+ "region_micro_mean": 0.6589827502919351,
972
+ "scored_regions": 947,
973
+ "missing_scores": 0
974
+ },
975
+ "bertscore_recall": {
976
+ "image_macro_mean": 0.6490962161357666,
977
+ "region_micro_mean": 0.6484705218858426,
978
+ "scored_regions": 947,
979
+ "missing_scores": 0
980
+ },
981
+ "bertscore_f1": {
982
+ "image_macro_mean": 0.6527882136195147,
983
+ "region_micro_mean": 0.6529264535042905,
984
+ "scored_regions": 947,
985
+ "missing_scores": 0
986
+ }
987
+ }
988
+ },
989
+ "effect": {
990
+ "image_macro_mean": 2.303536821705426,
991
+ "region_micro_mean": 2.26610348468849,
992
+ "scored_regions": 947,
993
+ "expected_matched_regions": 947,
994
+ "missing_judge_scores": 0,
995
+ "skipped_missing_reference": 0,
996
+ "images_fully_scored": 688,
997
+ "algorithm_metrics": {
998
+ "rouge_l_f1": {
999
+ "image_macro_mean": 0.3280038491119573,
1000
+ "region_micro_mean": 0.31697303674441857,
1001
+ "scored_regions": 947,
1002
+ "missing_scores": 0
1003
+ },
1004
+ "bertscore_precision": {
1005
+ "image_macro_mean": 0.7355784818429009,
1006
+ "region_micro_mean": 0.728703529618232,
1007
+ "scored_regions": 947,
1008
+ "missing_scores": 0
1009
+ },
1010
+ "bertscore_recall": {
1011
+ "image_macro_mean": 0.7367019057158352,
1012
+ "region_micro_mean": 0.7307755475059357,
1013
+ "scored_regions": 947,
1014
+ "missing_scores": 0
1015
+ },
1016
+ "bertscore_f1": {
1017
+ "image_macro_mean": 0.7356033870372777,
1018
+ "region_micro_mean": 0.7292097506074996,
1019
+ "scored_regions": 947,
1020
+ "missing_scores": 0
1021
+ }
1022
+ }
1023
+ }
1024
+ },
1025
+ "algorithm_metrics_total": {
1026
+ "rouge_l_f1": {
1027
+ "region_micro_mean": 0.29054928327233626,
1028
+ "image_field_macro_mean": 0.29690358501332953,
1029
+ "scored_regions": 3788,
1030
+ "missing_scores": 0
1031
+ },
1032
+ "bertscore_precision": {
1033
+ "region_micro_mean": 0.7089908334811109,
1034
+ "image_field_macro_mean": 0.7127177304804845,
1035
+ "scored_regions": 3788,
1036
+ "missing_scores": 0
1037
+ },
1038
+ "bertscore_recall": {
1039
+ "region_micro_mean": 0.7062038862418851,
1040
+ "image_field_macro_mean": 0.7101749828417403,
1041
+ "scored_regions": 3788,
1042
+ "missing_scores": 0
1043
+ },
1044
+ "bertscore_f1": {
1045
+ "region_micro_mean": 0.7069659575174829,
1046
+ "image_field_macro_mean": 0.7108172645249093,
1047
+ "scored_regions": 3788,
1048
+ "missing_scores": 0
1049
+ }
1050
+ }
1051
+ },
1052
+ "all_local_algorithm_metrics": {
1053
+ "rouge_l_f1": {
1054
+ "region_micro_mean": 0.4132819295391393,
1055
+ "scored_regions": 9164,
1056
+ "missing_scores": 0
1057
+ },
1058
+ "bertscore_precision": {
1059
+ "region_micro_mean": 0.7659774949031852,
1060
+ "scored_regions": 9164,
1061
+ "missing_scores": 0
1062
+ },
1063
+ "bertscore_recall": {
1064
+ "region_micro_mean": 0.759442357150476,
1065
+ "scored_regions": 9164,
1066
+ "missing_scores": 0
1067
+ },
1068
+ "bertscore_f1": {
1069
+ "region_micro_mean": 0.7622623857727013,
1070
+ "scored_regions": 9164,
1071
+ "missing_scores": 0
1072
+ }
1073
+ }
1074
+ }
1075
+ },
1076
+ "overall": {
1077
+ "overall_comment_mean": 2.6307129798903106,
1078
+ "scored_images": 2188,
1079
+ "skipped_missing_reference": 0,
1080
+ "unscored_images": 0,
1081
+ "algorithm_metrics": {
1082
+ "rouge_l_f1": {
1083
+ "mean": 0.2559770338133152,
1084
+ "scored_images": 2188,
1085
+ "missing_scores": 0
1086
+ },
1087
+ "bertscore_precision": {
1088
+ "mean": 0.7495749348968649,
1089
+ "scored_images": 2188,
1090
+ "missing_scores": 0
1091
+ },
1092
+ "bertscore_recall": {
1093
+ "mean": 0.7401539133333854,
1094
+ "scored_images": 2188,
1095
+ "missing_scores": 0
1096
+ },
1097
+ "bertscore_f1": {
1098
+ "mean": 0.7447555589828456,
1099
+ "scored_images": 2188,
1100
+ "missing_scores": 0
1101
+ }
1102
+ }
1103
+ }
1104
+ }
sft/qwen3vl_sft_v16/inference_best/.inference.lock ADDED
File without changes
sft/qwen3vl_sft_v16/inference_best/inference_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "/home/jca/models/Qwen3-VL-8B-Instruct",
3
+ "adapters": [
4
+ "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000"
5
+ ],
6
+ "dataset_sha256": "958282611539a7a037955b038d02b55b96c161923ad062b11c500c5988456e2e",
7
+ "max_new_tokens": 3072,
8
+ "temperature": 0.0,
9
+ "top_p": 1.0,
10
+ "dtype": "bfloat16",
11
+ "image_max_token_num": 512,
12
+ "image_min_token_num": 4
13
+ }
sft/qwen3vl_sft_v16/inference_best/inference_summary.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "/home/jca/models/Qwen3-VL-8B-Instruct",
3
+ "adapters": [
4
+ "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000"
5
+ ],
6
+ "dataset": "/home/jca/calligraphy_appreciation/data/sft/test_inference.jsonl",
7
+ "samples": 2188,
8
+ "processed": 2188,
9
+ "resumed_success": 0,
10
+ "new_processed": 2188,
11
+ "success": 2188,
12
+ "statuses": {
13
+ "ok": 2188
14
+ },
15
+ "remaining_or_failed": 0,
16
+ "interrupted": false,
17
+ "fatal_error": null,
18
+ "elapsed_seconds": 6523.841,
19
+ "gpus": [
20
+ "0",
21
+ "1"
22
+ ],
23
+ "workers": 2,
24
+ "batch_size_per_gpu": 10,
25
+ "temperature": 0.0,
26
+ "top_p": 1.0,
27
+ "max_new_tokens": 3072,
28
+ "latency_note": "该样本所在批次的耗时,不应在批内累加"
29
+ }
sft/qwen3vl_sft_v16/inference_best/predictions.json ADDED
The diff for this file is too large to render. See raw diff
 
sft/qwen3vl_sft_v16/inference_best/predictions.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
sft/qwen3vl_sft_v16/inference_best/worker_logs/worker_0.log ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0
  0%| | 0/10 [00:00<?, ?it/s]
 
1
  0%| | 0/10 [00:00<?, ?it/s]
 
2
  0%| | 0/10 [00:00<?, ?it/s]
 
3
  0%| | 0/10 [00:00<?, ?it/s]
 
4
  0%| | 0/10 [00:00<?, ?it/s]
 
5
  0%| | 0/10 [00:00<?, ?it/s]
 
6
  0%| | 0/10 [00:00<?, ?it/s]
 
7
  0%| | 0/10 [00:00<?, ?it/s]
 
8
  0%| | 0/10 [00:00<?, ?it/s]
 
9
  0%| | 0/10 [00:00<?, ?it/s]
 
10
  0%| | 0/10 [00:00<?, ?it/s]
 
11
  0%| | 0/10 [00:00<?, ?it/s]
 
12
  0%| | 0/10 [00:00<?, ?it/s]
 
13
  0%| | 0/10 [00:00<?, ?it/s]
 
14
  0%| | 0/10 [00:00<?, ?it/s]
 
15
  0%| | 0/10 [00:00<?, ?it/s]
 
16
  0%| | 0/10 [00:00<?, ?it/s]
 
17
  0%| | 0/10 [00:00<?, ?it/s]
 
18
  0%| | 0/10 [00:00<?, ?it/s]
 
19
  0%| | 0/10 [00:00<?, ?it/s]
 
20
  0%| | 0/10 [00:00<?, ?it/s]
 
21
  0%| | 0/10 [00:00<?, ?it/s]
 
22
  0%| | 0/10 [00:00<?, ?it/s]
 
23
  0%| | 0/10 [00:00<?, ?it/s]
 
24
  0%| | 0/10 [00:00<?, ?it/s]
 
25
  0%| | 0/10 [00:00<?, ?it/s]
 
26
  0%| | 0/10 [00:00<?, ?it/s]
 
27
  0%| | 0/10 [00:00<?, ?it/s]
 
28
  0%| | 0/10 [00:00<?, ?it/s]
 
29
  0%| | 0/10 [00:00<?, ?it/s]
 
30
  0%| | 0/10 [00:00<?, ?it/s]
 
31
  0%| | 0/10 [00:00<?, ?it/s]
 
32
  0%| | 0/10 [00:00<?, ?it/s]
 
33
  0%| | 0/10 [00:00<?, ?it/s]
 
34
  0%| | 0/10 [00:00<?, ?it/s]
 
35
  0%| | 0/10 [00:00<?, ?it/s]
 
36
  0%| | 0/10 [00:00<?, ?it/s]
 
37
  0%| | 0/10 [00:00<?, ?it/s]
 
38
  0%| | 0/10 [00:00<?, ?it/s]
 
39
  0%| | 0/10 [00:00<?, ?it/s]
 
40
  0%| | 0/10 [00:00<?, ?it/s]
 
41
  0%| | 0/10 [00:00<?, ?it/s]
 
42
  0%| | 0/10 [00:00<?, ?it/s]
 
43
  0%| | 0/10 [00:00<?, ?it/s]
 
44
  0%| | 0/10 [00:00<?, ?it/s]
 
45
  0%| | 0/10 [00:00<?, ?it/s]
 
46
  0%| | 0/10 [00:00<?, ?it/s]
 
47
  0%| | 0/10 [00:00<?, ?it/s]
 
48
  0%| | 0/10 [00:00<?, ?it/s]
 
49
  0%| | 0/10 [00:00<?, ?it/s]
 
50
  0%| | 0/10 [00:00<?, ?it/s]
 
51
  0%| | 0/10 [00:00<?, ?it/s]
 
52
  0%| | 0/10 [00:00<?, ?it/s]
 
53
  0%| | 0/10 [00:00<?, ?it/s]
 
54
  0%| | 0/10 [00:00<?, ?it/s]
 
55
  0%| | 0/10 [00:00<?, ?it/s]
 
56
  0%| | 0/10 [00:00<?, ?it/s]
 
57
  0%| | 0/10 [00:00<?, ?it/s]
 
58
  0%| | 0/10 [00:00<?, ?it/s]
 
59
  0%| | 0/10 [00:00<?, ?it/s]
 
60
  0%| | 0/10 [00:00<?, ?it/s]
 
61
  0%| | 0/10 [00:00<?, ?it/s]
 
62
  0%| | 0/10 [00:00<?, ?it/s]
 
63
  0%| | 0/10 [00:00<?, ?it/s]
 
64
  0%| | 0/10 [00:00<?, ?it/s]
 
65
  0%| | 0/10 [00:00<?, ?it/s]
 
66
  0%| | 0/10 [00:00<?, ?it/s]
 
67
  0%| | 0/10 [00:00<?, ?it/s]
 
68
  0%| | 0/10 [00:00<?, ?it/s]
 
69
  0%| | 0/10 [00:00<?, ?it/s]
 
70
  0%| | 0/10 [00:00<?, ?it/s]
 
71
  0%| | 0/10 [00:00<?, ?it/s]
 
72
  0%| | 0/10 [00:00<?, ?it/s]
 
73
  0%| | 0/10 [00:00<?, ?it/s]
 
74
  0%| | 0/10 [00:00<?, ?it/s]
 
75
  0%| | 0/10 [00:00<?, ?it/s]
 
76
  0%| | 0/10 [00:00<?, ?it/s]
 
77
  0%| | 0/10 [00:00<?, ?it/s]
 
78
  0%| | 0/10 [00:00<?, ?it/s]
 
79
  0%| | 0/10 [00:00<?, ?it/s]
 
80
  0%| | 0/10 [00:00<?, ?it/s]
 
81
  0%| | 0/10 [00:00<?, ?it/s]
 
82
  0%| | 0/10 [00:00<?, ?it/s]
 
83
  0%| | 0/10 [00:00<?, ?it/s]
 
84
  0%| | 0/10 [00:00<?, ?it/s]
 
85
  0%| | 0/10 [00:00<?, ?it/s]
 
86
  0%| | 0/10 [00:00<?, ?it/s]
 
87
  0%| | 0/10 [00:00<?, ?it/s]
 
88
  0%| | 0/10 [00:00<?, ?it/s]
 
89
  0%| | 0/10 [00:00<?, ?it/s]
 
90
  0%| | 0/10 [00:00<?, ?it/s]
 
91
  0%| | 0/10 [00:00<?, ?it/s]
 
92
  0%| | 0/10 [00:00<?, ?it/s]
 
93
  0%| | 0/10 [00:00<?, ?it/s]
 
94
  0%| | 0/10 [00:00<?, ?it/s]
 
95
  0%| | 0/10 [00:00<?, ?it/s]
 
96
  0%| | 0/10 [00:00<?, ?it/s]
 
97
  0%| | 0/10 [00:00<?, ?it/s]
 
98
  0%| | 0/10 [00:00<?, ?it/s]
 
99
  0%| | 0/10 [00:00<?, ?it/s]
 
100
  0%| | 0/10 [00:00<?, ?it/s]
 
101
  0%| | 0/10 [00:00<?, ?it/s]
 
102
  0%| | 0/10 [00:00<?, ?it/s]
 
103
  0%| | 0/10 [00:00<?, ?it/s]
 
104
  0%| | 0/10 [00:00<?, ?it/s]
 
105
  0%| | 0/10 [00:00<?, ?it/s]
 
106
  0%| | 0/10 [00:00<?, ?it/s]
 
107
  0%| | 0/10 [00:00<?, ?it/s]
 
108
  0%| | 0/10 [00:00<?, ?it/s]
 
109
  0%| | 0/8 [00:00<?, ?it/s]
 
1
+ GPU=0, batch_size=10, model=/home/jca/models/Qwen3-VL-8B-Instruct
2
+ [WARNING:swift] Loading model from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. This will execute custom Python code shipped in the model repository (e.g. configuration_*.py, modeling_*.py, tokenization_*.py). Only proceed if you trust the source of this model.
3
+ [transformers] `torch_dtype` is deprecated! Use `dtype` instead!
4
+ [WARNING:swift] Loading config from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. Custom Python code from the model repository will be executed. Only use models from sources you trust.
5
+ [WARNING:swift] Loading tokenizer/processor from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. Custom Python code from the model repository will be executed. Only use models from sources you trust.
6
+ [INFO:swift] Setting max_ratio: 200. You can adjust this hyperparameter through the environment variable: `MAX_RATIO`.
7
+ [INFO:swift] Setting frame_factor: 2. You can adjust this hyperparameter through the environment variable: `FRAME_FACTOR`.
8
+ [INFO:swift] Setting fps: 2.0. You can adjust this hyperparameter through the environment variable: `FPS`.
9
+ [INFO:swift] Setting fps_min_frames: 4. You can adjust this hyperparameter through the environment variable: `FPS_MIN_FRAMES`.
10
+ [INFO:swift] Setting fps_max_frames: 768. You can adjust this hyperparameter through the environment variable: `FPS_MAX_FRAMES`.
11
+ [INFO:swift] Using environment variable `IMAGE_MAX_TOKEN_NUM`, Setting image_max_token_num: 512.
12
+ [INFO:swift] Using environment variable `IMAGE_MIN_TOKEN_NUM`, Setting image_min_token_num: 4.
13
+ [INFO:swift] Setting spatial_merge_size: 2. You can adjust this hyperparameter through the environment variable: `SPATIAL_MERGE_SIZE`.
14
+ [INFO:swift] Setting video_max_token_num: 768. You can adjust this hyperparameter through the environment variable: `VIDEO_MAX_TOKEN_NUM`.
15
+ [INFO:swift] Setting video_min_token_num: 128. You can adjust this hyperparameter through the environment variable: `VIDEO_MIN_TOKEN_NUM`.
16
+ [INFO:swift] model_kwargs: {'device_map': 'cuda:0', 'dtype': torch.bfloat16}
17
+
18
+ [INFO:swift] Create the template for the infer_engine
19
+ [INFO:swift] Successfully registered `/opt/conda_envs/jca/qwen3vl/lib/python3.12/site-packages/swift/dataset/data/dataset_info.json`.
20
+ [INFO:swift] Successfully loaded /home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/args.json.
21
+ [INFO:swift] default_system: None
22
+ [INFO:swift] max_length: 262144
23
+ [INFO:swift] response_prefix: None
24
+ [INFO:swift] agent_template: hermes
25
+ [INFO:swift] norm_bbox: norm1000
26
+ [INFO:swift] Setting ROOT_IMAGE_DIR: None. You can adjust this hyperparameter through the environment variable: `ROOT_IMAGE_DIR`.
27
+ [INFO:swift] Setting QWENVL_BBOX_FORMAT: legacy. You can adjust this hyperparameter through the environment variable: `QWENVL_BBOX_FORMAT`.
28
+
29
  0%| | 0/10 [00:00<?, ?it/s]
30
+
31
  0%| | 0/10 [00:00<?, ?it/s]
32
+
33
  0%| | 0/10 [00:00<?, ?it/s]
34
+
35
  0%| | 0/10 [00:00<?, ?it/s]
36
+
37
  0%| | 0/10 [00:00<?, ?it/s]
38
+
39
  0%| | 0/10 [00:00<?, ?it/s]
40
+
41
  0%| | 0/10 [00:00<?, ?it/s]
42
+
43
  0%| | 0/10 [00:00<?, ?it/s]
44
+
45
  0%| | 0/10 [00:00<?, ?it/s]
46
+
47
  0%| | 0/10 [00:00<?, ?it/s]
48
+
49
  0%| | 0/10 [00:00<?, ?it/s]
50
+
51
  0%| | 0/10 [00:00<?, ?it/s]
52
+
53
  0%| | 0/10 [00:00<?, ?it/s]
54
+
55
  0%| | 0/10 [00:00<?, ?it/s]
56
+
57
  0%| | 0/10 [00:00<?, ?it/s]
58
+
59
  0%| | 0/10 [00:00<?, ?it/s]
60
+
61
  0%| | 0/10 [00:00<?, ?it/s]
62
+
63
  0%| | 0/10 [00:00<?, ?it/s]
64
+
65
  0%| | 0/10 [00:00<?, ?it/s]
66
+
67
  0%| | 0/10 [00:00<?, ?it/s]
68
+
69
  0%| | 0/10 [00:00<?, ?it/s]
70
+
71
  0%| | 0/10 [00:00<?, ?it/s]
72
+
73
  0%| | 0/10 [00:00<?, ?it/s]
74
+
75
  0%| | 0/10 [00:00<?, ?it/s]
76
+
77
  0%| | 0/10 [00:00<?, ?it/s]
78
+
79
  0%| | 0/10 [00:00<?, ?it/s]
80
+
81
  0%| | 0/10 [00:00<?, ?it/s]
82
+
83
  0%| | 0/10 [00:00<?, ?it/s]
84
+
85
  0%| | 0/10 [00:00<?, ?it/s]
86
+
87
  0%| | 0/10 [00:00<?, ?it/s]
88
+
89
  0%| | 0/10 [00:00<?, ?it/s]
90
+
91
  0%| | 0/10 [00:00<?, ?it/s]
92
+
93
  0%| | 0/10 [00:00<?, ?it/s]
94
+
95
  0%| | 0/10 [00:00<?, ?it/s]
96
+
97
  0%| | 0/10 [00:00<?, ?it/s]
98
+
99
  0%| | 0/10 [00:00<?, ?it/s]
100
+
101
  0%| | 0/10 [00:00<?, ?it/s]
102
+
103
  0%| | 0/10 [00:00<?, ?it/s]
104
+
105
  0%| | 0/10 [00:00<?, ?it/s]
106
+
107
  0%| | 0/10 [00:00<?, ?it/s]
108
+
109
  0%| | 0/10 [00:00<?, ?it/s]
110
+
111
  0%| | 0/10 [00:00<?, ?it/s]
112
+
113
  0%| | 0/10 [00:00<?, ?it/s]
114
+
115
  0%| | 0/10 [00:00<?, ?it/s]
116
+
117
  0%| | 0/10 [00:00<?, ?it/s]
118
+
119
  0%| | 0/10 [00:00<?, ?it/s]
120
+
121
  0%| | 0/10 [00:00<?, ?it/s]
122
+
123
  0%| | 0/10 [00:00<?, ?it/s]
124
+
125
  0%| | 0/10 [00:00<?, ?it/s]
126
+
127
  0%| | 0/10 [00:00<?, ?it/s]
128
+
129
  0%| | 0/10 [00:00<?, ?it/s]
130
+
131
  0%| | 0/10 [00:00<?, ?it/s]
132
+
133
  0%| | 0/10 [00:00<?, ?it/s]
134
+
135
  0%| | 0/10 [00:00<?, ?it/s]
136
+
137
  0%| | 0/10 [00:00<?, ?it/s]
138
+
139
  0%| | 0/10 [00:00<?, ?it/s]
140
+
141
  0%| | 0/10 [00:00<?, ?it/s]
142
+
143
  0%| | 0/10 [00:00<?, ?it/s]
144
+
145
  0%| | 0/10 [00:00<?, ?it/s]
146
+
147
  0%| | 0/10 [00:00<?, ?it/s]
148
+
149
  0%| | 0/10 [00:00<?, ?it/s]
150
+
151
  0%| | 0/10 [00:00<?, ?it/s]
152
+
153
  0%| | 0/10 [00:00<?, ?it/s]
154
+
155
  0%| | 0/10 [00:00<?, ?it/s]
156
+
157
  0%| | 0/10 [00:00<?, ?it/s]
158
+
159
  0%| | 0/10 [00:00<?, ?it/s]
160
+
161
  0%| | 0/10 [00:00<?, ?it/s]
162
+
163
  0%| | 0/10 [00:00<?, ?it/s]
164
+
165
  0%| | 0/10 [00:00<?, ?it/s]
166
+
167
  0%| | 0/10 [00:00<?, ?it/s]
168
+
169
  0%| | 0/10 [00:00<?, ?it/s]
170
+
171
  0%| | 0/10 [00:00<?, ?it/s]
172
+
173
  0%| | 0/10 [00:00<?, ?it/s]
174
+
175
  0%| | 0/10 [00:00<?, ?it/s]
176
+
177
  0%| | 0/10 [00:00<?, ?it/s]
178
+
179
  0%| | 0/10 [00:00<?, ?it/s]
180
+
181
  0%| | 0/10 [00:00<?, ?it/s]
182
+
183
  0%| | 0/10 [00:00<?, ?it/s]
184
+
185
  0%| | 0/10 [00:00<?, ?it/s]
186
+
187
  0%| | 0/10 [00:00<?, ?it/s]
188
+
189
  0%| | 0/10 [00:00<?, ?it/s]
190
+
191
  0%| | 0/10 [00:00<?, ?it/s]
192
+
193
  0%| | 0/10 [00:00<?, ?it/s]
194
+
195
  0%| | 0/10 [00:00<?, ?it/s]
196
+
197
  0%| | 0/10 [00:00<?, ?it/s]
198
+
199
  0%| | 0/10 [00:00<?, ?it/s]
200
+
201
  0%| | 0/10 [00:00<?, ?it/s]
202
+
203
  0%| | 0/10 [00:00<?, ?it/s]
204
+
205
  0%| | 0/10 [00:00<?, ?it/s]
206
+
207
  0%| | 0/10 [00:00<?, ?it/s]
208
+
209
  0%| | 0/10 [00:00<?, ?it/s]
210
+
211
  0%| | 0/10 [00:00<?, ?it/s]
212
+
213
  0%| | 0/10 [00:00<?, ?it/s]
214
+
215
  0%| | 0/10 [00:00<?, ?it/s]
216
+
217
  0%| | 0/10 [00:00<?, ?it/s]
218
+
219
  0%| | 0/10 [00:00<?, ?it/s]
220
+
221
  0%| | 0/10 [00:00<?, ?it/s]
222
+
223
  0%| | 0/10 [00:00<?, ?it/s]
224
+
225
  0%| | 0/10 [00:00<?, ?it/s]
226
+
227
  0%| | 0/10 [00:00<?, ?it/s]
228
+
229
  0%| | 0/10 [00:00<?, ?it/s]
230
+
231
  0%| | 0/10 [00:00<?, ?it/s]
232
+
233
  0%| | 0/10 [00:00<?, ?it/s]
234
+
235
  0%| | 0/10 [00:00<?, ?it/s]
236
+
237
  0%| | 0/10 [00:00<?, ?it/s]
238
+
239
  0%| | 0/10 [00:00<?, ?it/s]
240
+
241
  0%| | 0/10 [00:00<?, ?it/s]
242
+
243
  0%| | 0/10 [00:00<?, ?it/s]
244
+
245
  0%| | 0/10 [00:00<?, ?it/s]
246
+
247
  0%| | 0/8 [00:00<?, ?it/s]
sft/qwen3vl_sft_v16/inference_best/worker_logs/worker_1.log ADDED
@@ -0,0 +1,136 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0
  0%| | 0/10 [00:00<?, ?it/s]
 
1
  0%| | 0/10 [00:00<?, ?it/s]
 
2
  0%| | 0/10 [00:00<?, ?it/s]
 
3
  0%| | 0/10 [00:00<?, ?it/s]
 
4
  0%| | 0/10 [00:00<?, ?it/s]
 
5
  0%| | 0/10 [00:00<?, ?it/s]
 
6
  0%| | 0/10 [00:00<?, ?it/s]
 
7
  0%| | 0/10 [00:00<?, ?it/s]
 
8
  0%| | 0/10 [00:00<?, ?it/s]
 
9
  0%| | 0/10 [00:00<?, ?it/s]
 
10
  0%| | 0/10 [00:00<?, ?it/s]
 
11
  0%| | 0/10 [00:00<?, ?it/s]
 
12
  0%| | 0/10 [00:00<?, ?it/s]
 
13
  0%| | 0/10 [00:00<?, ?it/s]
 
14
  0%| | 0/10 [00:00<?, ?it/s]
 
15
  0%| | 0/10 [00:00<?, ?it/s]
 
16
  0%| | 0/10 [00:00<?, ?it/s]
 
17
  0%| | 0/10 [00:00<?, ?it/s]
 
18
  0%| | 0/10 [00:00<?, ?it/s]
 
19
  0%| | 0/10 [00:00<?, ?it/s]
 
20
  0%| | 0/10 [00:00<?, ?it/s]
 
21
  0%| | 0/10 [00:00<?, ?it/s]
 
22
  0%| | 0/10 [00:00<?, ?it/s]
 
23
  0%| | 0/10 [00:00<?, ?it/s]
 
24
  0%| | 0/10 [00:00<?, ?it/s]
 
25
  0%| | 0/10 [00:00<?, ?it/s]
 
26
  0%| | 0/10 [00:00<?, ?it/s]
 
27
  0%| | 0/10 [00:00<?, ?it/s]
 
28
  0%| | 0/10 [00:00<?, ?it/s]
 
29
  0%| | 0/10 [00:00<?, ?it/s]
 
30
  0%| | 0/10 [00:00<?, ?it/s]
 
31
  0%| | 0/10 [00:00<?, ?it/s]
 
32
  0%| | 0/10 [00:00<?, ?it/s]
 
33
  0%| | 0/10 [00:00<?, ?it/s]
 
34
  0%| | 0/10 [00:00<?, ?it/s]
 
35
  0%| | 0/10 [00:00<?, ?it/s]
 
36
  0%| | 0/10 [00:00<?, ?it/s]
 
37
  0%| | 0/10 [00:00<?, ?it/s]
 
38
  0%| | 0/10 [00:00<?, ?it/s]
 
39
  0%| | 0/10 [00:00<?, ?it/s]
 
40
  0%| | 0/10 [00:00<?, ?it/s]
 
41
  0%| | 0/10 [00:00<?, ?it/s]
 
42
  0%| | 0/10 [00:00<?, ?it/s]
 
43
  0%| | 0/10 [00:00<?, ?it/s]
 
44
  0%| | 0/10 [00:00<?, ?it/s]
 
45
  0%| | 0/10 [00:00<?, ?it/s]
 
46
  0%| | 0/10 [00:00<?, ?it/s]
 
47
  0%| | 0/10 [00:00<?, ?it/s]
 
48
  0%| | 0/10 [00:00<?, ?it/s]
 
49
  0%| | 0/10 [00:00<?, ?it/s]
 
50
  0%| | 0/10 [00:00<?, ?it/s]
 
51
  0%| | 0/10 [00:00<?, ?it/s]
 
52
  0%| | 0/10 [00:00<?, ?it/s]
 
53
  0%| | 0/10 [00:00<?, ?it/s]
 
54
  0%| | 0/10 [00:00<?, ?it/s]
 
55
  0%| | 0/10 [00:00<?, ?it/s]
 
56
  0%| | 0/10 [00:00<?, ?it/s]
 
57
  0%| | 0/10 [00:00<?, ?it/s]
 
58
  0%| | 0/10 [00:00<?, ?it/s]
 
59
  0%| | 0/10 [00:00<?, ?it/s]
 
60
  0%| | 0/10 [00:00<?, ?it/s]
 
61
  0%| | 0/10 [00:00<?, ?it/s]
 
62
  0%| | 0/10 [00:00<?, ?it/s]
 
63
  0%| | 0/10 [00:00<?, ?it/s]
 
64
  0%| | 0/10 [00:00<?, ?it/s]
 
65
  0%| | 0/10 [00:00<?, ?it/s]
 
66
  0%| | 0/10 [00:00<?, ?it/s]
 
67
  0%| | 0/10 [00:00<?, ?it/s]
 
68
  0%| | 0/10 [00:00<?, ?it/s]
 
69
  0%| | 0/10 [00:00<?, ?it/s]
 
70
  0%| | 0/10 [00:00<?, ?it/s]
 
71
  0%| | 0/10 [00:00<?, ?it/s]
 
72
  0%| | 0/10 [00:00<?, ?it/s]
 
73
  0%| | 0/10 [00:00<?, ?it/s]
 
74
  0%| | 0/10 [00:00<?, ?it/s]
 
75
  0%| | 0/10 [00:00<?, ?it/s]
 
76
  0%| | 0/10 [00:00<?, ?it/s]
 
77
  0%| | 0/10 [00:00<?, ?it/s]
 
78
  0%| | 0/10 [00:00<?, ?it/s]
 
79
  0%| | 0/10 [00:00<?, ?it/s]
 
80
  0%| | 0/10 [00:00<?, ?it/s]
 
81
  0%| | 0/10 [00:00<?, ?it/s]
 
82
  0%| | 0/10 [00:00<?, ?it/s]
 
83
  0%| | 0/10 [00:00<?, ?it/s]
 
84
  0%| | 0/10 [00:00<?, ?it/s]
 
85
  0%| | 0/10 [00:00<?, ?it/s]
 
86
  0%| | 0/10 [00:00<?, ?it/s]
 
87
  0%| | 0/10 [00:00<?, ?it/s]
 
88
  0%| | 0/10 [00:00<?, ?it/s]
 
89
  0%| | 0/10 [00:00<?, ?it/s]
 
90
  0%| | 0/10 [00:00<?, ?it/s]
 
91
  0%| | 0/10 [00:00<?, ?it/s]
 
92
  0%| | 0/10 [00:00<?, ?it/s]
 
93
  0%| | 0/10 [00:00<?, ?it/s]
 
94
  0%| | 0/10 [00:00<?, ?it/s]
 
95
  0%| | 0/10 [00:00<?, ?it/s]
 
96
  0%| | 0/10 [00:00<?, ?it/s]
 
97
  0%| | 0/10 [00:00<?, ?it/s]
 
98
  0%| | 0/10 [00:00<?, ?it/s]
 
99
  0%| | 0/10 [00:00<?, ?it/s]
 
100
  0%| | 0/10 [00:00<?, ?it/s]
 
101
  0%| | 0/10 [00:00<?, ?it/s]
 
102
  0%| | 0/10 [00:00<?, ?it/s]
 
103
  0%| | 0/10 [00:00<?, ?it/s]
 
104
  0%| | 0/10 [00:00<?, ?it/s]
 
105
  0%| | 0/10 [00:00<?, ?it/s]
 
106
  0%| | 0/10 [00:00<?, ?it/s]
 
107
  0%| | 0/10 [00:00<?, ?it/s]
 
108
  0%| | 0/10 [00:00<?, ?it/s]
 
1
+ GPU=1, batch_size=10, model=/home/jca/models/Qwen3-VL-8B-Instruct
2
+ [WARNING:swift] Loading model from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. This will execute custom Python code shipped in the model repository (e.g. configuration_*.py, modeling_*.py, tokenization_*.py). Only proceed if you trust the source of this model.
3
+ [transformers] `torch_dtype` is deprecated! Use `dtype` instead!
4
+ [WARNING:swift] Loading config from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. Custom Python code from the model repository will be executed. Only use models from sources you trust.
5
+ [WARNING:swift] Loading tokenizer/processor from '/home/jca/models/Qwen3-VL-8B-Instruct' with trust_remote_code=True. Custom Python code from the model repository will be executed. Only use models from sources you trust.
6
+ [INFO:swift] Setting max_ratio: 200. You can adjust this hyperparameter through the environment variable: `MAX_RATIO`.
7
+ [INFO:swift] Setting frame_factor: 2. You can adjust this hyperparameter through the environment variable: `FRAME_FACTOR`.
8
+ [INFO:swift] Setting fps: 2.0. You can adjust this hyperparameter through the environment variable: `FPS`.
9
+ [INFO:swift] Setting fps_min_frames: 4. You can adjust this hyperparameter through the environment variable: `FPS_MIN_FRAMES`.
10
+ [INFO:swift] Setting fps_max_frames: 768. You can adjust this hyperparameter through the environment variable: `FPS_MAX_FRAMES`.
11
+ [INFO:swift] Using environment variable `IMAGE_MAX_TOKEN_NUM`, Setting image_max_token_num: 512.
12
+ [INFO:swift] Using environment variable `IMAGE_MIN_TOKEN_NUM`, Setting image_min_token_num: 4.
13
+ [INFO:swift] Setting spatial_merge_size: 2. You can adjust this hyperparameter through the environment variable: `SPATIAL_MERGE_SIZE`.
14
+ [INFO:swift] Setting video_max_token_num: 768. You can adjust this hyperparameter through the environment variable: `VIDEO_MAX_TOKEN_NUM`.
15
+ [INFO:swift] Setting video_min_token_num: 128. You can adjust this hyperparameter through the environment variable: `VIDEO_MIN_TOKEN_NUM`.
16
+ [INFO:swift] model_kwargs: {'device_map': 'cuda:0', 'dtype': torch.bfloat16}
17
+
18
+ [INFO:swift] Create the template for the infer_engine
19
+ [INFO:swift] Successfully registered `/opt/conda_envs/jca/qwen3vl/lib/python3.12/site-packages/swift/dataset/data/dataset_info.json`.
20
+ [INFO:swift] Successfully loaded /home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/args.json.
21
+ [INFO:swift] default_system: None
22
+ [INFO:swift] max_length: 262144
23
+ [INFO:swift] response_prefix: None
24
+ [INFO:swift] agent_template: hermes
25
+ [INFO:swift] norm_bbox: norm1000
26
+ [INFO:swift] Setting ROOT_IMAGE_DIR: None. You can adjust this hyperparameter through the environment variable: `ROOT_IMAGE_DIR`.
27
+ [INFO:swift] Setting QWENVL_BBOX_FORMAT: legacy. You can adjust this hyperparameter through the environment variable: `QWENVL_BBOX_FORMAT`.
28
+
29
  0%| | 0/10 [00:00<?, ?it/s]
30
+
31
  0%| | 0/10 [00:00<?, ?it/s]
32
+
33
  0%| | 0/10 [00:00<?, ?it/s]
34
+
35
  0%| | 0/10 [00:00<?, ?it/s]
36
+
37
  0%| | 0/10 [00:00<?, ?it/s]
38
+
39
  0%| | 0/10 [00:00<?, ?it/s]
40
+
41
  0%| | 0/10 [00:00<?, ?it/s]
42
+
43
  0%| | 0/10 [00:00<?, ?it/s]
44
+
45
  0%| | 0/10 [00:00<?, ?it/s]
46
+
47
  0%| | 0/10 [00:00<?, ?it/s]
48
+
49
  0%| | 0/10 [00:00<?, ?it/s]
50
+
51
  0%| | 0/10 [00:00<?, ?it/s]
52
+
53
  0%| | 0/10 [00:00<?, ?it/s]
54
+
55
  0%| | 0/10 [00:00<?, ?it/s]
56
+
57
  0%| | 0/10 [00:00<?, ?it/s]
58
+
59
  0%| | 0/10 [00:00<?, ?it/s]
60
+
61
  0%| | 0/10 [00:00<?, ?it/s]
62
+
63
  0%| | 0/10 [00:00<?, ?it/s]
64
+
65
  0%| | 0/10 [00:00<?, ?it/s]
66
+
67
  0%| | 0/10 [00:00<?, ?it/s]
68
+
69
  0%| | 0/10 [00:00<?, ?it/s]
70
+
71
  0%| | 0/10 [00:00<?, ?it/s]
72
+
73
  0%| | 0/10 [00:00<?, ?it/s]
74
+
75
  0%| | 0/10 [00:00<?, ?it/s]
76
+
77
  0%| | 0/10 [00:00<?, ?it/s]
78
+
79
  0%| | 0/10 [00:00<?, ?it/s]
80
+
81
  0%| | 0/10 [00:00<?, ?it/s]
82
+
83
  0%| | 0/10 [00:00<?, ?it/s]
84
+
85
  0%| | 0/10 [00:00<?, ?it/s]
86
+
87
  0%| | 0/10 [00:00<?, ?it/s]
88
+
89
  0%| | 0/10 [00:00<?, ?it/s]
90
+
91
  0%| | 0/10 [00:00<?, ?it/s]
92
+
93
  0%| | 0/10 [00:00<?, ?it/s]
94
+
95
  0%| | 0/10 [00:00<?, ?it/s]
96
+
97
  0%| | 0/10 [00:00<?, ?it/s]
98
+
99
  0%| | 0/10 [00:00<?, ?it/s]
100
+
101
  0%| | 0/10 [00:00<?, ?it/s]
102
+
103
  0%| | 0/10 [00:00<?, ?it/s]
104
+
105
  0%| | 0/10 [00:00<?, ?it/s]
106
+
107
  0%| | 0/10 [00:00<?, ?it/s]
108
+
109
  0%| | 0/10 [00:00<?, ?it/s]
110
+
111
  0%| | 0/10 [00:00<?, ?it/s]
112
+
113
  0%| | 0/10 [00:00<?, ?it/s]
114
+
115
  0%| | 0/10 [00:00<?, ?it/s]
116
+
117
  0%| | 0/10 [00:00<?, ?it/s]
118
+
119
  0%| | 0/10 [00:00<?, ?it/s]
120
+
121
  0%| | 0/10 [00:00<?, ?it/s]
122
+
123
  0%| | 0/10 [00:00<?, ?it/s]
124
+
125
  0%| | 0/10 [00:00<?, ?it/s]
126
+
127
  0%| | 0/10 [00:00<?, ?it/s]
128
+
129
  0%| | 0/10 [00:00<?, ?it/s]
130
+
131
  0%| | 0/10 [00:00<?, ?it/s]
132
+
133
  0%| | 0/10 [00:00<?, ?it/s]
134
+
135
  0%| | 0/10 [00:00<?, ?it/s]
136
+
137
  0%| | 0/10 [00:00<?, ?it/s]
138
+
139
  0%| | 0/10 [00:00<?, ?it/s]
140
+
141
  0%| | 0/10 [00:00<?, ?it/s]
142
+
143
  0%| | 0/10 [00:00<?, ?it/s]
144
+
145
  0%| | 0/10 [00:00<?, ?it/s]
146
+
147
  0%| | 0/10 [00:00<?, ?it/s]
148
+
149
  0%| | 0/10 [00:00<?, ?it/s]
150
+
151
  0%| | 0/10 [00:00<?, ?it/s]
152
+
153
  0%| | 0/10 [00:00<?, ?it/s]
154
+
155
  0%| | 0/10 [00:00<?, ?it/s]
156
+
157
  0%| | 0/10 [00:00<?, ?it/s]
158
+
159
  0%| | 0/10 [00:00<?, ?it/s]
160
+
161
  0%| | 0/10 [00:00<?, ?it/s]
162
+
163
  0%| | 0/10 [00:00<?, ?it/s]
164
+
165
  0%| | 0/10 [00:00<?, ?it/s]
166
+
167
  0%| | 0/10 [00:00<?, ?it/s]
168
+
169
  0%| | 0/10 [00:00<?, ?it/s]
170
+
171
  0%| | 0/10 [00:00<?, ?it/s]
172
+
173
  0%| | 0/10 [00:00<?, ?it/s]
174
+
175
  0%| | 0/10 [00:00<?, ?it/s]
176
+
177
  0%| | 0/10 [00:00<?, ?it/s]
178
+
179
  0%| | 0/10 [00:00<?, ?it/s]
180
+
181
  0%| | 0/10 [00:00<?, ?it/s]
182
+
183
  0%| | 0/10 [00:00<?, ?it/s]
184
+
185
  0%| | 0/10 [00:00<?, ?it/s]
186
+
187
  0%| | 0/10 [00:00<?, ?it/s]
188
+
189
  0%| | 0/10 [00:00<?, ?it/s]
190
+
191
  0%| | 0/10 [00:00<?, ?it/s]
192
+
193
  0%| | 0/10 [00:00<?, ?it/s]
194
+
195
  0%| | 0/10 [00:00<?, ?it/s]
196
+
197
  0%| | 0/10 [00:00<?, ?it/s]
198
+
199
  0%| | 0/10 [00:00<?, ?it/s]
200
+
201
  0%| | 0/10 [00:00<?, ?it/s]
202
+
203
  0%| | 0/10 [00:00<?, ?it/s]
204
+
205
  0%| | 0/10 [00:00<?, ?it/s]
206
+
207
  0%| | 0/10 [00:00<?, ?it/s]
208
+
209
  0%| | 0/10 [00:00<?, ?it/s]
210
+
211
  0%| | 0/10 [00:00<?, ?it/s]
212
+
213
  0%| | 0/10 [00:00<?, ?it/s]
214
+
215
  0%| | 0/10 [00:00<?, ?it/s]
216
+
217
  0%| | 0/10 [00:00<?, ?it/s]
218
+
219
  0%| | 0/10 [00:00<?, ?it/s]
220
+
221
  0%| | 0/10 [00:00<?, ?it/s]
222
+
223
  0%| | 0/10 [00:00<?, ?it/s]
224
+
225
  0%| | 0/10 [00:00<?, ?it/s]
226
+
227
  0%| | 0/10 [00:00<?, ?it/s]
228
+
229
  0%| | 0/10 [00:00<?, ?it/s]
230
+
231
  0%| | 0/10 [00:00<?, ?it/s]
232
+
233
  0%| | 0/10 [00:00<?, ?it/s]
234
+
235
  0%| | 0/10 [00:00<?, ?it/s]
236
+
237
  0%| | 0/10 [00:00<?, ?it/s]
238
+
239
  0%| | 0/10 [00:00<?, ?it/s]
240
+
241
  0%| | 0/10 [00:00<?, ?it/s]
242
+
243
  0%| | 0/10 [00:00<?, ?it/s]
244
+
245
  0%| | 0/10 [00:00<?, ?it/s]
sft/qwen3vl_sft_v16/preflight/preflight_report.json ADDED
The diff for this file is too large to render. See raw diff
 
sft/qwen3vl_sft_v16/preflight/preflight_summary.json ADDED
@@ -0,0 +1,135 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "/home/jca/models/Qwen3-VL-8B-Instruct",
3
+ "backend": "swift",
4
+ "max_length": 4096,
5
+ "errors": 0,
6
+ "error_examples": [],
7
+ "datasets": {
8
+ "train": {
9
+ "path": "/home/jca/calligraphy_appreciation/data/sft/train_multitask.jsonl",
10
+ "rows": 26992,
11
+ "invalid_rows": 0,
12
+ "encoded_rows": 26992,
13
+ "length_statistics": {
14
+ "samples": 26992,
15
+ "min": 175,
16
+ "max": 3104,
17
+ "mean": 1095.4009706579727,
18
+ "p50": 1312.0,
19
+ "p90": 1676.0,
20
+ "p95": 1841.449999999997,
21
+ "p99": 2252.1800000000003,
22
+ "configured_max_length": 4096,
23
+ "over_configured_max_length": 0,
24
+ "candidate_limits": {
25
+ "2048": {
26
+ "over": 643,
27
+ "kept_ratio": 0.9761781268524007
28
+ },
29
+ "4096": {
30
+ "over": 0,
31
+ "kept_ratio": 1.0
32
+ },
33
+ "8192": {
34
+ "over": 0,
35
+ "kept_ratio": 1.0
36
+ },
37
+ "12288": {
38
+ "over": 0,
39
+ "kept_ratio": 1.0
40
+ }
41
+ },
42
+ "prompt_token_statistics": {
43
+ "count": 26992,
44
+ "min": 145,
45
+ "max": 836,
46
+ "mean": 625.7000592768228,
47
+ "p50": 756.0,
48
+ "p95": 836.0,
49
+ "p99": 836.0
50
+ },
51
+ "assistant_token_statistics": {
52
+ "count": 26992,
53
+ "min": 14,
54
+ "max": 2428,
55
+ "mean": 469.70091138115,
56
+ "p50": 530.0,
57
+ "p95": 1062.449999999997,
58
+ "p99": 1469.2700000000004
59
+ },
60
+ "image_token_statistics": {
61
+ "count": 26992,
62
+ "min": 32,
63
+ "max": 256,
64
+ "mean": 204.4463544754001,
65
+ "p50": 208.0,
66
+ "p95": 256.0,
67
+ "p99": 256.0
68
+ }
69
+ }
70
+ },
71
+ "validation": {
72
+ "path": "/home/jca/calligraphy_appreciation/data/sft/validation.jsonl",
73
+ "rows": 2199,
74
+ "invalid_rows": 0,
75
+ "encoded_rows": 2199,
76
+ "length_statistics": {
77
+ "samples": 2199,
78
+ "min": 782,
79
+ "max": 2712,
80
+ "mean": 1485.286948613006,
81
+ "p50": 1460.0,
82
+ "p90": 1778.2,
83
+ "p95": 1954.2999999999997,
84
+ "p99": 2404.08,
85
+ "configured_max_length": 4096,
86
+ "over_configured_max_length": 0,
87
+ "candidate_limits": {
88
+ "2048": {
89
+ "over": 76,
90
+ "kept_ratio": 0.9654388358344702
91
+ },
92
+ "4096": {
93
+ "over": 0,
94
+ "kept_ratio": 1.0
95
+ },
96
+ "8192": {
97
+ "over": 0,
98
+ "kept_ratio": 1.0
99
+ },
100
+ "12288": {
101
+ "over": 0,
102
+ "kept_ratio": 1.0
103
+ }
104
+ },
105
+ "prompt_token_statistics": {
106
+ "count": 2199,
107
+ "min": 612,
108
+ "max": 836,
109
+ "mean": 784.7403365165984,
110
+ "p50": 788.0,
111
+ "p95": 836.0,
112
+ "p99": 836.0
113
+ },
114
+ "assistant_token_statistics": {
115
+ "count": 2199,
116
+ "min": 108,
117
+ "max": 1908,
118
+ "mean": 700.5466120964074,
119
+ "p50": 671.0,
120
+ "p95": 1177.1,
121
+ "p99": 1612.02
122
+ },
123
+ "image_token_statistics": {
124
+ "count": 2199,
125
+ "min": 32,
126
+ "max": 256,
127
+ "mean": 204.74033651659846,
128
+ "p50": 208.0,
129
+ "p95": 256.0,
130
+ "p99": 256.0
131
+ }
132
+ }
133
+ }
134
+ }
135
+ }
sft/qwen3vl_sft_v16/v0-20261028-121611/args.json ADDED
@@ -0,0 +1,359 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "output_dir": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611",
3
+ "per_device_train_batch_size": 2,
4
+ "num_train_epochs": 4.0,
5
+ "max_steps": -1,
6
+ "learning_rate": 0.0001,
7
+ "lr_scheduler_type": "cosine",
8
+ "lr_scheduler_kwargs": null,
9
+ "warmup_steps": 0,
10
+ "optim": "adamw_torch_fused",
11
+ "optim_args": null,
12
+ "weight_decay": 0.1,
13
+ "adam_beta1": 0.9,
14
+ "adam_beta2": 0.95,
15
+ "adam_epsilon": 1e-08,
16
+ "optim_target_modules": null,
17
+ "gradient_accumulation_steps": 4,
18
+ "average_tokens_across_devices": true,
19
+ "max_grad_norm": 1.0,
20
+ "label_smoothing_factor": 0.0,
21
+ "bf16": true,
22
+ "fp16": false,
23
+ "bf16_full_eval": false,
24
+ "fp16_full_eval": false,
25
+ "tf32": null,
26
+ "gradient_checkpointing": true,
27
+ "gradient_checkpointing_kwargs": null,
28
+ "torch_compile": false,
29
+ "torch_compile_backend": null,
30
+ "torch_compile_mode": null,
31
+ "use_liger_kernel": false,
32
+ "liger_kernel_config": null,
33
+ "use_cache": false,
34
+ "neftune_noise_alpha": null,
35
+ "torch_empty_cache_steps": null,
36
+ "auto_find_batch_size": false,
37
+ "logging_strategy": "steps",
38
+ "logging_steps": 5,
39
+ "logging_first_step": true,
40
+ "log_on_each_node": true,
41
+ "logging_nan_inf_filter": true,
42
+ "include_num_input_tokens_seen": false,
43
+ "log_level": "passive",
44
+ "log_level_replica": "warning",
45
+ "disable_tqdm": null,
46
+ "report_to": [
47
+ "tensorboard"
48
+ ],
49
+ "run_name": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611",
50
+ "project": "huggingface",
51
+ "trackio_space_id": null,
52
+ "trackio_bucket_id": null,
53
+ "trackio_static_space_id": null,
54
+ "eval_strategy": "steps",
55
+ "eval_steps": 200.0,
56
+ "eval_delay": 0,
57
+ "per_device_eval_batch_size": 2,
58
+ "prediction_loss_only": false,
59
+ "eval_on_start": false,
60
+ "eval_do_concat_batches": true,
61
+ "eval_use_gather_object": false,
62
+ "eval_accumulation_steps": null,
63
+ "include_for_metrics": [],
64
+ "batch_eval_metrics": false,
65
+ "save_only_model": false,
66
+ "save_strategy": "steps",
67
+ "save_steps": 200.0,
68
+ "save_on_each_node": false,
69
+ "save_total_limit": 3,
70
+ "enable_jit_checkpoint": false,
71
+ "push_to_hub": false,
72
+ "hub_token": null,
73
+ "hub_private_repo": null,
74
+ "hub_model_id": null,
75
+ "hub_strategy": "every_save",
76
+ "hub_always_push": false,
77
+ "hub_revision": null,
78
+ "load_best_model_at_end": true,
79
+ "metric_for_best_model": "loss",
80
+ "greater_is_better": false,
81
+ "ignore_data_skip": false,
82
+ "restore_callback_states_from_checkpoint": false,
83
+ "full_determinism": false,
84
+ "seed": 42,
85
+ "data_seed": 42,
86
+ "use_cpu": false,
87
+ "accelerator_config": {
88
+ "dispatch_batches": false
89
+ },
90
+ "parallelism_config": null,
91
+ "dataloader_drop_last": false,
92
+ "dataloader_num_workers": 2,
93
+ "dataloader_pin_memory": true,
94
+ "dataloader_persistent_workers": true,
95
+ "dataloader_prefetch_factor": null,
96
+ "dataloader_multiprocessing_context": null,
97
+ "dataloader_in_order": true,
98
+ "remove_unused_columns": true,
99
+ "label_names": null,
100
+ "train_sampling_strategy": "random",
101
+ "length_column_name": "length",
102
+ "ddp_find_unused_parameters": null,
103
+ "ddp_bucket_cap_mb": null,
104
+ "ddp_broadcast_buffers": null,
105
+ "ddp_static_graph": null,
106
+ "ddp_backend": null,
107
+ "ddp_timeout": 18000000,
108
+ "fsdp": [],
109
+ "fsdp_config": null,
110
+ "deepspeed": null,
111
+ "debug": null,
112
+ "skip_memory_metrics": true,
113
+ "do_train": false,
114
+ "do_eval": false,
115
+ "do_predict": false,
116
+ "resume_from_checkpoint": null,
117
+ "local_rank": 0,
118
+ "sortish_sampler": false,
119
+ "predict_with_generate": false,
120
+ "generation_max_length": null,
121
+ "generation_num_beams": null,
122
+ "generation_config": null,
123
+ "tuner_backend": "peft",
124
+ "vit_gradient_checkpointing": true,
125
+ "router_aux_loss_coef": 0.0,
126
+ "enable_dft_loss": false,
127
+ "enable_channel_loss": false,
128
+ "safe_serialization": true,
129
+ "max_shard_size": "5GB",
130
+ "check_model": true,
131
+ "acc_strategy": "token",
132
+ "train_dataloader_shuffle": true,
133
+ "group_by_length": false,
134
+ "max_epochs": null,
135
+ "aligner_lr": null,
136
+ "vit_lr": 1e-05,
137
+ "use_logits_to_keep": null,
138
+ "ds3_gather_for_generation": true,
139
+ "resume_only_model": false,
140
+ "optimizer": null,
141
+ "loss_type": null,
142
+ "mrl_dims": null,
143
+ "eval_metric": null,
144
+ "callbacks": [],
145
+ "early_stop_interval": null,
146
+ "eval_use_evalscope": false,
147
+ "eval_dataset": [],
148
+ "eval_dataset_args": null,
149
+ "eval_limit": null,
150
+ "eval_generation_config": null,
151
+ "extra_eval_args": null,
152
+ "tuner_type": "lora",
153
+ "use_galore": false,
154
+ "galore_target_modules": null,
155
+ "galore_rank": 128,
156
+ "galore_update_proj_gap": 50,
157
+ "galore_scale": 1.0,
158
+ "galore_proj_type": "std",
159
+ "galore_optim_per_parameter": false,
160
+ "galore_with_embedding": false,
161
+ "galore_quantization": false,
162
+ "galore_proj_quant": false,
163
+ "galore_proj_bits": 4,
164
+ "galore_proj_group_size": 256,
165
+ "galore_cos_threshold": 0.4,
166
+ "galore_gamma_proj": 2,
167
+ "galore_queue_size": 5,
168
+ "lisa_activated_layers": 0,
169
+ "lisa_step_interval": 20,
170
+ "use_flash_ckpt": false,
171
+ "logging_dir": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/runs",
172
+ "warmup_ratio": 0.05,
173
+ "use_ray": false,
174
+ "ray_exp_name": null,
175
+ "device_groups": null,
176
+ "model": "/home/jca/models/Qwen3-VL-8B-Instruct",
177
+ "model_type": "qwen3_vl",
178
+ "model_revision": null,
179
+ "task_type": "causal_lm",
180
+ "torch_dtype": "bfloat16",
181
+ "attn_impl": null,
182
+ "experts_impl": null,
183
+ "new_special_tokens": [],
184
+ "num_labels": null,
185
+ "problem_type": null,
186
+ "rope_scaling": null,
187
+ "device_map": null,
188
+ "max_memory": {},
189
+ "max_model_len": null,
190
+ "local_repo_path": null,
191
+ "init_strategy": null,
192
+ "template": "qwen3_vl",
193
+ "system": null,
194
+ "max_length": 4096,
195
+ "truncation_strategy": "delete",
196
+ "max_pixels": null,
197
+ "agent_template": null,
198
+ "norm_bbox": null,
199
+ "use_chat_template": true,
200
+ "padding_side": "right",
201
+ "padding_free": false,
202
+ "loss_scale": "default",
203
+ "sequence_parallel_size": 1,
204
+ "is_binary_loss_scale": null,
205
+ "template_backend": "swift",
206
+ "response_prefix": null,
207
+ "enable_thinking": null,
208
+ "preserve_thinking": null,
209
+ "add_non_thinking_prefix": true,
210
+ "disable_ignore_empty_think": false,
211
+ "dataset": [
212
+ "/home/jca/calligraphy_appreciation/data/sft/train_multitask.jsonl"
213
+ ],
214
+ "val_dataset": [
215
+ "/home/jca/calligraphy_appreciation/data/sft/validation.jsonl"
216
+ ],
217
+ "cached_dataset": [],
218
+ "cached_val_dataset": [],
219
+ "split_dataset_ratio": 0.0,
220
+ "dataset_num_proc": 2,
221
+ "load_from_cache_file": false,
222
+ "dataset_shuffle": true,
223
+ "val_dataset_shuffle": false,
224
+ "streaming": false,
225
+ "interleave_prob": null,
226
+ "stopping_strategy": "first_exhausted",
227
+ "shuffle_buffer_size": 1000,
228
+ "download_mode": "reuse_dataset_if_exists",
229
+ "columns": {},
230
+ "strict": true,
231
+ "disable_auto_column_mapping": false,
232
+ "model_name": null,
233
+ "model_author": null,
234
+ "custom_dataset_info": [],
235
+ "decision_drop_instructions": 0.0,
236
+ "decision_subsample_options": 0,
237
+ "decision_state_as_text": 0.0,
238
+ "decision_shuffle_fields": false,
239
+ "quant_method": "bnb",
240
+ "quant_bits": 4,
241
+ "hqq_axis": null,
242
+ "bnb_4bit_compute_dtype": "bfloat16",
243
+ "bnb_4bit_quant_type": "nf4",
244
+ "bnb_4bit_use_double_quant": true,
245
+ "bnb_4bit_quant_storage": null,
246
+ "max_new_tokens": 64,
247
+ "temperature": 0.0,
248
+ "top_k": null,
249
+ "top_p": null,
250
+ "repetition_penalty": null,
251
+ "num_beams": 1,
252
+ "stream": false,
253
+ "stop_words": [],
254
+ "logprobs": false,
255
+ "top_logprobs": null,
256
+ "structured_outputs_regex": null,
257
+ "adapters": [],
258
+ "external_plugins": [],
259
+ "custom_register_path": [],
260
+ "model_kwargs": {},
261
+ "enable_npu_model_patch": true,
262
+ "load_args": false,
263
+ "load_data_args": false,
264
+ "packing": false,
265
+ "packing_length": null,
266
+ "packing_num_proc": 1,
267
+ "packing_strategy": "binpack",
268
+ "lazy_tokenize": true,
269
+ "use_hf": false,
270
+ "ignore_args_error": false,
271
+ "use_swift_lora": false,
272
+ "freeze_parameters": [],
273
+ "freeze_parameters_regex": null,
274
+ "freeze_parameters_ratio": 0.0,
275
+ "trainable_parameters": [],
276
+ "trainable_parameters_regex": null,
277
+ "freeze_llm": false,
278
+ "freeze_vit": false,
279
+ "freeze_aligner": true,
280
+ "target_modules": [
281
+ "all-linear"
282
+ ],
283
+ "target_regex": null,
284
+ "target_parameters": null,
285
+ "modules_to_save": [],
286
+ "lora_rank": 128,
287
+ "lora_alpha": 256.0,
288
+ "lora_dropout": 0.05,
289
+ "lora_bias": "none",
290
+ "lora_dtype": null,
291
+ "lorap_lr_ratio": null,
292
+ "use_rslora": false,
293
+ "use_dora": false,
294
+ "lora_ga_batch_size": 2,
295
+ "lora_ga_iters": 2,
296
+ "lora_ga_max_length": 1024,
297
+ "lora_ga_direction": "ArB2r",
298
+ "lora_ga_scale": "stable",
299
+ "lora_ga_stable_gamma": 16,
300
+ "init_weights": true,
301
+ "fourier_n_frequency": 2000,
302
+ "fourier_scaling": 300.0,
303
+ "boft_block_size": 4,
304
+ "boft_block_num": 0,
305
+ "boft_n_butterfly_factor": 1,
306
+ "boft_dropout": 0.0,
307
+ "vera_rank": 256,
308
+ "vera_projection_prng_key": 0,
309
+ "vera_dropout": 0.0,
310
+ "vera_d_initial": 0.1,
311
+ "adapter_act": "gelu",
312
+ "adapter_length": 128,
313
+ "adalora_target_r": 8,
314
+ "adalora_init_r": 12,
315
+ "adalora_tinit": 0,
316
+ "adalora_tfinal": 0,
317
+ "adalora_deltaT": 1,
318
+ "adalora_beta1": 0.85,
319
+ "adalora_beta2": 0.85,
320
+ "adalora_orth_reg_weight": 0.5,
321
+ "llamapro_num_new_blocks": 4,
322
+ "llamapro_num_groups": null,
323
+ "reft_layer_key": null,
324
+ "reft_layers": null,
325
+ "reft_rank": 4,
326
+ "reft_intervention_type": "LoreftIntervention",
327
+ "reft_args": null,
328
+ "swanlab_token": null,
329
+ "swanlab_project": "ms-swift",
330
+ "swanlab_workspace": null,
331
+ "swanlab_exp_name": null,
332
+ "swanlab_notification_method": null,
333
+ "swanlab_webhook_url": null,
334
+ "swanlab_secret": null,
335
+ "swanlab_sender_email": null,
336
+ "swanlab_receiver_email": null,
337
+ "swanlab_smtp_server": null,
338
+ "swanlab_smtp_port": null,
339
+ "swanlab_email_language": "zh",
340
+ "swanlab_mode": "cloud",
341
+ "add_version": true,
342
+ "create_checkpoint_symlink": true,
343
+ "zero_hpz_partition_size": null,
344
+ "deepspeed_autotp_size": null,
345
+ "swift_version": "4.6.0",
346
+ "ckpt_dir": null,
347
+ "rank": 0,
348
+ "global_world_size": 2,
349
+ "local_world_size": 2,
350
+ "model_suffix": "Qwen3-VL-8B-Instruct",
351
+ "model_info": "ModelInfo(model_type='qwen3_vl', model_dir='/home/jca/models/Qwen3-VL-8B-Instruct', torch_dtype=torch.bfloat16, max_model_len=262144, quant_method='bnb', quant_bits=4, rope_scaling=None, is_moe_model=False, is_multimodal=True, config=None, task_type='causal_lm', num_labels=None)",
352
+ "model_meta": "ModelMeta(model_type='qwen3_vl', model_groups=[ModelGroup(models=[Model(ms_model_id='Qwen/Qwen3-VL-2B-Instruct', hf_model_id='Qwen/Qwen3-VL-2B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Thinking', hf_model_id='Qwen/Qwen3-VL-2B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-2B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-2B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Instruct', hf_model_id='Qwen/Qwen3-VL-4B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Thinking', hf_model_id='Qwen/Qwen3-VL-4B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-4B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-4B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Instruct', hf_model_id='Qwen/Qwen3-VL-8B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Thinking', hf_model_id='Qwen/Qwen3-VL-8B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-8B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-8B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Instruct', hf_model_id='Qwen/Qwen3-VL-32B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Thinking', hf_model_id='Qwen/Qwen3-VL-32B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-32B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-32B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None)], template='qwen3_vl', ignore_patterns=None, requires=None, tags=[])], loader=<class 'swift.model.models.qwen.Qwen3VLLoader'>, template='qwen3_vl', model_arch=MultiModelKeys(arch_name='qwen3_vl', embedding=None, module_list=None, lm_head=None, q_proj=None, k_proj=None, v_proj=None, o_proj=None, attention=None, mlp='model.language_model.layers.{}.mlp', down_proj=None, qkv_proj=None, qk_proj=None, qa_proj=None, qb_proj=None, kv_proj=None, kva_proj=None, kvb_proj=None, language_model=['model.language_model', 'lm_head'], aligner=['model.visual.merger', 'model.visual.deepstack_merger_list'], vision_tower=['model.visual'], generator=[]), mcore_model_type=None, architectures=['Qwen3VLForConditionalGeneration'], additional_saved_files=[], torch_dtype=None, is_multimodal=True, is_reward=False, task_type=None, ignore_patterns=None, requires=['transformers>=4.57', 'qwen_vl_utils>=0.0.14', 'decord'], tags=[])",
353
+ "model_dir": "/home/jca/models/Qwen3-VL-8B-Instruct",
354
+ "template_meta": "QwenTemplateMeta(template_type='qwen3_vl', prefix=[], prompt=['<|im_start|>user\\n{{QUERY}}<|im_end|>\\n<|im_start|>assistant\\n'], chat_sep=['<|im_end|>\\n'], suffix=['<|im_end|>\\n'], template_cls=<class 'swift.template.templates.qwen.Qwen3VLTemplate'>, system_prefix=['<|im_start|>system\\n{{SYSTEM}}<|im_end|>\\n'], default_system=None, auto_add_bos=False, stop_words=['<|endoftext|>'], agent_template='hermes', is_thinking=False, thinking_prefix='<think>\\n', non_thinking_prefix='', preserve_thinking=None, history_thinking_prefix='')",
355
+ "_val_dataset_exists": true,
356
+ "hub": "<class 'swift.hub.hub.MSHub'>",
357
+ "evaluation_strategy": "steps",
358
+ "training_args": "Seq2SeqTrainingArguments(output_dir='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611', per_device_train_batch_size=2, num_train_epochs=4.0, max_steps=-1, learning_rate=0.0001, lr_scheduler_type=<SchedulerType.COSINE: 'cosine'>, lr_scheduler_kwargs=None, warmup_steps=0.05, optim=<OptimizerNames.ADAMW_TORCH_FUSED: 'adamw_torch_fused'>, optim_args=None, weight_decay=0.1, adam_beta1=0.9, adam_beta2=0.95, adam_epsilon=1e-08, optim_target_modules=None, gradient_accumulation_steps=4, average_tokens_across_devices=None, max_grad_norm=1.0, label_smoothing_factor=0.0, bf16=True, fp16=False, bf16_full_eval=False, fp16_full_eval=False, tf32=None, gradient_checkpointing=True, gradient_checkpointing_kwargs=None, torch_compile=False, torch_compile_backend=None, torch_compile_mode=None, use_liger_kernel=False, liger_kernel_config=None, use_cache=False, neftune_noise_alpha=None, torch_empty_cache_steps=None, auto_find_batch_size=False, logging_strategy=<IntervalStrategy.STEPS: 'steps'>, logging_steps=5, logging_first_step=True, log_on_each_node=True, logging_nan_inf_filter=True, include_num_input_tokens_seen=None, log_level='passive', log_level_replica='warning', disable_tqdm=False, report_to=['tensorboard'], run_name='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611', project='huggingface', trackio_space_id=None, trackio_bucket_id=None, trackio_static_space_id=None, eval_strategy=<IntervalStrategy.STEPS: 'steps'>, eval_steps=200, eval_delay=0, per_device_eval_batch_size=2, prediction_loss_only=False, eval_on_start=False, eval_do_concat_batches=True, eval_use_gather_object=False, eval_accumulation_steps=None, include_for_metrics=[], batch_eval_metrics=False, save_only_model=False, save_strategy=<SaveStrategy.STEPS: 'steps'>, save_steps=200, save_on_each_node=False, save_total_limit=3, enable_jit_checkpoint=False, push_to_hub=False, hub_token=None, hub_private_repo=None, hub_model_id=None, hub_strategy=<HubStrategy.EVERY_SAVE: 'every_save'>, hub_always_push=False, hub_revision=None, load_best_model_at_end=True, metric_for_best_model='loss', greater_is_better=False, ignore_data_skip=False, restore_callback_states_from_checkpoint=False, full_determinism=False, seed=42, data_seed=42, use_cpu=False, accelerator_config=AcceleratorConfig(split_batches=False, dispatch_batches=False, even_batches=True, use_seedable_sampler=True, non_blocking=False, gradient_accumulation_kwargs=None, use_configured_state=False), parallelism_config=None, dataloader_drop_last=False, dataloader_num_workers=2, dataloader_pin_memory=True, dataloader_persistent_workers=True, dataloader_prefetch_factor=2, dataloader_multiprocessing_context=None, dataloader_in_order=True, remove_unused_columns=False, label_names=None, train_sampling_strategy='random', length_column_name='length', ddp_find_unused_parameters=None, ddp_bucket_cap_mb=None, ddp_broadcast_buffers=None, ddp_static_graph=None, ddp_backend=None, ddp_timeout=18000000, fsdp=[], fsdp_config=None, deepspeed=None, debug=[], skip_memory_metrics=True, do_train=False, do_eval=True, do_predict=False, resume_from_checkpoint=None, local_rank=0, sortish_sampler=False, predict_with_generate=False, generation_max_length=None, generation_num_beams=None, generation_config=None, tuner_backend='peft', vit_gradient_checkpointing=True, router_aux_loss_coef=0.0, enable_dft_loss=False, enable_channel_loss=False, safe_serialization=True, max_shard_size='5GB', check_model=True, acc_strategy='token', train_dataloader_shuffle=True, group_by_length=False, max_epochs=None, aligner_lr=None, vit_lr=1e-05, use_logits_to_keep=None, ds3_gather_for_generation=True, resume_only_model=False, optimizer='multimodal', loss_type=None, mrl_dims=None, eval_metric=None, callbacks=[], early_stop_interval=None, eval_use_evalscope=False, eval_dataset=[], eval_dataset_args=None, eval_limit=None, eval_generation_config=None, extra_eval_args=None, tuner_type='lora', use_galore=False, galore_target_modules=None, galore_rank=128, galore_update_proj_gap=50, galore_scale=1.0, galore_proj_type='std', galore_optim_per_parameter=False, galore_with_embedding=False, galore_quantization=False, galore_proj_quant=False, galore_proj_bits=4, galore_proj_group_size=256, galore_cos_threshold=0.4, galore_gamma_proj=2, galore_queue_size=5, lisa_activated_layers=0, lisa_step_interval=20, use_flash_ckpt=False, logging_dir='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/runs', warmup_ratio=0.0)"
359
+ }
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /home/jca/models/Qwen3-VL-8B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:/home/jca/models/Qwen3-VL-8B-Instruct
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.20.0
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/adapter_config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "/home/jca/models/Qwen3-VL-8B-Instruct",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": false,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 256.0,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "lora_ga_config": null,
23
+ "megatron_config": null,
24
+ "megatron_core": "megatron.core",
25
+ "modules_to_save": [],
26
+ "monteclora_config": null,
27
+ "peft_type": "LORA",
28
+ "peft_version": "0.20.0",
29
+ "qalora_group_size": 16,
30
+ "r": 128,
31
+ "rank_pattern": {},
32
+ "revision": null,
33
+ "target_modules": "^(model\\.language_model(?=\\.).*\\.(o_proj|gate_proj|down_proj|v_proj|up_proj|k_proj|q_proj)|(?!(model.visual.merger|model.visual.deepstack_merger_list))model\\.visual(?=\\.).*\\.(linear_fc1|qkv|linear_fc2|attn.proj))$",
34
+ "target_parameters": null,
35
+ "task_type": "CAUSAL_LM",
36
+ "trainable_token_indices": null,
37
+ "use_bdlora": null,
38
+ "use_dora": false,
39
+ "use_qalora": false,
40
+ "use_rslora": false,
41
+ "velora_config": null
42
+ }
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02d5a3f359aed69d20b54d6ef96e6ec0dcabf6b7035007e1c5a1ea81feb25cb6
3
+ size 1643209400
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/additional_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"lora_dtype": null, "lorap_lr_ratio": null, "lorap_emb_lr": 1e-06}
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/args.json ADDED
@@ -0,0 +1,359 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "output_dir": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611",
3
+ "per_device_train_batch_size": 2,
4
+ "num_train_epochs": 4.0,
5
+ "max_steps": -1,
6
+ "learning_rate": 0.0001,
7
+ "lr_scheduler_type": "cosine",
8
+ "lr_scheduler_kwargs": null,
9
+ "warmup_steps": 0,
10
+ "optim": "adamw_torch_fused",
11
+ "optim_args": null,
12
+ "weight_decay": 0.1,
13
+ "adam_beta1": 0.9,
14
+ "adam_beta2": 0.95,
15
+ "adam_epsilon": 1e-08,
16
+ "optim_target_modules": null,
17
+ "gradient_accumulation_steps": 4,
18
+ "average_tokens_across_devices": true,
19
+ "max_grad_norm": 1.0,
20
+ "label_smoothing_factor": 0.0,
21
+ "bf16": true,
22
+ "fp16": false,
23
+ "bf16_full_eval": false,
24
+ "fp16_full_eval": false,
25
+ "tf32": null,
26
+ "gradient_checkpointing": true,
27
+ "gradient_checkpointing_kwargs": null,
28
+ "torch_compile": false,
29
+ "torch_compile_backend": null,
30
+ "torch_compile_mode": null,
31
+ "use_liger_kernel": false,
32
+ "liger_kernel_config": null,
33
+ "use_cache": false,
34
+ "neftune_noise_alpha": null,
35
+ "torch_empty_cache_steps": null,
36
+ "auto_find_batch_size": false,
37
+ "logging_strategy": "steps",
38
+ "logging_steps": 5,
39
+ "logging_first_step": true,
40
+ "log_on_each_node": true,
41
+ "logging_nan_inf_filter": true,
42
+ "include_num_input_tokens_seen": false,
43
+ "log_level": "passive",
44
+ "log_level_replica": "warning",
45
+ "disable_tqdm": null,
46
+ "report_to": [
47
+ "tensorboard"
48
+ ],
49
+ "run_name": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611",
50
+ "project": "huggingface",
51
+ "trackio_space_id": null,
52
+ "trackio_bucket_id": null,
53
+ "trackio_static_space_id": null,
54
+ "eval_strategy": "steps",
55
+ "eval_steps": 200.0,
56
+ "eval_delay": 0,
57
+ "per_device_eval_batch_size": 2,
58
+ "prediction_loss_only": false,
59
+ "eval_on_start": false,
60
+ "eval_do_concat_batches": true,
61
+ "eval_use_gather_object": false,
62
+ "eval_accumulation_steps": null,
63
+ "include_for_metrics": [],
64
+ "batch_eval_metrics": false,
65
+ "save_only_model": false,
66
+ "save_strategy": "steps",
67
+ "save_steps": 200.0,
68
+ "save_on_each_node": false,
69
+ "save_total_limit": 3,
70
+ "enable_jit_checkpoint": false,
71
+ "push_to_hub": false,
72
+ "hub_token": null,
73
+ "hub_private_repo": null,
74
+ "hub_model_id": null,
75
+ "hub_strategy": "every_save",
76
+ "hub_always_push": false,
77
+ "hub_revision": null,
78
+ "load_best_model_at_end": true,
79
+ "metric_for_best_model": "loss",
80
+ "greater_is_better": false,
81
+ "ignore_data_skip": false,
82
+ "restore_callback_states_from_checkpoint": false,
83
+ "full_determinism": false,
84
+ "seed": 42,
85
+ "data_seed": 42,
86
+ "use_cpu": false,
87
+ "accelerator_config": {
88
+ "dispatch_batches": false
89
+ },
90
+ "parallelism_config": null,
91
+ "dataloader_drop_last": false,
92
+ "dataloader_num_workers": 2,
93
+ "dataloader_pin_memory": true,
94
+ "dataloader_persistent_workers": true,
95
+ "dataloader_prefetch_factor": null,
96
+ "dataloader_multiprocessing_context": null,
97
+ "dataloader_in_order": true,
98
+ "remove_unused_columns": true,
99
+ "label_names": null,
100
+ "train_sampling_strategy": "random",
101
+ "length_column_name": "length",
102
+ "ddp_find_unused_parameters": null,
103
+ "ddp_bucket_cap_mb": null,
104
+ "ddp_broadcast_buffers": null,
105
+ "ddp_static_graph": null,
106
+ "ddp_backend": null,
107
+ "ddp_timeout": 18000000,
108
+ "fsdp": [],
109
+ "fsdp_config": null,
110
+ "deepspeed": null,
111
+ "debug": null,
112
+ "skip_memory_metrics": true,
113
+ "do_train": false,
114
+ "do_eval": false,
115
+ "do_predict": false,
116
+ "resume_from_checkpoint": null,
117
+ "local_rank": 0,
118
+ "sortish_sampler": false,
119
+ "predict_with_generate": false,
120
+ "generation_max_length": null,
121
+ "generation_num_beams": null,
122
+ "generation_config": null,
123
+ "tuner_backend": "peft",
124
+ "vit_gradient_checkpointing": true,
125
+ "router_aux_loss_coef": 0.0,
126
+ "enable_dft_loss": false,
127
+ "enable_channel_loss": false,
128
+ "safe_serialization": true,
129
+ "max_shard_size": "5GB",
130
+ "check_model": true,
131
+ "acc_strategy": "token",
132
+ "train_dataloader_shuffle": true,
133
+ "group_by_length": false,
134
+ "max_epochs": null,
135
+ "aligner_lr": null,
136
+ "vit_lr": 1e-05,
137
+ "use_logits_to_keep": null,
138
+ "ds3_gather_for_generation": true,
139
+ "resume_only_model": false,
140
+ "optimizer": null,
141
+ "loss_type": null,
142
+ "mrl_dims": null,
143
+ "eval_metric": null,
144
+ "callbacks": [],
145
+ "early_stop_interval": null,
146
+ "eval_use_evalscope": false,
147
+ "eval_dataset": [],
148
+ "eval_dataset_args": null,
149
+ "eval_limit": null,
150
+ "eval_generation_config": null,
151
+ "extra_eval_args": null,
152
+ "tuner_type": "lora",
153
+ "use_galore": false,
154
+ "galore_target_modules": null,
155
+ "galore_rank": 128,
156
+ "galore_update_proj_gap": 50,
157
+ "galore_scale": 1.0,
158
+ "galore_proj_type": "std",
159
+ "galore_optim_per_parameter": false,
160
+ "galore_with_embedding": false,
161
+ "galore_quantization": false,
162
+ "galore_proj_quant": false,
163
+ "galore_proj_bits": 4,
164
+ "galore_proj_group_size": 256,
165
+ "galore_cos_threshold": 0.4,
166
+ "galore_gamma_proj": 2,
167
+ "galore_queue_size": 5,
168
+ "lisa_activated_layers": 0,
169
+ "lisa_step_interval": 20,
170
+ "use_flash_ckpt": false,
171
+ "logging_dir": "/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/runs",
172
+ "warmup_ratio": 0.05,
173
+ "use_ray": false,
174
+ "ray_exp_name": null,
175
+ "device_groups": null,
176
+ "model": "/home/jca/models/Qwen3-VL-8B-Instruct",
177
+ "model_type": "qwen3_vl",
178
+ "model_revision": null,
179
+ "task_type": "causal_lm",
180
+ "torch_dtype": "bfloat16",
181
+ "attn_impl": null,
182
+ "experts_impl": null,
183
+ "new_special_tokens": [],
184
+ "num_labels": null,
185
+ "problem_type": null,
186
+ "rope_scaling": null,
187
+ "device_map": null,
188
+ "max_memory": {},
189
+ "max_model_len": null,
190
+ "local_repo_path": null,
191
+ "init_strategy": null,
192
+ "template": "qwen3_vl",
193
+ "system": null,
194
+ "max_length": 4096,
195
+ "truncation_strategy": "delete",
196
+ "max_pixels": null,
197
+ "agent_template": null,
198
+ "norm_bbox": null,
199
+ "use_chat_template": true,
200
+ "padding_side": "right",
201
+ "padding_free": false,
202
+ "loss_scale": "default",
203
+ "sequence_parallel_size": 1,
204
+ "is_binary_loss_scale": null,
205
+ "template_backend": "swift",
206
+ "response_prefix": null,
207
+ "enable_thinking": null,
208
+ "preserve_thinking": null,
209
+ "add_non_thinking_prefix": true,
210
+ "disable_ignore_empty_think": false,
211
+ "dataset": [
212
+ "/home/jca/calligraphy_appreciation/data/sft/train_multitask.jsonl"
213
+ ],
214
+ "val_dataset": [
215
+ "/home/jca/calligraphy_appreciation/data/sft/validation.jsonl"
216
+ ],
217
+ "cached_dataset": [],
218
+ "cached_val_dataset": [],
219
+ "split_dataset_ratio": 0.0,
220
+ "dataset_num_proc": 2,
221
+ "load_from_cache_file": false,
222
+ "dataset_shuffle": true,
223
+ "val_dataset_shuffle": false,
224
+ "streaming": false,
225
+ "interleave_prob": null,
226
+ "stopping_strategy": "first_exhausted",
227
+ "shuffle_buffer_size": 1000,
228
+ "download_mode": "reuse_dataset_if_exists",
229
+ "columns": {},
230
+ "strict": true,
231
+ "disable_auto_column_mapping": false,
232
+ "model_name": null,
233
+ "model_author": null,
234
+ "custom_dataset_info": [],
235
+ "decision_drop_instructions": 0.0,
236
+ "decision_subsample_options": 0,
237
+ "decision_state_as_text": 0.0,
238
+ "decision_shuffle_fields": false,
239
+ "quant_method": "bnb",
240
+ "quant_bits": 4,
241
+ "hqq_axis": null,
242
+ "bnb_4bit_compute_dtype": "bfloat16",
243
+ "bnb_4bit_quant_type": "nf4",
244
+ "bnb_4bit_use_double_quant": true,
245
+ "bnb_4bit_quant_storage": null,
246
+ "max_new_tokens": 64,
247
+ "temperature": 0.0,
248
+ "top_k": null,
249
+ "top_p": null,
250
+ "repetition_penalty": null,
251
+ "num_beams": 1,
252
+ "stream": false,
253
+ "stop_words": [],
254
+ "logprobs": false,
255
+ "top_logprobs": null,
256
+ "structured_outputs_regex": null,
257
+ "adapters": [],
258
+ "external_plugins": [],
259
+ "custom_register_path": [],
260
+ "model_kwargs": {},
261
+ "enable_npu_model_patch": true,
262
+ "load_args": false,
263
+ "load_data_args": false,
264
+ "packing": false,
265
+ "packing_length": null,
266
+ "packing_num_proc": 1,
267
+ "packing_strategy": "binpack",
268
+ "lazy_tokenize": true,
269
+ "use_hf": false,
270
+ "ignore_args_error": false,
271
+ "use_swift_lora": false,
272
+ "freeze_parameters": [],
273
+ "freeze_parameters_regex": null,
274
+ "freeze_parameters_ratio": 0.0,
275
+ "trainable_parameters": [],
276
+ "trainable_parameters_regex": null,
277
+ "freeze_llm": false,
278
+ "freeze_vit": false,
279
+ "freeze_aligner": true,
280
+ "target_modules": [
281
+ "all-linear"
282
+ ],
283
+ "target_regex": null,
284
+ "target_parameters": null,
285
+ "modules_to_save": [],
286
+ "lora_rank": 128,
287
+ "lora_alpha": 256.0,
288
+ "lora_dropout": 0.05,
289
+ "lora_bias": "none",
290
+ "lora_dtype": null,
291
+ "lorap_lr_ratio": null,
292
+ "use_rslora": false,
293
+ "use_dora": false,
294
+ "lora_ga_batch_size": 2,
295
+ "lora_ga_iters": 2,
296
+ "lora_ga_max_length": 1024,
297
+ "lora_ga_direction": "ArB2r",
298
+ "lora_ga_scale": "stable",
299
+ "lora_ga_stable_gamma": 16,
300
+ "init_weights": true,
301
+ "fourier_n_frequency": 2000,
302
+ "fourier_scaling": 300.0,
303
+ "boft_block_size": 4,
304
+ "boft_block_num": 0,
305
+ "boft_n_butterfly_factor": 1,
306
+ "boft_dropout": 0.0,
307
+ "vera_rank": 256,
308
+ "vera_projection_prng_key": 0,
309
+ "vera_dropout": 0.0,
310
+ "vera_d_initial": 0.1,
311
+ "adapter_act": "gelu",
312
+ "adapter_length": 128,
313
+ "adalora_target_r": 8,
314
+ "adalora_init_r": 12,
315
+ "adalora_tinit": 0,
316
+ "adalora_tfinal": 0,
317
+ "adalora_deltaT": 1,
318
+ "adalora_beta1": 0.85,
319
+ "adalora_beta2": 0.85,
320
+ "adalora_orth_reg_weight": 0.5,
321
+ "llamapro_num_new_blocks": 4,
322
+ "llamapro_num_groups": null,
323
+ "reft_layer_key": null,
324
+ "reft_layers": null,
325
+ "reft_rank": 4,
326
+ "reft_intervention_type": "LoreftIntervention",
327
+ "reft_args": null,
328
+ "swanlab_token": null,
329
+ "swanlab_project": "ms-swift",
330
+ "swanlab_workspace": null,
331
+ "swanlab_exp_name": null,
332
+ "swanlab_notification_method": null,
333
+ "swanlab_webhook_url": null,
334
+ "swanlab_secret": null,
335
+ "swanlab_sender_email": null,
336
+ "swanlab_receiver_email": null,
337
+ "swanlab_smtp_server": null,
338
+ "swanlab_smtp_port": null,
339
+ "swanlab_email_language": "zh",
340
+ "swanlab_mode": "cloud",
341
+ "add_version": true,
342
+ "create_checkpoint_symlink": true,
343
+ "zero_hpz_partition_size": null,
344
+ "deepspeed_autotp_size": null,
345
+ "swift_version": "4.6.0",
346
+ "ckpt_dir": null,
347
+ "rank": 0,
348
+ "global_world_size": 2,
349
+ "local_world_size": 2,
350
+ "model_suffix": "Qwen3-VL-8B-Instruct",
351
+ "model_info": "ModelInfo(model_type='qwen3_vl', model_dir='/home/jca/models/Qwen3-VL-8B-Instruct', torch_dtype=torch.bfloat16, max_model_len=262144, quant_method='bnb', quant_bits=4, rope_scaling=None, is_moe_model=False, is_multimodal=True, config=None, task_type='causal_lm', num_labels=None)",
352
+ "model_meta": "ModelMeta(model_type='qwen3_vl', model_groups=[ModelGroup(models=[Model(ms_model_id='Qwen/Qwen3-VL-2B-Instruct', hf_model_id='Qwen/Qwen3-VL-2B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Thinking', hf_model_id='Qwen/Qwen3-VL-2B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-2B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-2B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-2B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Instruct', hf_model_id='Qwen/Qwen3-VL-4B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Thinking', hf_model_id='Qwen/Qwen3-VL-4B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-4B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-4B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-4B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Instruct', hf_model_id='Qwen/Qwen3-VL-8B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Thinking', hf_model_id='Qwen/Qwen3-VL-8B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-8B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-8B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-8B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Instruct', hf_model_id='Qwen/Qwen3-VL-32B-Instruct', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Thinking', hf_model_id='Qwen/Qwen3-VL-32B-Thinking', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Instruct-FP8', hf_model_id='Qwen/Qwen3-VL-32B-Instruct-FP8', model_path=None, ms_revision=None, hf_revision=None), Model(ms_model_id='Qwen/Qwen3-VL-32B-Thinking-FP8', hf_model_id='Qwen/Qwen3-VL-32B-Thinking-FP8', model_path=None, ms_revision=None, hf_revision=None)], template='qwen3_vl', ignore_patterns=None, requires=None, tags=[])], loader=<class 'swift.model.models.qwen.Qwen3VLLoader'>, template='qwen3_vl', model_arch=MultiModelKeys(arch_name='qwen3_vl', embedding=None, module_list=None, lm_head=None, q_proj=None, k_proj=None, v_proj=None, o_proj=None, attention=None, mlp='model.language_model.layers.{}.mlp', down_proj=None, qkv_proj=None, qk_proj=None, qa_proj=None, qb_proj=None, kv_proj=None, kva_proj=None, kvb_proj=None, language_model=['model.language_model', 'lm_head'], aligner=['model.visual.merger', 'model.visual.deepstack_merger_list'], vision_tower=['model.visual'], generator=[]), mcore_model_type=None, architectures=['Qwen3VLForConditionalGeneration'], additional_saved_files=[], torch_dtype=None, is_multimodal=True, is_reward=False, task_type=None, ignore_patterns=None, requires=['transformers>=4.57', 'qwen_vl_utils>=0.0.14', 'decord'], tags=[])",
353
+ "model_dir": "/home/jca/models/Qwen3-VL-8B-Instruct",
354
+ "template_meta": "QwenTemplateMeta(template_type='qwen3_vl', prefix=[], prompt=['<|im_start|>user\\n{{QUERY}}<|im_end|>\\n<|im_start|>assistant\\n'], chat_sep=['<|im_end|>\\n'], suffix=['<|im_end|>\\n'], template_cls=<class 'swift.template.templates.qwen.Qwen3VLTemplate'>, system_prefix=['<|im_start|>system\\n{{SYSTEM}}<|im_end|>\\n'], default_system=None, auto_add_bos=False, stop_words=['<|endoftext|>'], agent_template='hermes', is_thinking=False, thinking_prefix='<think>\\n', non_thinking_prefix='', preserve_thinking=None, history_thinking_prefix='')",
355
+ "_val_dataset_exists": true,
356
+ "hub": "<class 'swift.hub.hub.MSHub'>",
357
+ "evaluation_strategy": "steps",
358
+ "training_args": "Seq2SeqTrainingArguments(output_dir='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611', per_device_train_batch_size=2, num_train_epochs=4.0, max_steps=-1, learning_rate=0.0001, lr_scheduler_type=<SchedulerType.COSINE: 'cosine'>, lr_scheduler_kwargs=None, warmup_steps=0.05, optim=<OptimizerNames.ADAMW_TORCH_FUSED: 'adamw_torch_fused'>, optim_args=None, weight_decay=0.1, adam_beta1=0.9, adam_beta2=0.95, adam_epsilon=1e-08, optim_target_modules=None, gradient_accumulation_steps=4, average_tokens_across_devices=None, max_grad_norm=1.0, label_smoothing_factor=0.0, bf16=True, fp16=False, bf16_full_eval=False, fp16_full_eval=False, tf32=None, gradient_checkpointing=True, gradient_checkpointing_kwargs=None, torch_compile=False, torch_compile_backend=None, torch_compile_mode=None, use_liger_kernel=False, liger_kernel_config=None, use_cache=False, neftune_noise_alpha=None, torch_empty_cache_steps=None, auto_find_batch_size=False, logging_strategy=<IntervalStrategy.STEPS: 'steps'>, logging_steps=5, logging_first_step=True, log_on_each_node=True, logging_nan_inf_filter=True, include_num_input_tokens_seen=None, log_level='passive', log_level_replica='warning', disable_tqdm=False, report_to=['tensorboard'], run_name='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611', project='huggingface', trackio_space_id=None, trackio_bucket_id=None, trackio_static_space_id=None, eval_strategy=<IntervalStrategy.STEPS: 'steps'>, eval_steps=200, eval_delay=0, per_device_eval_batch_size=2, prediction_loss_only=False, eval_on_start=False, eval_do_concat_batches=True, eval_use_gather_object=False, eval_accumulation_steps=None, include_for_metrics=[], batch_eval_metrics=False, save_only_model=False, save_strategy=<SaveStrategy.STEPS: 'steps'>, save_steps=200, save_on_each_node=False, save_total_limit=3, enable_jit_checkpoint=False, push_to_hub=False, hub_token=None, hub_private_repo=None, hub_model_id=None, hub_strategy=<HubStrategy.EVERY_SAVE: 'every_save'>, hub_always_push=False, hub_revision=None, load_best_model_at_end=True, metric_for_best_model='loss', greater_is_better=False, ignore_data_skip=False, restore_callback_states_from_checkpoint=False, full_determinism=False, seed=42, data_seed=42, use_cpu=False, accelerator_config=AcceleratorConfig(split_batches=False, dispatch_batches=False, even_batches=True, use_seedable_sampler=True, non_blocking=False, gradient_accumulation_kwargs=None, use_configured_state=False), parallelism_config=None, dataloader_drop_last=False, dataloader_num_workers=2, dataloader_pin_memory=True, dataloader_persistent_workers=True, dataloader_prefetch_factor=2, dataloader_multiprocessing_context=None, dataloader_in_order=True, remove_unused_columns=False, label_names=None, train_sampling_strategy='random', length_column_name='length', ddp_find_unused_parameters=None, ddp_bucket_cap_mb=None, ddp_broadcast_buffers=None, ddp_static_graph=None, ddp_backend=None, ddp_timeout=18000000, fsdp=[], fsdp_config=None, deepspeed=None, debug=[], skip_memory_metrics=True, do_train=False, do_eval=True, do_predict=False, resume_from_checkpoint=None, local_rank=0, sortish_sampler=False, predict_with_generate=False, generation_max_length=None, generation_num_beams=None, generation_config=None, tuner_backend='peft', vit_gradient_checkpointing=True, router_aux_loss_coef=0.0, enable_dft_loss=False, enable_channel_loss=False, safe_serialization=True, max_shard_size='5GB', check_model=True, acc_strategy='token', train_dataloader_shuffle=True, group_by_length=False, max_epochs=None, aligner_lr=None, vit_lr=1e-05, use_logits_to_keep=None, ds3_gather_for_generation=True, resume_only_model=False, optimizer='multimodal', loss_type=None, mrl_dims=None, eval_metric=None, callbacks=[], early_stop_interval=None, eval_use_evalscope=False, eval_dataset=[], eval_dataset_args=None, eval_limit=None, eval_generation_config=None, extra_eval_args=None, tuner_type='lora', use_galore=False, galore_target_modules=None, galore_rank=128, galore_update_proj_gap=50, galore_scale=1.0, galore_proj_type='std', galore_optim_per_parameter=False, galore_with_embedding=False, galore_quantization=False, galore_proj_quant=False, galore_proj_bits=4, galore_proj_group_size=256, galore_cos_threshold=0.4, galore_gamma_proj=2, galore_queue_size=5, lisa_activated_layers=0, lisa_step_interval=20, use_flash_ckpt=False, logging_dir='/home/jca/models/trained_models/sft/qwen3vl_sft_v16/v0-20261028-121611/runs', warmup_ratio=0.0)"
359
+ }
sft/qwen3vl_sft_v16/v0-20261028-121611/checkpoint-5000/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f77a58860a563c955e0d1c872dd4deced44b2bcd6f9a414cc3a7f3f0ef4e1672
3
+ size 3286824211