skx618 commited on
Commit
b288148
·
verified ·
1 Parent(s): 48e39a4

Add files using upload-large-folder tool

Browse files
Files changed (49) hide show
  1. LICENSE +84 -0
  2. README.md +44 -0
  3. audio_scheduler/scheduler_config.json +5 -0
  4. audio_vae/config.json +125 -0
  5. checkpoint_content.json +99 -0
  6. checkpoint_metadata.json +204 -0
  7. fastvideo_inference.json +22 -0
  8. modelopt_manifest.json +1280 -0
  9. modular_model_index.json +131 -0
  10. processor/chat_template.json +3 -0
  11. processor/merges.txt +0 -0
  12. processor/preprocessor_config.json +21 -0
  13. processor/tokenizer.json +0 -0
  14. processor/tokenizer_config.json +246 -0
  15. processor/video_preprocessor_config.json +21 -0
  16. processor/vocab.json +0 -0
  17. provenance.json +19 -0
  18. scheduler/scheduler_config.json +5 -0
  19. text_encoder/chat_template.json +3 -0
  20. text_encoder/config.json +62 -0
  21. text_encoder/merges.txt +0 -0
  22. text_encoder/model-00001-of-00014.safetensors +3 -0
  23. text_encoder/model-00002-of-00014.safetensors +3 -0
  24. text_encoder/model-00003-of-00014.safetensors +3 -0
  25. text_encoder/model-00006-of-00014.safetensors +3 -0
  26. text_encoder/model-00007-of-00014.safetensors +3 -0
  27. text_encoder/model-00014-of-00014.safetensors +3 -0
  28. text_encoder/model.safetensors.index.json +1065 -0
  29. text_encoder/preprocessor_config.json +21 -0
  30. text_encoder/tokenizer.json +0 -0
  31. text_encoder/tokenizer_config.json +246 -0
  32. text_encoder/video_preprocessor_config.json +21 -0
  33. text_encoder/vocab.json +0 -0
  34. tokenizer/merges.txt +0 -0
  35. tokenizer/tokenizer.json +0 -0
  36. tokenizer/tokenizer_config.json +246 -0
  37. tokenizer/vocab.json +0 -0
  38. transformer/config.json +26 -0
  39. transformer/diffusion_pytorch_model-00002-of-00014.safetensors +3 -0
  40. transformer/diffusion_pytorch_model-00003-of-00014.safetensors +3 -0
  41. transformer/diffusion_pytorch_model-00007-of-00014.safetensors +3 -0
  42. transformer/diffusion_pytorch_model-00008-of-00014.safetensors +3 -0
  43. transformer/diffusion_pytorch_model-00009-of-00014.safetensors +3 -0
  44. transformer/diffusion_pytorch_model-00010-of-00014.safetensors +3 -0
  45. transformer/diffusion_pytorch_model.safetensors.index.json +895 -0
  46. transformer/modelopt-component-manifest.json +1483 -0
  47. vae/config.json +97 -0
  48. vae/diffusion_pytorch_model.safetensors.index.json +0 -0
  49. vae/modelopt-component-manifest.json +0 -0
LICENSE ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MiniMax H3 COMMUNITY LICENSE AGREEMENT
2
+ MiniMax H3 release date/License date: August 2, 2026.
3
+ The scope of this License Agreement (this “Agreement”) is expressly limited to the “Applicable Territory” as defined below.
4
+ By clicking to accept, or by using, reproducing, modifying, distributing, running, or displaying any portion or element of the MiniMax H3 Works (including through any Hosted Services) in any manner, you acknowledge and accept the terms of this Agreement, and this Agreement shall take immediate effect upon the occurrence of such act.
5
+ I. Definitions
6
+ 1. “Acceptable Use Policy” means the policy published by MiniMax in Exhibit A.
7
+ 2. “Agreement” means the terms and conditions set forth herein that govern the use, reproduction, distribution, modification, running, and display of the MiniMax H3 Works or any portion or element thereof.
8
+ 3. “Applicable Territory” means worldwide, excluding the Excluded Territories.
9
+ 4. “Documentation” means the specifications, manuals, and documentation concerning MiniMax H3 that are publicly released by MiniMax.
10
+ 5. “Excluded Territories” means the European Union, the United Kingdom, the Republic of Korea and the United States of America.
11
+ 6. “MiniMax H3” means the video generation model, together with its software and algorithms, including trained model weights, parameters (including optimizer states), machine-learning model code, inference-supporting code, and other elements thereof made publicly available by Us, as released at https://huggingface.co/MiniMaxAI/MiniMax-H3.
12
+ 7. “MiniMax H3 Works” means (i) the Materials, (ii) the Model Derivatives, and (iii) all derivatives thereof.
13
+ 8. “Hosted Services” means hosted services provided via application programming interfaces (APIs), web access, or any other electronic or remote means.
14
+ 9. “Licensee,” “you,” or “your” means the natural or legal person exercising rights and/or using the MiniMax H3 Works for any purpose in any field of use under this Agreement.
15
+ 10. “Materials” means, collectively, MiniMax H3 and the Documentation (and any portion thereof), in each case as made available by MiniMax under this Agreement and proprietary to MiniMax.
16
+ 11. “Model Derivatives” means all of the following: (i) any modification of MiniMax H3 or any Model Derivative thereof; (ii) any work based on MiniMax H3 or any Model Derivative thereof; or (iii) any other machine learning model created by transferring the patterns of the weights, parameters, operational patterns, or Outputs of MiniMax H3 or any Model Derivative thereof to another model, such that the latter model exhibits behavior similar to MiniMax H3 or its Model Derivatives, including by distillation methods, methods using intermediate data representations, or methods based on training using synthetic-data Outputs generated by MiniMax H3 or its Model Derivatives. For the avoidance of doubt, Outputs are not deemed Model Derivatives.
17
+ 12. “Output” means any result of operating or otherwise using MiniMax H3 or any Model Derivatives (including through Hosted Services).
18
+ 13. “Third Party” means any natural or legal person that is not under common control with us or with you.
19
+ 14. “Including” means “including but not limited to.”
20
+ 15. “We,” “Us” or “MiniMax” means Nanonoble Pte. Ltd..
21
+ II. Grant of Rights
22
+ Solely within the Applicable Territory, we grant you a non-exclusive, non-transferable, royalty-free, limited license to use, reproduce, distribute, create derivative works (including Model Derivatives), and modify the Materials in accordance with the terms of this Agreement and the Acceptable Use Policy, based on the intellectual property and other rights owned by MiniMax that are embodied in or used by the Materials. You shall not violate (or encourage or permit any person to violate) any term of this Agreement or the Acceptable Use Policy.
23
+ We will continuously evaluate the applicable laws, regulations and compliance requirements for the Excluded Territories. In the meantime, should any person in such Excluded Territories be interested in deploying our models, you are welcome to contact us about obtaining a license, which will be granted based on robust controls and guardrails for purposes of complying with the laws, regulations and compliance requirements of the Excluded Territories.
24
+ III. Distribution and Redistribution
25
+ Subject to and conditioned on your continuing compliance with this Agreement, including its territorial restrictions and the Acceptable Use Policy, and solely within the Applicable Territory, you may distribute or make available the MiniMax H3 Works to Third Parties within the Applicable Territory; provided, that all of the following conditions are met:
26
+ 1. You must provide a copy of this Agreement to all such Third Parties who receive the MiniMax H3 Works or use your products or services related thereto;
27
+ 2. You must cause any modified files to carry prominent notices stating that you have modified such files;
28
+ 3. You are encouraged to:
29
+ a. display a notice on any product or service developed using MiniMax H3 indicating that the product or service is “Powered by MiniMax H3”;
30
+ b. add an AI-generation identifier to files produced using generative AI models including MiniMax H3; and
31
+ c. publish at least one technical blog post or a public statement describing your experience using MiniMax H3 Works;
32
+ 4. All distributions to Third Parties (other than through Hosted Services) must be accompanied by a “NOTICE” text file containing the following notice:
33
+ “MiniMax H3 is licensed under the MiniMax H3 Community License Agreement, Copyright © 2026 MiniMax. All Rights Reserved.”
34
+ You may add your own copyright notices on your modifications; except as provided in this Section and in Section V, however, you may not impose additional or different terms and conditions on the use, reproduction, or distribution of your modifications or of any aggregate Model Derivatives, and your use, reproduction, modification, distribution, running, and display of the work must otherwise comply with the terms and conditions of this Agreement (including the provisions concerning the Applicable Territory). If you receive the MiniMax H3 Works from a Licensee as part of an integrated end-user product, the provisions of Section III of this Agreement do not apply to you, but Section V and Exhibit A remain applicable.
35
+ IV. Additional Commercial Terms
36
+ 1. You shall obtain a separate, prior written authorization from MiniMax by contacting api@minimax.io with the subject line “MiniMax H3 licensing - authorization request”, if your commercial products and services generate more than 20 million US dollars (or equivalent in other currencies) in yearly revenue.
37
+ 2. You shall prominently display “MiniMax H3”on the user interface of commercial product or service that uses MiniMax H3 or MiniMax H3 Works.
38
+ V. Use Restrictions
39
+ 1. Your use of the MiniMax H3 Works must comply with applicable laws and regulations (including trade-compliance laws and regulations) and must comply with the Acceptable Use Policy for the MiniMax H3 Works, which is incorporated into this Agreement by reference.
40
+ 2. Before providing access to the MiniMax H3 Works or any product, service, or Hosted Service incorporating them, you must bind each recipient or user to enforceable terms at least as protective as the use restrictions in this Section V and Exhibit A, and you must notify each recipient or user that those restrictions apply.
41
+ 3. You may not use the MiniMax H3 Works or any of their Outputs or results to improve any other artificial intelligence model (other than MiniMax H3 or its Model Derivatives).
42
+ 4. You may not use, reproduce, modify, distribute, or display the MiniMax H3 Works or any of their Outputs or results outside the Applicable Territory. Any such use outside the Applicable Territory is not authorized by this Agreement.
43
+ 5. If you provide or make available to any Third Party a product, service, or Hosted Service that permits the generation of Outputs using MiniMax H3 or any Model Derivative, you must, before making that product or service available and throughout its operation, implement, maintain, test, and periodically review reasonable and proportionate technical and organizational safeguards designed to prevent and mitigate access, uses, and Outputs that violate this Section V or Exhibit A, including uses or Outputs that infringe, misappropriate, or otherwise violate any Third Party’s intellectual-property or other rights. You must not knowingly disable, materially weaken, or permit the circumvention of those safeguards. You must maintain a reasonably accessible mechanism for reporting suspected violations. Upon receiving a good-faith report or otherwise obtaining actual knowledge of a violation, you must promptly investigate and take reasonable steps within your control to stop or mitigate the violation, including removing or disabling access to offending content or services and suspending or terminating repeat violators where appropriate. You are responsible for implementing and enforcing these requirements with respect to your products, services, systems, users, and downstream recipients.
44
+ VI. Intellectual Property
45
+ 1. Subject to MiniMax’s rights in the MiniMax H3 Works (and the intellectual property therein), and to your compliance with the terms and conditions of this Agreement, as between you and MiniMax, you will own the derivative works and modifications of the Materials that you have created or had created, as well as any Model Derivatives.
46
+ 2. Except for the limited license expressly granted in this paragraph, no trademark license is granted under this Agreement; with respect to MiniMax H3 Works, the Licensee may not use any name or mark owned by or associated with MiniMax or any of its affiliates, except as reasonably and customarily necessary to describe and distribute the MiniMax H3 Works. MiniMax hereby grants you a license to use the “MiniMax H3” mark (the “Mark”) within the Applicable Territory solely for the purpose of complying with Section III.3; provided, that you comply with all applicable trademark-protection laws. All goodwill arising from your use of the Mark shall inure to the benefit of MiniMax.
47
+ 3. If you bring or assert any suit or other legal proceeding (including a cross-claim or counterclaim in any action) against us or any other natural or legal person alleging that the Materials, any Output, or any portion of the foregoing infringes any intellectual property right or other right owned by you or for which you can obtain a license, all licenses granted to you under this Agreement will terminate as of the date such suit or proceeding is filed. You shall defend, indemnify, and hold us harmless against any Third-Party claim arising out of or related to the use or distribution of the MiniMax H3 Works by you or by any Third Party.
48
+ 4. MiniMax claims no rights over the Outputs you generate. You and your users are entirely responsible for the Outputs and any subsequent use thereof.
49
+ VII. Disclaimers and Limitations of Liability
50
+ 1. We have no obligation to support, update, provide training for, or develop any further version of the MiniMax H3 Works, or to grant any license with respect thereto.
51
+ 2. UNLESS AND ONLY TO THE EXTENT REQUIRED BY APPLICABLE LAW, THE MINIMAX H3 WORKS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED “AS IS” WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES OF ANY KIND INCLUDING ANY WARRANTIES OF TITLE, MERCHANTABILITY, NONINFRINGEMENT, COURSE OF DEALING, USAGE OF TRADE, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING, REPRODUCING, MODIFYING, PERFORMING, DISPLAYING OR DISTRIBUTING ANY OF THE MINIMAX H3 WORKS OR OUTPUTS AND ASSUME ANY AND ALL RISKS ASSOCIATED WITH YOUR OR A THIRD PARTY’S USE OR DISTRIBUTION OF ANY OF THE MINIMAX H3 WORKS OR OUTPUTS AND YOUR EXERCISE OF RIGHTS AND PERMISSIONS UNDER THIS AGREEMENT.
52
+ 3. TO THE FULLEST EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT SHALL MINIMAX OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, FOR ANY DAMAGES, INCLUDING ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, EXEMPLARY, CONSEQUENTIAL OR PUNITIVE DAMAGES, OR LOST PROFITS OF ANY KIND ARISING FROM THIS AGREEMENT OR RELATED TO ANY OF THE MINIMAX H3 WORKS OR OUTPUTS, EVEN IF MINIMAX OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
53
+ VIII. Term and Termination
54
+ 1. This Agreement is effective from the moment you accept this Agreement or begin accessing the Materials, and, subject to your compliance with its terms and conditions, will remain in effect until terminated as provided herein.
55
+ 2. If you breach any term or condition of this Agreement, we have the right to terminate this Agreement. Upon termination, you must immediately cease accessing, using, and distributing the MiniMax H3 Works; delete or destroy all copies within your possession or control; and notify each downstream recipient that your authorization has ended. The obligations in the preceding sentence and Sections VI.1, VI.3, VII, and IX survive termination.
56
+ IX. Governing Law and Jurisdiction
57
+ 1. This Agreement, and any dispute arising out of or related to this Agreement, shall be governed by the laws of the Hong Kong Special Administrative Region of the People’s Republic of China, without regard to its conflict-of-laws rules. The United Nations Convention on Contracts for the International Sale of Goods does not apply to this Agreement.
58
+ 2. Any dispute arising out of or related to this Agreement shall be subject to the exclusive jurisdiction of the courts of the Hong Kong Special Administrative Region of the People’s Republic of China with competent jurisdiction. Both MiniMax and the Licensee hereby consent to the exclusive jurisdiction of such courts for any such dispute.
59
+ Additional Note: Please note that the encoder of MiniMax H3 uses Qwen3-VL-32B, which is licensed under Apache 2.0 License: https://github.com/QwenLM/Qwen3-VL/blob/main/LICENSE.
60
+
61
+ Exhibit A — Acceptable Use Policy
62
+ MiniMax reserves the right to update this Acceptable Use Policy from time to time.
63
+ Last revised: August 2, 2026.
64
+ MiniMax is committed to promoting the safe and fair use of its tools and features, including MiniMax H3. You agree not to use MiniMax H3, any Model Derivatives, or any Output in any of the following ways:
65
+ 1. Use outside the Applicable Territory;
66
+ 2. Use in any manner that violates any applicable national, federal, state, local, or international law, regulation, or other legal requirement, or that infringes, misappropriates, or otherwise violates any Third Party’s intellectual-property or other proprietary rights, including through unauthorized reproduction, distribution, public display, public performance, or creation of derivative works;
67
+ 3. Use in any manner that may harm yourself or others;
68
+ 4. Use to repurpose or distribute the Outputs of MiniMax H3 or any Model Derivatives in order to harm yourself or others;
69
+ 5. Use to circumvent or bypass any safety guardrails or safeguards we have implemented;
70
+ 6. Use in any manner that exploits or harms, or intends to exploit or harm, minors;
71
+ 7. Use to generate or disseminate verifiably false information and/or content for the purpose of harming others or influencing elections;
72
+ 8. Use to manufacture or facilitate false online engagement, including fake reviews and other means of false online engagement;
73
+ 9. Use to intentionally defame, disparage, or otherwise harass others;
74
+ 10. Use to generate and/or disseminate malware (including ransomware) or any other content intended to damage electronic systems;
75
+ 11. Use to generate or disseminate personally identifiable information for the purpose of harming others;
76
+ 12. Use to generate or disseminate information (including images, code, posts, or articles) in or to any public environment (including via bot tweets or similar means) without clearly and prominently disclosing that such information and/or content is machine-generated;
77
+ 13. Use to impersonate another person without that person’s consent, authorization, or lawful right to do so;
78
+ 14. Use to make high-risk automated decisions in critical domains that affect individual safety, rights, or well-being (such as law enforcement, immigration, healthcare or medical services, critical-infrastructure management, product-safety components, essential services, credit, employment, housing, education, social scoring, or insurance);
79
+ 15. Use in any manner that violates or disregards the social, ethical, or moral standards of other countries or regions;
80
+ 16. Use to carry out, assist, threaten, incite, plan, advocate for, or encourage violent extremism or terrorism;
81
+ 17. Use for any purpose intended to discriminate against, or harm, individuals or groups based on protected characteristics or categories, online or offline social behavior, or known or predicted personality traits;
82
+ 18. Use to intentionally exploit the vulnerabilities of specific populations based on age, social, physical, or psychological characteristics, so as to materially distort the behavior of a member of that group in a manner that causes, or is likely to cause, physical or psychological harm to that person or to others;
83
+ 19. Use for military purposes;
84
+ 20. Use to engage in any unauthorized or unlicensed professional activity, including but not limited to financial, legal, medical or healthcare, or other professional practice.
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-h3-community
4
+ license_link: LICENSE
5
+ base_model: FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree
6
+ library_name: uniserve
7
+ pipeline_tag: text-to-video
8
+ tags:
9
+ - text-to-video
10
+ - text-to-audio-video
11
+ - fastvideo
12
+ - fasth3
13
+ - nvfp4
14
+ - modelopt
15
+ - quantized
16
+ ---
17
+
18
+ # FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree-NVFP4
19
+
20
+ > This UniServe deployment checkpoint applies calibrated NVIDIA Model Optimizer NVFP4 W4A4 to the fused gate/up and down projections in all 50 H3 denoiser gated MLPs and to the qkv, attention-output, fused gate/up, and down projections in all 36 Video VAE decoder Transformer blocks; denoiser attention, the BF16 text encoder, token refiner, modulation, normalization, latent and conditioning boundaries, convolutions, residual/affine paths, and audio decoder remain BF16/FP32. Calibration used 1,000 prompts with complete four-forward denoising trajectories and deployment-distribution VAE decoding, ModelOpt commit `6a4b3f147e14a6fec690fedbced8df402344085d`, E2M1 values, K16 FP8 E4M3 block scales, FP32 tensor scales, and calibration-derived activation tensor scales.
21
+
22
+ This repository is a packed UniServe checkpoint derived from [FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree). It generates synchronized video and audio with four transformer forwards and retains the source checkpoint's VSA-H3 execution contract.
23
+
24
+ ## Run with UniServe
25
+
26
+ UniServe detects `modelopt_manifest.json` automatically and selects the only valid precision, `calibrated`. The packed checkpoint does not require NVIDIA Model Optimizer at deployment time.
27
+
28
+ ```bash
29
+ uniserve serve skx618/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree-NVFP4 \
30
+ --model-description minimax-h3 \
31
+ --served-model-name MiniMax-H3 \
32
+ --dtype bfloat16 \
33
+ --quantization-config '{"mode":"calibrated"}'
34
+ ```
35
+
36
+ The checkpoint was validated on four NVIDIA B200 GPUs. The GPU count must divide H3's 56 attention heads.
37
+
38
+ ## Validation status
39
+
40
+ Packed values and scales passed 39/39 projection conformance checks against ModelOpt fake quantization. Candidate A reduced measured end-to-end latency by 16.3–28.4% and peak aggregate GPU memory by 12.8–17.7% versus the BF16/FP16 reference over the fixed benchmark points. Same-seed metrics measure trajectory drift rather than absolute perceptual quality; the frozen blinded human review has not been completed, so this checkpoint is not claimed to be perceptually equivalent to the reference.
41
+
42
+ ## License
43
+
44
+ This derivative inherits the [MiniMax H3 Community License](LICENSE) and the source checkpoint's usage conditions.
audio_scheduler/scheduler_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Scheduler",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "shift": 3.0
5
+ }
audio_vae/config.json ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLMiniMaxH3Audio",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "encoder_dim": 64,
5
+ "encoder_rates": [
6
+ 2,
7
+ 4,
8
+ 4,
9
+ 5,
10
+ 5
11
+ ],
12
+ "latent_dim": 2048,
13
+ "latent_channels": 32,
14
+ "decoder_dim": 1024,
15
+ "decoder_rates": [
16
+ 5,
17
+ 5,
18
+ 2,
19
+ 2,
20
+ 2,
21
+ 2,
22
+ 2
23
+ ],
24
+ "decoder_kernel_sizes": [
25
+ 9,
26
+ 9,
27
+ 4,
28
+ 4,
29
+ 4,
30
+ 4,
31
+ 4
32
+ ],
33
+ "num_attention_heads": 8,
34
+ "resblock_kernel_sizes": [
35
+ 3,
36
+ 7,
37
+ 11
38
+ ],
39
+ "resblock_dilation_sizes": [
40
+ [
41
+ 1,
42
+ 3,
43
+ 5
44
+ ],
45
+ [
46
+ 1,
47
+ 3,
48
+ 5
49
+ ],
50
+ [
51
+ 1,
52
+ 3,
53
+ 5
54
+ ]
55
+ ],
56
+ "sampling_rate": 32000,
57
+ "latents_mean": [
58
+ -0.020211687488382354,
59
+ 0.3876466479950502,
60
+ -0.04398279799186767,
61
+ -0.28591514936373,
62
+ 0.08179686214561671,
63
+ -0.35782641352446604,
64
+ 0.040623809960919084,
65
+ -0.01552534501956604,
66
+ -0.223362481667332,
67
+ 0.1821006842509091,
68
+ 0.2941778783780663,
69
+ -0.07901167601970885,
70
+ -0.056815072777201,
71
+ -0.3699028221860095,
72
+ -0.31616315591624855,
73
+ 0.5905951377425391,
74
+ -0.052139568068853864,
75
+ 0.013673160263486295,
76
+ -0.03691647864630577,
77
+ 0.09732660653298163,
78
+ -0.3394662328788498,
79
+ -0.30685677538541667,
80
+ -0.24504598907458763,
81
+ -0.034698524462007344,
82
+ 0.02868032184767538,
83
+ -0.21217779266454084,
84
+ -0.1678263169941987,
85
+ 0.3221287889040614,
86
+ -0.1223055851554907,
87
+ 0.4356604928128464,
88
+ -0.0502599202236253,
89
+ 0.3979258376211797
90
+ ],
91
+ "latents_std": [
92
+ 1.6895524230479284,
93
+ 2.76263727217653,
94
+ 1.7945344281264435,
95
+ 1.6801681847309828,
96
+ 1.6390226546605453,
97
+ 2.7788298348882177,
98
+ 1.7659090095747236,
99
+ 1.6199757612137327,
100
+ 2.6336525640336896,
101
+ 1.8539356672817833,
102
+ 2.5056497896915633,
103
+ 1.811019237886178,
104
+ 1.9579657790720237,
105
+ 1.6685498243529284,
106
+ 1.4922469314453364,
107
+ 3.298670198067373,
108
+ 1.9491804496832168,
109
+ 1.8720003270431442,
110
+ 1.8334080103291832,
111
+ 1.6488070416529093,
112
+ 1.6176957696319716,
113
+ 1.9131449234774398,
114
+ 1.5695245398428617,
115
+ 1.6943659940415912,
116
+ 1.8318420762504692,
117
+ 1.5540637421583379,
118
+ 1.9344930328968526,
119
+ 1.599198216109855,
120
+ 1.718045989838149,
121
+ 1.6307219190837705,
122
+ 1.8661226051202384,
123
+ 1.5613768203168363
124
+ ]
125
+ }
checkpoint_content.json ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "aggregate_sha256": "b36987515e4c75fa4c7aaa632a7842c829ea141b235358a54d782b51230497b3",
3
+ "checkpoint_root": "/mnt/lustre/vlm-wlsaidhi/fastvideo/outputs/minimax_h3_dmd2_sp4_fsdp32_v10p5_datafree_mixed_vsa64/inference/checkpoint-1300",
4
+ "file_count": 18,
5
+ "files": [
6
+ {
7
+ "bytes": 9,
8
+ "path": ".complete",
9
+ "sha256": "37a40f08d8548dba289b9b0bb35bcf63b359f6d37ee86044ebc6b6da080b9ec1"
10
+ },
11
+ {
12
+ "bytes": 6167,
13
+ "path": "metadata.json",
14
+ "sha256": "dcad0fbee2a7c7e75e53435f4fd98fccf3138844883874edf057962ab48fa428"
15
+ },
16
+ {
17
+ "bytes": 546,
18
+ "path": "transformer/config.json",
19
+ "sha256": "74c11bff524336576096993cbfcdcdc2ef4fa2fa4409df693bdcbc6c666282ae"
20
+ },
21
+ {
22
+ "bytes": 5331008552,
23
+ "path": "transformer/diffusion_pytorch_model-00001-of-00014.safetensors",
24
+ "sha256": "d4563741673a7f95a1b54bcb952527f6452c4df63931da9cb67732c75290b4c3"
25
+ },
26
+ {
27
+ "bytes": 5318721256,
28
+ "path": "transformer/diffusion_pytorch_model-00002-of-00014.safetensors",
29
+ "sha256": "8920795048b28c1109f0c64bd357bd662d3651ac840ccc6e47746bf63e6903df"
30
+ },
31
+ {
32
+ "bytes": 5318721248,
33
+ "path": "transformer/diffusion_pytorch_model-00003-of-00014.safetensors",
34
+ "sha256": "15b4102c4bf16a46098df64a9fb14f756f59c5b6187ece71d4781da36d2ad85f"
35
+ },
36
+ {
37
+ "bytes": 4875566048,
38
+ "path": "transformer/diffusion_pytorch_model-00004-of-00014.safetensors",
39
+ "sha256": "793ce754a4185fd49da4684fb0ad439b387d2afae0e64320931a87d648549862"
40
+ },
41
+ {
42
+ "bytes": 5318505992,
43
+ "path": "transformer/diffusion_pytorch_model-00005-of-00014.safetensors",
44
+ "sha256": "b91266bb970e3c653e222b3a6be88f455a04dcba0a77fcb4b39a37e8b95631ef"
45
+ },
46
+ {
47
+ "bytes": 5164580688,
48
+ "path": "transformer/diffusion_pytorch_model-00006-of-00014.safetensors",
49
+ "sha256": "219cf3f31b51e336483dcd192613479854c536146aa0cf6a8d53ae0637145d23"
50
+ },
51
+ {
52
+ "bytes": 5318721240,
53
+ "path": "transformer/diffusion_pytorch_model-00007-of-00014.safetensors",
54
+ "sha256": "583020d48bf97bb872b581272fd992f11c0da4579b096764920f494a3ab406ce"
55
+ },
56
+ {
57
+ "bytes": 5318721248,
58
+ "path": "transformer/diffusion_pytorch_model-00008-of-00014.safetensors",
59
+ "sha256": "7edf1065d51a9c80c47ca23315081d76e5b282976cfef3ecd71b0fbe84a607ae"
60
+ },
61
+ {
62
+ "bytes": 4875566056,
63
+ "path": "transformer/diffusion_pytorch_model-00009-of-00014.safetensors",
64
+ "sha256": "dc9a291ef15c8a575d54888d50b408dbc26a0f6fe31ddb2914865d8d86501457"
65
+ },
66
+ {
67
+ "bytes": 5318505984,
68
+ "path": "transformer/diffusion_pytorch_model-00010-of-00014.safetensors",
69
+ "sha256": "10c1b817392968bc2a8817f51c91029cb9de1a96e27cfe99ac7181fa679bf1b4"
70
+ },
71
+ {
72
+ "bytes": 5164580688,
73
+ "path": "transformer/diffusion_pytorch_model-00011-of-00014.safetensors",
74
+ "sha256": "ba7a12ac11e63d801db7d34f7f8840bdbcd6594c54091b1780614c7d2f01767c"
75
+ },
76
+ {
77
+ "bytes": 5318721256,
78
+ "path": "transformer/diffusion_pytorch_model-00012-of-00014.safetensors",
79
+ "sha256": "cea2d272d196fd8dc9b812b3397d63bb9bc2dd7b92dfa7e22513d1463597a887"
80
+ },
81
+ {
82
+ "bytes": 5318721208,
83
+ "path": "transformer/diffusion_pytorch_model-00013-of-00014.safetensors",
84
+ "sha256": "efbbe1952958a7e9a31e956221aeb8bbd91761f03b29432034efed517c30577d"
85
+ },
86
+ {
87
+ "bytes": 2138941296,
88
+ "path": "transformer/diffusion_pytorch_model-00014-of-00014.safetensors",
89
+ "sha256": "c4c204080a1f7a29d7f65a2b9a54d3c41ad2d994028923804d28c29102c2b71c"
90
+ },
91
+ {
92
+ "bytes": 70079,
93
+ "path": "transformer/diffusion_pytorch_model.safetensors.index.json",
94
+ "sha256": "5be1367650e2faf79edf1f106a8354d1a7ef2e3ff45df40c4514b4ae97e1136b"
95
+ }
96
+ ],
97
+ "schema_version": "fastvideo-checkpoint-content-identity-v1",
98
+ "shard_count": 14
99
+ }
checkpoint_metadata.json ADDED
@@ -0,0 +1,204 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "base_model_dir": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
3
+ "config": {
4
+ "callbacks": {
5
+ "grad_clip": {
6
+ "_target_": "fastvideo.train.callbacks.grad_clip.GradNormClipCallback",
7
+ "max_grad_norm": 1.0
8
+ },
9
+ "latent_vis": {
10
+ "_target_": "fastvideo.train.callbacks.latent_vis.LatentVisCallback",
11
+ "every_steps": 100,
12
+ "fps": 24
13
+ },
14
+ "validation": {
15
+ "_target_": "fastvideo.train.callbacks.validation.ValidationCallback",
16
+ "dataset_file": "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/validation/heldout60.json",
17
+ "every_steps": 100,
18
+ "guidance_scale": 1.0,
19
+ "max_record_num_frames": 345,
20
+ "num_videos_per_prompt": 1,
21
+ "offload_training_state": true,
22
+ "pipeline_target": "fastvideo.pipelines.basic.minimax_h3.minimax_h3_pipeline.MiniMaxH3Pipeline",
23
+ "run_at_start": true,
24
+ "sampling_steps": [
25
+ 4
26
+ ],
27
+ "text_encoder_cpu_offload": true,
28
+ "use_record_dimensions": true,
29
+ "use_validation_media_conditioning": false,
30
+ "vae_cpu_offload": true
31
+ }
32
+ },
33
+ "method": {
34
+ "_target_": "fastvideo.train.methods.distribution_matching.dmd2.DMD2Method",
35
+ "cfg_uncond": {
36
+ "text": "zero"
37
+ },
38
+ "dmd_denoising_steps": [
39
+ 999,
40
+ 749,
41
+ 500,
42
+ 250
43
+ ],
44
+ "fake_score_betas": [
45
+ 0.9,
46
+ 0.999
47
+ ],
48
+ "fake_score_learning_rate": 2e-06,
49
+ "fake_score_loss_space": "x0",
50
+ "fake_score_lr_scheduler": "constant",
51
+ "generator_update_interval": 5,
52
+ "max_timestep_ratio": 0.999,
53
+ "min_timestep_ratio": 0.001,
54
+ "real_score_guidance_scale": 1.0,
55
+ "rollout_carry": true,
56
+ "rollout_carry_slots": 8,
57
+ "rollout_mode": "simulate",
58
+ "rollout_sample_type": "ode",
59
+ "score_timestep_shift": 2.4
60
+ },
61
+ "models": {
62
+ "critic": {
63
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
64
+ "attention_backend": "FLASH_ATTN",
65
+ "disable_custom_init_weights": true,
66
+ "enable_gradient_checkpointing_type": "full",
67
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
68
+ "trainable": true
69
+ },
70
+ "student": {
71
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
72
+ "attention_backend": "VIDEO_SPARSE_ATTN_H3",
73
+ "enable_gradient_checkpointing_type": "full",
74
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
75
+ "trainable": true
76
+ },
77
+ "teacher": {
78
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
79
+ "attention_backend": "FLASH_ATTN",
80
+ "disable_custom_init_weights": true,
81
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
82
+ "trainable": false
83
+ }
84
+ },
85
+ "pipeline": {
86
+ "dit_config": {
87
+ "uniform_parameter_dtype": false
88
+ }
89
+ },
90
+ "training": {
91
+ "checkpoint": {
92
+ "checkpointing_start_step": 100,
93
+ "checkpoints_total_limit": 3,
94
+ "inference_checkpoint_dtype": "bfloat16",
95
+ "inference_checkpoint_role": "student",
96
+ "output_dir": "/mnt/lustre/vlm-wlsaidhi/fastvideo/outputs/minimax_h3_dmd2_sp4_fsdp32_v10p5_datafree_mixed_vsa64",
97
+ "require_complete_training_checkpoint": true,
98
+ "resume_from_checkpoint": "latest",
99
+ "save_inference_checkpoint_on_validation": true,
100
+ "training_state_checkpointing_steps": 100
101
+ },
102
+ "data": {
103
+ "data_path": [
104
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_50k_720_mixed_len/data",
105
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_5s_768p/data",
106
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_10k_720_mixed_len/data",
107
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_10k_mixed_res_len/data",
108
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_fastgen_vidprom_150k/data"
109
+ ],
110
+ "dataloader_num_workers": 0,
111
+ "native_shape_bucketing": true,
112
+ "num_frames": 124,
113
+ "num_height": 768,
114
+ "num_latent_t": 37,
115
+ "num_width": 1344,
116
+ "preprocessed_data_type": "text_only",
117
+ "seed": 42,
118
+ "train_batch_size": 1,
119
+ "training_cfg_rate": 0.0
120
+ },
121
+ "distributed": {
122
+ "hsdp_replicate_dim": 1,
123
+ "hsdp_shard_dim": 32,
124
+ "num_gpus": 32,
125
+ "sp_size": 4,
126
+ "tp_size": 1
127
+ },
128
+ "dit_precision": "fp32",
129
+ "loop": {
130
+ "gradient_accumulation_steps": 8,
131
+ "max_train_steps": 4000
132
+ },
133
+ "model": {
134
+ "enable_gradient_checkpointing_type": "full",
135
+ "enable_torch_compile": true,
136
+ "precondition_outputs": false,
137
+ "torch_compile_kwargs": {
138
+ "dynamic": true,
139
+ "recompile_limit": 32
140
+ }
141
+ },
142
+ "optimizer": {
143
+ "betas": [
144
+ 0.9,
145
+ 0.999
146
+ ],
147
+ "learning_rate": 2e-06,
148
+ "lr_scheduler": "constant",
149
+ "lr_warmup_steps": 0,
150
+ "weight_decay": 0.01
151
+ },
152
+ "tracker": {
153
+ "project_name": "h3-dmd2-vsa",
154
+ "run_name": "dmd2_sp4_fsdp32_v10p5_datafree_mixed_vsa64"
155
+ },
156
+ "vsa": {
157
+ "sparsity": 0.9,
158
+ "tile_size": 64
159
+ }
160
+ }
161
+ },
162
+ "dtype": "bfloat16",
163
+ "format_version": 1,
164
+ "kind": "inference",
165
+ "max_shard_size_bytes": 5368709120,
166
+ "module": "transformer",
167
+ "role": "student",
168
+ "shard_count": 14,
169
+ "shard_file_sizes": [
170
+ 5331008552,
171
+ 5318721256,
172
+ 5318721248,
173
+ 4875566048,
174
+ 5318505992,
175
+ 5164580688,
176
+ 5318721240,
177
+ 5318721248,
178
+ 4875566056,
179
+ 5318505984,
180
+ 5164580688,
181
+ 5318721256,
182
+ 5318721208,
183
+ 2138941296
184
+ ],
185
+ "shard_sizes": [
186
+ 5331000320,
187
+ 5318715392,
188
+ 5318715392,
189
+ 4875560448,
190
+ 5318500352,
191
+ 5164574720,
192
+ 5318715392,
193
+ 5318715392,
194
+ 4875560448,
195
+ 5318500352,
196
+ 5164574720,
197
+ 5318715392,
198
+ 5318715392,
199
+ 2138938880
200
+ ],
201
+ "step": 1300,
202
+ "tensor_count": 688,
203
+ "total_size": 70099502592
204
+ }
fastvideo_inference.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": "fasth3-inference-contract-v1",
3
+ "model_id": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
4
+ "training_parent_run_id": "20260823T132231Z-v10p5-datafree-sp4",
5
+ "checkpoint_step": 1300,
6
+ "checkpoint_content_sha256": "b36987515e4c75fa4c7aaa632a7842c829ea141b235358a54d782b51230497b3",
7
+ "checkpoint_metadata_sha256": "dcad0fbee2a7c7e75e53435f4fd98fccf3138844883874edf057962ab48fa428",
8
+ "fastvideo_commit": "48a047c05ff4138f20cfa33351499c6ec5945f5d",
9
+ "task": "t2av",
10
+ "transformer_forwards": 4,
11
+ "num_inference_steps": 5,
12
+ "dmd_denoising_steps": [999, 749, 500, 250],
13
+ "guidance_scale": 1.0,
14
+ "attention_backend": "VIDEO_SPARSE_ATTN_H3",
15
+ "vsa_tile_size": 64,
16
+ "vsa_sparsity": 0.9,
17
+ "vsa_kernel": "sm100a",
18
+ "num_gpus": 4,
19
+ "sequence_parallel_size": 4,
20
+ "use_fsdp_inference": true,
21
+ "torch_compile": false
22
+ }
modelopt_manifest.json ADDED
@@ -0,0 +1,1280 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "calibration": {
3
+ "activation_block_scale": "runtime dynamic K16 encoding",
4
+ "activation_global_scale": "ModelOpt NVFP4 activation headroom calibration",
5
+ "denoising_forwards_per_record": 4,
6
+ "records": 1000,
7
+ "sample_sha256": "5baf06f8a8a811d4021efd4b372e984d3a8a5ea71912b150d80ace804046dd90",
8
+ "weight_scale": "static MSE, complete E4M3 scale sweep"
9
+ },
10
+ "components": {
11
+ "denoiser": {
12
+ "enabled": true,
13
+ "excluded_patterns": [
14
+ "attention",
15
+ "token_refiner",
16
+ "adaln",
17
+ "norm",
18
+ "latent_heads"
19
+ ],
20
+ "modules": {
21
+ "denoiser.transformer.layers.0.mlp.down": {
22
+ "activation_amax": 602.3152465820312
23
+ },
24
+ "denoiser.transformer.layers.0.mlp.gate_up.projections.gate": {
25
+ "activation_amax": 485.0114440917969
26
+ },
27
+ "denoiser.transformer.layers.0.mlp.gate_up.projections.up": {
28
+ "activation_amax": 485.0114440917969
29
+ },
30
+ "denoiser.transformer.layers.1.mlp.down": {
31
+ "activation_amax": 390.5531311035156
32
+ },
33
+ "denoiser.transformer.layers.1.mlp.gate_up.projections.gate": {
34
+ "activation_amax": 485.0114440917969
35
+ },
36
+ "denoiser.transformer.layers.1.mlp.gate_up.projections.up": {
37
+ "activation_amax": 485.0114440917969
38
+ },
39
+ "denoiser.transformer.layers.10.mlp.down": {
40
+ "activation_amax": 5254.6357421875
41
+ },
42
+ "denoiser.transformer.layers.10.mlp.gate_up.projections.gate": {
43
+ "activation_amax": 2743.63916015625
44
+ },
45
+ "denoiser.transformer.layers.10.mlp.gate_up.projections.up": {
46
+ "activation_amax": 2743.63916015625
47
+ },
48
+ "denoiser.transformer.layers.11.mlp.down": {
49
+ "activation_amax": 5855.6962890625
50
+ },
51
+ "denoiser.transformer.layers.11.mlp.gate_up.projections.gate": {
52
+ "activation_amax": 2743.63916015625
53
+ },
54
+ "denoiser.transformer.layers.11.mlp.gate_up.projections.up": {
55
+ "activation_amax": 2743.63916015625
56
+ },
57
+ "denoiser.transformer.layers.12.mlp.down": {
58
+ "activation_amax": 5855.6962890625
59
+ },
60
+ "denoiser.transformer.layers.12.mlp.gate_up.projections.gate": {
61
+ "activation_amax": 2743.63916015625
62
+ },
63
+ "denoiser.transformer.layers.12.mlp.gate_up.projections.up": {
64
+ "activation_amax": 2743.63916015625
65
+ },
66
+ "denoiser.transformer.layers.13.mlp.down": {
67
+ "activation_amax": 5855.6962890625
68
+ },
69
+ "denoiser.transformer.layers.13.mlp.gate_up.projections.gate": {
70
+ "activation_amax": 3057.47509765625
71
+ },
72
+ "denoiser.transformer.layers.13.mlp.gate_up.projections.up": {
73
+ "activation_amax": 3057.47509765625
74
+ },
75
+ "denoiser.transformer.layers.14.mlp.down": {
76
+ "activation_amax": 5254.6357421875
77
+ },
78
+ "denoiser.transformer.layers.14.mlp.gate_up.projections.gate": {
79
+ "activation_amax": 2743.63916015625
80
+ },
81
+ "denoiser.transformer.layers.14.mlp.gate_up.projections.up": {
82
+ "activation_amax": 2743.63916015625
83
+ },
84
+ "denoiser.transformer.layers.15.mlp.down": {
85
+ "activation_amax": 5855.6962890625
86
+ },
87
+ "denoiser.transformer.layers.15.mlp.gate_up.projections.gate": {
88
+ "activation_amax": 2743.63916015625
89
+ },
90
+ "denoiser.transformer.layers.15.mlp.gate_up.projections.up": {
91
+ "activation_amax": 2743.63916015625
92
+ },
93
+ "denoiser.transformer.layers.16.mlp.down": {
94
+ "activation_amax": 5855.6962890625
95
+ },
96
+ "denoiser.transformer.layers.16.mlp.gate_up.projections.gate": {
97
+ "activation_amax": 3407.209716796875
98
+ },
99
+ "denoiser.transformer.layers.16.mlp.gate_up.projections.up": {
100
+ "activation_amax": 3407.209716796875
101
+ },
102
+ "denoiser.transformer.layers.17.mlp.down": {
103
+ "activation_amax": 9030.7177734375
104
+ },
105
+ "denoiser.transformer.layers.17.mlp.gate_up.projections.gate": {
106
+ "activation_amax": 3057.47509765625
107
+ },
108
+ "denoiser.transformer.layers.17.mlp.gate_up.projections.up": {
109
+ "activation_amax": 3057.47509765625
110
+ },
111
+ "denoiser.transformer.layers.18.mlp.down": {
112
+ "activation_amax": 9030.7177734375
113
+ },
114
+ "denoiser.transformer.layers.18.mlp.gate_up.projections.gate": {
115
+ "activation_amax": 2743.63916015625
116
+ },
117
+ "denoiser.transformer.layers.18.mlp.gate_up.projections.up": {
118
+ "activation_amax": 2743.63916015625
119
+ },
120
+ "denoiser.transformer.layers.19.mlp.down": {
121
+ "activation_amax": 9030.7177734375
122
+ },
123
+ "denoiser.transformer.layers.19.mlp.gate_up.projections.gate": {
124
+ "activation_amax": 2743.63916015625
125
+ },
126
+ "denoiser.transformer.layers.19.mlp.gate_up.projections.up": {
127
+ "activation_amax": 2743.63916015625
128
+ },
129
+ "denoiser.transformer.layers.2.mlp.down": {
130
+ "activation_amax": 1779.0299072265625
131
+ },
132
+ "denoiser.transformer.layers.2.mlp.gate_up.projections.gate": {
133
+ "activation_amax": 928.8970947265625
134
+ },
135
+ "denoiser.transformer.layers.2.mlp.gate_up.projections.up": {
136
+ "activation_amax": 928.8970947265625
137
+ },
138
+ "denoiser.transformer.layers.20.mlp.down": {
139
+ "activation_amax": 10063.712890625
140
+ },
141
+ "denoiser.transformer.layers.20.mlp.gate_up.projections.gate": {
142
+ "activation_amax": 3057.47509765625
143
+ },
144
+ "denoiser.transformer.layers.20.mlp.gate_up.projections.up": {
145
+ "activation_amax": 3057.47509765625
146
+ },
147
+ "denoiser.transformer.layers.21.mlp.down": {
148
+ "activation_amax": 9030.7177734375
149
+ },
150
+ "denoiser.transformer.layers.21.mlp.gate_up.projections.gate": {
151
+ "activation_amax": 3057.47509765625
152
+ },
153
+ "denoiser.transformer.layers.21.mlp.gate_up.projections.up": {
154
+ "activation_amax": 3057.47509765625
155
+ },
156
+ "denoiser.transformer.layers.22.mlp.down": {
157
+ "activation_amax": 9030.7177734375
158
+ },
159
+ "denoiser.transformer.layers.22.mlp.gate_up.projections.gate": {
160
+ "activation_amax": 3407.209716796875
161
+ },
162
+ "denoiser.transformer.layers.22.mlp.gate_up.projections.up": {
163
+ "activation_amax": 3407.209716796875
164
+ },
165
+ "denoiser.transformer.layers.23.mlp.down": {
166
+ "activation_amax": 11214.8681640625
167
+ },
168
+ "denoiser.transformer.layers.23.mlp.gate_up.projections.gate": {
169
+ "activation_amax": 3407.209716796875
170
+ },
171
+ "denoiser.transformer.layers.23.mlp.gate_up.projections.up": {
172
+ "activation_amax": 3407.209716796875
173
+ },
174
+ "denoiser.transformer.layers.24.mlp.down": {
175
+ "activation_amax": 12497.7001953125
176
+ },
177
+ "denoiser.transformer.layers.24.mlp.gate_up.projections.gate": {
178
+ "activation_amax": 3796.94921875
179
+ },
180
+ "denoiser.transformer.layers.24.mlp.gate_up.projections.up": {
181
+ "activation_amax": 3796.94921875
182
+ },
183
+ "denoiser.transformer.layers.25.mlp.down": {
184
+ "activation_amax": 17295.69140625
185
+ },
186
+ "denoiser.transformer.layers.25.mlp.gate_up.projections.gate": {
187
+ "activation_amax": 3796.94921875
188
+ },
189
+ "denoiser.transformer.layers.25.mlp.gate_up.projections.up": {
190
+ "activation_amax": 3796.94921875
191
+ },
192
+ "denoiser.transformer.layers.26.mlp.down": {
193
+ "activation_amax": 21478.7890625
194
+ },
195
+ "denoiser.transformer.layers.26.mlp.gate_up.projections.gate": {
196
+ "activation_amax": 3796.94921875
197
+ },
198
+ "denoiser.transformer.layers.26.mlp.gate_up.projections.up": {
199
+ "activation_amax": 3796.94921875
200
+ },
201
+ "denoiser.transformer.layers.27.mlp.down": {
202
+ "activation_amax": 26673.6015625
203
+ },
204
+ "denoiser.transformer.layers.27.mlp.gate_up.projections.gate": {
205
+ "activation_amax": 4715.27099609375
206
+ },
207
+ "denoiser.transformer.layers.27.mlp.gate_up.projections.up": {
208
+ "activation_amax": 4715.27099609375
209
+ },
210
+ "denoiser.transformer.layers.28.mlp.down": {
211
+ "activation_amax": 45841.765625
212
+ },
213
+ "denoiser.transformer.layers.28.mlp.gate_up.projections.gate": {
214
+ "activation_amax": 4715.27099609375
215
+ },
216
+ "denoiser.transformer.layers.28.mlp.gate_up.projections.up": {
217
+ "activation_amax": 4715.27099609375
218
+ },
219
+ "denoiser.transformer.layers.29.mlp.down": {
220
+ "activation_amax": 51085.45703125
221
+ },
222
+ "denoiser.transformer.layers.29.mlp.gate_up.projections.gate": {
223
+ "activation_amax": 4715.27099609375
224
+ },
225
+ "denoiser.transformer.layers.29.mlp.gate_up.projections.up": {
226
+ "activation_amax": 4715.27099609375
227
+ },
228
+ "denoiser.transformer.layers.3.mlp.down": {
229
+ "activation_amax": 1596.4205322265625
230
+ },
231
+ "denoiser.transformer.layers.3.mlp.gate_up.projections.gate": {
232
+ "activation_amax": 833.550048828125
233
+ },
234
+ "denoiser.transformer.layers.3.mlp.gate_up.projections.up": {
235
+ "activation_amax": 833.550048828125
236
+ },
237
+ "denoiser.transformer.layers.30.mlp.down": {
238
+ "activation_amax": 70697.6640625
239
+ },
240
+ "denoiser.transformer.layers.30.mlp.gate_up.projections.gate": {
241
+ "activation_amax": 5254.6357421875
242
+ },
243
+ "denoiser.transformer.layers.30.mlp.gate_up.projections.up": {
244
+ "activation_amax": 5254.6357421875
245
+ },
246
+ "denoiser.transformer.layers.31.mlp.down": {
247
+ "activation_amax": 97839.203125
248
+ },
249
+ "denoiser.transformer.layers.31.mlp.gate_up.projections.gate": {
250
+ "activation_amax": 5254.6357421875
251
+ },
252
+ "denoiser.transformer.layers.31.mlp.gate_up.projections.up": {
253
+ "activation_amax": 5254.6357421875
254
+ },
255
+ "denoiser.transformer.layers.32.mlp.down": {
256
+ "activation_amax": 135400.640625
257
+ },
258
+ "denoiser.transformer.layers.32.mlp.gate_up.projections.gate": {
259
+ "activation_amax": 5855.6962890625
260
+ },
261
+ "denoiser.transformer.layers.32.mlp.gate_up.projections.up": {
262
+ "activation_amax": 5855.6962890625
263
+ },
264
+ "denoiser.transformer.layers.33.mlp.down": {
265
+ "activation_amax": 168148.34375
266
+ },
267
+ "denoiser.transformer.layers.33.mlp.gate_up.projections.gate": {
268
+ "activation_amax": 5855.6962890625
269
+ },
270
+ "denoiser.transformer.layers.33.mlp.gate_up.projections.up": {
271
+ "activation_amax": 5855.6962890625
272
+ },
273
+ "denoiser.transformer.layers.34.mlp.down": {
274
+ "activation_amax": 187382.28125
275
+ },
276
+ "denoiser.transformer.layers.34.mlp.gate_up.projections.gate": {
277
+ "activation_amax": 6525.51025390625
278
+ },
279
+ "denoiser.transformer.layers.34.mlp.gate_up.projections.up": {
280
+ "activation_amax": 6525.51025390625
281
+ },
282
+ "denoiser.transformer.layers.35.mlp.down": {
283
+ "activation_amax": 232702.140625
284
+ },
285
+ "denoiser.transformer.layers.35.mlp.gate_up.projections.gate": {
286
+ "activation_amax": 7271.94189453125
287
+ },
288
+ "denoiser.transformer.layers.35.mlp.gate_up.projections.up": {
289
+ "activation_amax": 7271.94189453125
290
+ },
291
+ "denoiser.transformer.layers.36.mlp.down": {
292
+ "activation_amax": 232702.140625
293
+ },
294
+ "denoiser.transformer.layers.36.mlp.gate_up.projections.gate": {
295
+ "activation_amax": 7271.94189453125
296
+ },
297
+ "denoiser.transformer.layers.36.mlp.gate_up.projections.up": {
298
+ "activation_amax": 7271.94189453125
299
+ },
300
+ "denoiser.transformer.layers.37.mlp.down": {
301
+ "activation_amax": 232702.140625
302
+ },
303
+ "denoiser.transformer.layers.37.mlp.gate_up.projections.gate": {
304
+ "activation_amax": 6525.51025390625
305
+ },
306
+ "denoiser.transformer.layers.37.mlp.gate_up.projections.up": {
307
+ "activation_amax": 6525.51025390625
308
+ },
309
+ "denoiser.transformer.layers.38.mlp.down": {
310
+ "activation_amax": 288982.96875
311
+ },
312
+ "denoiser.transformer.layers.38.mlp.gate_up.projections.gate": {
313
+ "activation_amax": 6525.51025390625
314
+ },
315
+ "denoiser.transformer.layers.38.mlp.gate_up.projections.up": {
316
+ "activation_amax": 6525.51025390625
317
+ },
318
+ "denoiser.transformer.layers.39.mlp.down": {
319
+ "activation_amax": 399926.40625
320
+ },
321
+ "denoiser.transformer.layers.39.mlp.gate_up.projections.gate": {
322
+ "activation_amax": 7271.94189453125
323
+ },
324
+ "denoiser.transformer.layers.39.mlp.gate_up.projections.up": {
325
+ "activation_amax": 7271.94189453125
326
+ },
327
+ "denoiser.transformer.layers.4.mlp.down": {
328
+ "activation_amax": 1432.55517578125
329
+ },
330
+ "denoiser.transformer.layers.4.mlp.gate_up.projections.gate": {
331
+ "activation_amax": 833.550048828125
332
+ },
333
+ "denoiser.transformer.layers.4.mlp.gate_up.projections.up": {
334
+ "activation_amax": 833.550048828125
335
+ },
336
+ "denoiser.transformer.layers.40.mlp.down": {
337
+ "activation_amax": 445672.6875
338
+ },
339
+ "denoiser.transformer.layers.40.mlp.gate_up.projections.gate": {
340
+ "activation_amax": 8103.755859375
341
+ },
342
+ "denoiser.transformer.layers.40.mlp.gate_up.projections.up": {
343
+ "activation_amax": 8103.755859375
344
+ },
345
+ "denoiser.transformer.layers.41.mlp.down": {
346
+ "activation_amax": 496651.71875
347
+ },
348
+ "denoiser.transformer.layers.41.mlp.gate_up.projections.gate": {
349
+ "activation_amax": 8103.755859375
350
+ },
351
+ "denoiser.transformer.layers.41.mlp.gate_up.projections.up": {
352
+ "activation_amax": 8103.755859375
353
+ },
354
+ "denoiser.transformer.layers.42.mlp.down": {
355
+ "activation_amax": 616770.8125
356
+ },
357
+ "denoiser.transformer.layers.42.mlp.gate_up.projections.gate": {
358
+ "activation_amax": 9030.7177734375
359
+ },
360
+ "denoiser.transformer.layers.42.mlp.gate_up.projections.up": {
361
+ "activation_amax": 9030.7177734375
362
+ },
363
+ "denoiser.transformer.layers.43.mlp.down": {
364
+ "activation_amax": 616770.8125
365
+ },
366
+ "denoiser.transformer.layers.43.mlp.gate_up.projections.gate": {
367
+ "activation_amax": 9030.7177734375
368
+ },
369
+ "denoiser.transformer.layers.43.mlp.gate_up.projections.up": {
370
+ "activation_amax": 9030.7177734375
371
+ },
372
+ "denoiser.transformer.layers.44.mlp.down": {
373
+ "activation_amax": 687321.25
374
+ },
375
+ "denoiser.transformer.layers.44.mlp.gate_up.projections.gate": {
376
+ "activation_amax": 10063.712890625
377
+ },
378
+ "denoiser.transformer.layers.44.mlp.gate_up.projections.up": {
379
+ "activation_amax": 10063.712890625
380
+ },
381
+ "denoiser.transformer.layers.45.mlp.down": {
382
+ "activation_amax": 853555.25
383
+ },
384
+ "denoiser.transformer.layers.45.mlp.gate_up.projections.gate": {
385
+ "activation_amax": 11214.8681640625
386
+ },
387
+ "denoiser.transformer.layers.45.mlp.gate_up.projections.up": {
388
+ "activation_amax": 11214.8681640625
389
+ },
390
+ "denoiser.transformer.layers.46.mlp.down": {
391
+ "activation_amax": 951190.625
392
+ },
393
+ "denoiser.transformer.layers.46.mlp.gate_up.projections.gate": {
394
+ "activation_amax": 12497.7001953125
395
+ },
396
+ "denoiser.transformer.layers.46.mlp.gate_up.projections.up": {
397
+ "activation_amax": 12497.7001953125
398
+ },
399
+ "denoiser.transformer.layers.47.mlp.down": {
400
+ "activation_amax": 1316362.125
401
+ },
402
+ "denoiser.transformer.layers.47.mlp.gate_up.projections.gate": {
403
+ "activation_amax": 13927.271484375
404
+ },
405
+ "denoiser.transformer.layers.47.mlp.gate_up.projections.up": {
406
+ "activation_amax": 13927.271484375
407
+ },
408
+ "denoiser.transformer.layers.48.mlp.down": {
409
+ "activation_amax": 2030107.875
410
+ },
411
+ "denoiser.transformer.layers.48.mlp.gate_up.projections.gate": {
412
+ "activation_amax": 17295.69140625
413
+ },
414
+ "denoiser.transformer.layers.48.mlp.gate_up.projections.up": {
415
+ "activation_amax": 17295.69140625
416
+ },
417
+ "denoiser.transformer.layers.49.mlp.down": {
418
+ "activation_amax": 2809486.5
419
+ },
420
+ "denoiser.transformer.layers.49.mlp.gate_up.projections.gate": {
421
+ "activation_amax": 19274.087890625
422
+ },
423
+ "denoiser.transformer.layers.49.mlp.gate_up.projections.up": {
424
+ "activation_amax": 19274.087890625
425
+ },
426
+ "denoiser.transformer.layers.5.mlp.down": {
427
+ "activation_amax": 5254.6357421875
428
+ },
429
+ "denoiser.transformer.layers.5.mlp.gate_up.projections.gate": {
430
+ "activation_amax": 2209.302001953125
431
+ },
432
+ "denoiser.transformer.layers.5.mlp.gate_up.projections.up": {
433
+ "activation_amax": 2209.302001953125
434
+ },
435
+ "denoiser.transformer.layers.6.mlp.down": {
436
+ "activation_amax": 5254.6357421875
437
+ },
438
+ "denoiser.transformer.layers.6.mlp.gate_up.projections.gate": {
439
+ "activation_amax": 2209.302001953125
440
+ },
441
+ "denoiser.transformer.layers.6.mlp.gate_up.projections.up": {
442
+ "activation_amax": 2209.302001953125
443
+ },
444
+ "denoiser.transformer.layers.7.mlp.down": {
445
+ "activation_amax": 4231.27001953125
446
+ },
447
+ "denoiser.transformer.layers.7.mlp.gate_up.projections.gate": {
448
+ "activation_amax": 2462.01708984375
449
+ },
450
+ "denoiser.transformer.layers.7.mlp.gate_up.projections.up": {
451
+ "activation_amax": 2462.01708984375
452
+ },
453
+ "denoiser.transformer.layers.8.mlp.down": {
454
+ "activation_amax": 5254.6357421875
455
+ },
456
+ "denoiser.transformer.layers.8.mlp.gate_up.projections.gate": {
457
+ "activation_amax": 2462.01708984375
458
+ },
459
+ "denoiser.transformer.layers.8.mlp.gate_up.projections.up": {
460
+ "activation_amax": 2462.01708984375
461
+ },
462
+ "denoiser.transformer.layers.9.mlp.down": {
463
+ "activation_amax": 5254.6357421875
464
+ },
465
+ "denoiser.transformer.layers.9.mlp.gate_up.projections.gate": {
466
+ "activation_amax": 2743.63916015625
467
+ },
468
+ "denoiser.transformer.layers.9.mlp.gate_up.projections.up": {
469
+ "activation_amax": 2743.63916015625
470
+ }
471
+ },
472
+ "quantized_patterns": [
473
+ "transformer_blocks.*.ff.net.0.proj",
474
+ "transformer_blocks.*.ff.net.2"
475
+ ]
476
+ },
477
+ "text_encoder": {
478
+ "enabled": false,
479
+ "excluded_patterns": [
480
+ "attention",
481
+ "embedding",
482
+ "norm",
483
+ "rope",
484
+ "softmax",
485
+ "checkpoint_layers.50:64",
486
+ "conditioning_output"
487
+ ],
488
+ "modules": {},
489
+ "quantized_patterns": [
490
+ "retained_layers.0:50.mlp.{gate,up,down}"
491
+ ]
492
+ },
493
+ "video_vae": {
494
+ "enabled": true,
495
+ "excluded_patterns": [
496
+ "post_quant_conv",
497
+ "decoder_boundaries",
498
+ "conv",
499
+ "norm",
500
+ "rope",
501
+ "softmax",
502
+ "residual",
503
+ "affine",
504
+ "pixel_postprocess"
505
+ ],
506
+ "modules": {
507
+ "video_decoder.decoder.decoder.decoder.layers.0.mlp.down": {
508
+ "activation_amax": 540.4903564453125
509
+ },
510
+ "video_decoder.decoder.decoder.decoder.layers.0.mlp.gate_up.projections.gate": {
511
+ "activation_amax": 3796.94921875
512
+ },
513
+ "video_decoder.decoder.decoder.decoder.layers.0.mlp.gate_up.projections.up": {
514
+ "activation_amax": 3796.94921875
515
+ },
516
+ "video_decoder.decoder.decoder.decoder.layers.0.output": {
517
+ "activation_amax": 4231.27001953125
518
+ },
519
+ "video_decoder.decoder.decoder.decoder.layers.0.qkv.projections.k": {
520
+ "activation_amax": 5855.6962890625
521
+ },
522
+ "video_decoder.decoder.decoder.decoder.layers.0.qkv.projections.q": {
523
+ "activation_amax": 5855.6962890625
524
+ },
525
+ "video_decoder.decoder.decoder.decoder.layers.0.qkv.projections.v": {
526
+ "activation_amax": 5855.6962890625
527
+ },
528
+ "video_decoder.decoder.decoder.decoder.layers.1.mlp.down": {
529
+ "activation_amax": 833.550048828125
530
+ },
531
+ "video_decoder.decoder.decoder.decoder.layers.1.mlp.gate_up.projections.gate": {
532
+ "activation_amax": 3057.47509765625
533
+ },
534
+ "video_decoder.decoder.decoder.decoder.layers.1.mlp.gate_up.projections.up": {
535
+ "activation_amax": 3057.47509765625
536
+ },
537
+ "video_decoder.decoder.decoder.decoder.layers.1.output": {
538
+ "activation_amax": 3407.209716796875
539
+ },
540
+ "video_decoder.decoder.decoder.decoder.layers.1.qkv.projections.k": {
541
+ "activation_amax": 3407.209716796875
542
+ },
543
+ "video_decoder.decoder.decoder.decoder.layers.1.qkv.projections.q": {
544
+ "activation_amax": 3407.209716796875
545
+ },
546
+ "video_decoder.decoder.decoder.decoder.layers.1.qkv.projections.v": {
547
+ "activation_amax": 3407.209716796875
548
+ },
549
+ "video_decoder.decoder.decoder.decoder.layers.10.mlp.down": {
550
+ "activation_amax": 1982.5272216796875
551
+ },
552
+ "video_decoder.decoder.decoder.decoder.layers.10.mlp.gate_up.projections.gate": {
553
+ "activation_amax": 9030.7177734375
554
+ },
555
+ "video_decoder.decoder.decoder.decoder.layers.10.mlp.gate_up.projections.up": {
556
+ "activation_amax": 9030.7177734375
557
+ },
558
+ "video_decoder.decoder.decoder.decoder.layers.10.output": {
559
+ "activation_amax": 4715.27099609375
560
+ },
561
+ "video_decoder.decoder.decoder.decoder.layers.10.qkv.projections.k": {
562
+ "activation_amax": 10063.712890625
563
+ },
564
+ "video_decoder.decoder.decoder.decoder.layers.10.qkv.projections.q": {
565
+ "activation_amax": 10063.712890625
566
+ },
567
+ "video_decoder.decoder.decoder.decoder.layers.10.qkv.projections.v": {
568
+ "activation_amax": 10063.712890625
569
+ },
570
+ "video_decoder.decoder.decoder.decoder.layers.11.mlp.down": {
571
+ "activation_amax": 1982.5272216796875
572
+ },
573
+ "video_decoder.decoder.decoder.decoder.layers.11.mlp.gate_up.projections.gate": {
574
+ "activation_amax": 9030.7177734375
575
+ },
576
+ "video_decoder.decoder.decoder.decoder.layers.11.mlp.gate_up.projections.up": {
577
+ "activation_amax": 9030.7177734375
578
+ },
579
+ "video_decoder.decoder.decoder.decoder.layers.11.output": {
580
+ "activation_amax": 4231.27001953125
581
+ },
582
+ "video_decoder.decoder.decoder.decoder.layers.11.qkv.projections.k": {
583
+ "activation_amax": 10063.712890625
584
+ },
585
+ "video_decoder.decoder.decoder.decoder.layers.11.qkv.projections.q": {
586
+ "activation_amax": 10063.712890625
587
+ },
588
+ "video_decoder.decoder.decoder.decoder.layers.11.qkv.projections.v": {
589
+ "activation_amax": 10063.712890625
590
+ },
591
+ "video_decoder.decoder.decoder.decoder.layers.12.mlp.down": {
592
+ "activation_amax": 1982.5272216796875
593
+ },
594
+ "video_decoder.decoder.decoder.decoder.layers.12.mlp.gate_up.projections.gate": {
595
+ "activation_amax": 9030.7177734375
596
+ },
597
+ "video_decoder.decoder.decoder.decoder.layers.12.mlp.gate_up.projections.up": {
598
+ "activation_amax": 9030.7177734375
599
+ },
600
+ "video_decoder.decoder.decoder.decoder.layers.12.output": {
601
+ "activation_amax": 3407.209716796875
602
+ },
603
+ "video_decoder.decoder.decoder.decoder.layers.12.qkv.projections.k": {
604
+ "activation_amax": 10063.712890625
605
+ },
606
+ "video_decoder.decoder.decoder.decoder.layers.12.qkv.projections.q": {
607
+ "activation_amax": 10063.712890625
608
+ },
609
+ "video_decoder.decoder.decoder.decoder.layers.12.qkv.projections.v": {
610
+ "activation_amax": 10063.712890625
611
+ },
612
+ "video_decoder.decoder.decoder.decoder.layers.13.mlp.down": {
613
+ "activation_amax": 1779.0299072265625
614
+ },
615
+ "video_decoder.decoder.decoder.decoder.layers.13.mlp.gate_up.projections.gate": {
616
+ "activation_amax": 9030.7177734375
617
+ },
618
+ "video_decoder.decoder.decoder.decoder.layers.13.mlp.gate_up.projections.up": {
619
+ "activation_amax": 9030.7177734375
620
+ },
621
+ "video_decoder.decoder.decoder.decoder.layers.13.output": {
622
+ "activation_amax": 3407.209716796875
623
+ },
624
+ "video_decoder.decoder.decoder.decoder.layers.13.qkv.projections.k": {
625
+ "activation_amax": 9030.7177734375
626
+ },
627
+ "video_decoder.decoder.decoder.decoder.layers.13.qkv.projections.q": {
628
+ "activation_amax": 9030.7177734375
629
+ },
630
+ "video_decoder.decoder.decoder.decoder.layers.13.qkv.projections.v": {
631
+ "activation_amax": 9030.7177734375
632
+ },
633
+ "video_decoder.decoder.decoder.decoder.layers.14.mlp.down": {
634
+ "activation_amax": 1779.0299072265625
635
+ },
636
+ "video_decoder.decoder.decoder.decoder.layers.14.mlp.gate_up.projections.gate": {
637
+ "activation_amax": 8103.755859375
638
+ },
639
+ "video_decoder.decoder.decoder.decoder.layers.14.mlp.gate_up.projections.up": {
640
+ "activation_amax": 8103.755859375
641
+ },
642
+ "video_decoder.decoder.decoder.decoder.layers.14.output": {
643
+ "activation_amax": 2743.63916015625
644
+ },
645
+ "video_decoder.decoder.decoder.decoder.layers.14.qkv.projections.k": {
646
+ "activation_amax": 9030.7177734375
647
+ },
648
+ "video_decoder.decoder.decoder.decoder.layers.14.qkv.projections.q": {
649
+ "activation_amax": 9030.7177734375
650
+ },
651
+ "video_decoder.decoder.decoder.decoder.layers.14.qkv.projections.v": {
652
+ "activation_amax": 9030.7177734375
653
+ },
654
+ "video_decoder.decoder.decoder.decoder.layers.15.mlp.down": {
655
+ "activation_amax": 1779.0299072265625
656
+ },
657
+ "video_decoder.decoder.decoder.decoder.layers.15.mlp.gate_up.projections.gate": {
658
+ "activation_amax": 8103.755859375
659
+ },
660
+ "video_decoder.decoder.decoder.decoder.layers.15.mlp.gate_up.projections.up": {
661
+ "activation_amax": 8103.755859375
662
+ },
663
+ "video_decoder.decoder.decoder.decoder.layers.15.output": {
664
+ "activation_amax": 2462.01708984375
665
+ },
666
+ "video_decoder.decoder.decoder.decoder.layers.15.qkv.projections.k": {
667
+ "activation_amax": 9030.7177734375
668
+ },
669
+ "video_decoder.decoder.decoder.decoder.layers.15.qkv.projections.q": {
670
+ "activation_amax": 9030.7177734375
671
+ },
672
+ "video_decoder.decoder.decoder.decoder.layers.15.qkv.projections.v": {
673
+ "activation_amax": 9030.7177734375
674
+ },
675
+ "video_decoder.decoder.decoder.decoder.layers.16.mlp.down": {
676
+ "activation_amax": 1596.4205322265625
677
+ },
678
+ "video_decoder.decoder.decoder.decoder.layers.16.mlp.gate_up.projections.gate": {
679
+ "activation_amax": 7271.94189453125
680
+ },
681
+ "video_decoder.decoder.decoder.decoder.layers.16.mlp.gate_up.projections.up": {
682
+ "activation_amax": 7271.94189453125
683
+ },
684
+ "video_decoder.decoder.decoder.decoder.layers.16.output": {
685
+ "activation_amax": 2743.63916015625
686
+ },
687
+ "video_decoder.decoder.decoder.decoder.layers.16.qkv.projections.k": {
688
+ "activation_amax": 8103.755859375
689
+ },
690
+ "video_decoder.decoder.decoder.decoder.layers.16.qkv.projections.q": {
691
+ "activation_amax": 8103.755859375
692
+ },
693
+ "video_decoder.decoder.decoder.decoder.layers.16.qkv.projections.v": {
694
+ "activation_amax": 8103.755859375
695
+ },
696
+ "video_decoder.decoder.decoder.decoder.layers.17.mlp.down": {
697
+ "activation_amax": 1432.55517578125
698
+ },
699
+ "video_decoder.decoder.decoder.decoder.layers.17.mlp.gate_up.projections.gate": {
700
+ "activation_amax": 7271.94189453125
701
+ },
702
+ "video_decoder.decoder.decoder.decoder.layers.17.mlp.gate_up.projections.up": {
703
+ "activation_amax": 7271.94189453125
704
+ },
705
+ "video_decoder.decoder.decoder.decoder.layers.17.output": {
706
+ "activation_amax": 1982.5272216796875
707
+ },
708
+ "video_decoder.decoder.decoder.decoder.layers.17.qkv.projections.k": {
709
+ "activation_amax": 7271.94189453125
710
+ },
711
+ "video_decoder.decoder.decoder.decoder.layers.17.qkv.projections.q": {
712
+ "activation_amax": 7271.94189453125
713
+ },
714
+ "video_decoder.decoder.decoder.decoder.layers.17.qkv.projections.v": {
715
+ "activation_amax": 7271.94189453125
716
+ },
717
+ "video_decoder.decoder.decoder.decoder.layers.18.mlp.down": {
718
+ "activation_amax": 1035.150634765625
719
+ },
720
+ "video_decoder.decoder.decoder.decoder.layers.18.mlp.gate_up.projections.gate": {
721
+ "activation_amax": 5855.6962890625
722
+ },
723
+ "video_decoder.decoder.decoder.decoder.layers.18.mlp.gate_up.projections.up": {
724
+ "activation_amax": 5855.6962890625
725
+ },
726
+ "video_decoder.decoder.decoder.decoder.layers.18.output": {
727
+ "activation_amax": 3407.209716796875
728
+ },
729
+ "video_decoder.decoder.decoder.decoder.layers.18.qkv.projections.k": {
730
+ "activation_amax": 6525.51025390625
731
+ },
732
+ "video_decoder.decoder.decoder.decoder.layers.18.qkv.projections.q": {
733
+ "activation_amax": 6525.51025390625
734
+ },
735
+ "video_decoder.decoder.decoder.decoder.layers.18.qkv.projections.v": {
736
+ "activation_amax": 6525.51025390625
737
+ },
738
+ "video_decoder.decoder.decoder.decoder.layers.19.mlp.down": {
739
+ "activation_amax": 833.550048828125
740
+ },
741
+ "video_decoder.decoder.decoder.decoder.layers.19.mlp.gate_up.projections.gate": {
742
+ "activation_amax": 5254.6357421875
743
+ },
744
+ "video_decoder.decoder.decoder.decoder.layers.19.mlp.gate_up.projections.up": {
745
+ "activation_amax": 5254.6357421875
746
+ },
747
+ "video_decoder.decoder.decoder.decoder.layers.19.output": {
748
+ "activation_amax": 5855.6962890625
749
+ },
750
+ "video_decoder.decoder.decoder.decoder.layers.19.qkv.projections.k": {
751
+ "activation_amax": 5855.6962890625
752
+ },
753
+ "video_decoder.decoder.decoder.decoder.layers.19.qkv.projections.q": {
754
+ "activation_amax": 5855.6962890625
755
+ },
756
+ "video_decoder.decoder.decoder.decoder.layers.19.qkv.projections.v": {
757
+ "activation_amax": 5855.6962890625
758
+ },
759
+ "video_decoder.decoder.decoder.decoder.layers.2.mlp.down": {
760
+ "activation_amax": 1153.55810546875
761
+ },
762
+ "video_decoder.decoder.decoder.decoder.layers.2.mlp.gate_up.projections.gate": {
763
+ "activation_amax": 4231.27001953125
764
+ },
765
+ "video_decoder.decoder.decoder.decoder.layers.2.mlp.gate_up.projections.up": {
766
+ "activation_amax": 4231.27001953125
767
+ },
768
+ "video_decoder.decoder.decoder.decoder.layers.2.output": {
769
+ "activation_amax": 2743.63916015625
770
+ },
771
+ "video_decoder.decoder.decoder.decoder.layers.2.qkv.projections.k": {
772
+ "activation_amax": 3407.209716796875
773
+ },
774
+ "video_decoder.decoder.decoder.decoder.layers.2.qkv.projections.q": {
775
+ "activation_amax": 3407.209716796875
776
+ },
777
+ "video_decoder.decoder.decoder.decoder.layers.2.qkv.projections.v": {
778
+ "activation_amax": 3407.209716796875
779
+ },
780
+ "video_decoder.decoder.decoder.decoder.layers.20.mlp.down": {
781
+ "activation_amax": 671.212158203125
782
+ },
783
+ "video_decoder.decoder.decoder.decoder.layers.20.mlp.gate_up.projections.gate": {
784
+ "activation_amax": 5254.6357421875
785
+ },
786
+ "video_decoder.decoder.decoder.decoder.layers.20.mlp.gate_up.projections.up": {
787
+ "activation_amax": 5254.6357421875
788
+ },
789
+ "video_decoder.decoder.decoder.decoder.layers.20.output": {
790
+ "activation_amax": 6525.51025390625
791
+ },
792
+ "video_decoder.decoder.decoder.decoder.layers.20.qkv.projections.k": {
793
+ "activation_amax": 5254.6357421875
794
+ },
795
+ "video_decoder.decoder.decoder.decoder.layers.20.qkv.projections.q": {
796
+ "activation_amax": 5254.6357421875
797
+ },
798
+ "video_decoder.decoder.decoder.decoder.layers.20.qkv.projections.v": {
799
+ "activation_amax": 5254.6357421875
800
+ },
801
+ "video_decoder.decoder.decoder.decoder.layers.21.mlp.down": {
802
+ "activation_amax": 540.4903564453125
803
+ },
804
+ "video_decoder.decoder.decoder.decoder.layers.21.mlp.gate_up.projections.gate": {
805
+ "activation_amax": 4715.27099609375
806
+ },
807
+ "video_decoder.decoder.decoder.decoder.layers.21.mlp.gate_up.projections.up": {
808
+ "activation_amax": 4715.27099609375
809
+ },
810
+ "video_decoder.decoder.decoder.decoder.layers.21.output": {
811
+ "activation_amax": 3407.209716796875
812
+ },
813
+ "video_decoder.decoder.decoder.decoder.layers.21.qkv.projections.k": {
814
+ "activation_amax": 4715.27099609375
815
+ },
816
+ "video_decoder.decoder.decoder.decoder.layers.21.qkv.projections.q": {
817
+ "activation_amax": 4715.27099609375
818
+ },
819
+ "video_decoder.decoder.decoder.decoder.layers.21.qkv.projections.v": {
820
+ "activation_amax": 4715.27099609375
821
+ },
822
+ "video_decoder.decoder.decoder.decoder.layers.22.mlp.down": {
823
+ "activation_amax": 390.5531311035156
824
+ },
825
+ "video_decoder.decoder.decoder.decoder.layers.22.mlp.gate_up.projections.gate": {
826
+ "activation_amax": 4231.27001953125
827
+ },
828
+ "video_decoder.decoder.decoder.decoder.layers.22.mlp.gate_up.projections.up": {
829
+ "activation_amax": 4231.27001953125
830
+ },
831
+ "video_decoder.decoder.decoder.decoder.layers.22.output": {
832
+ "activation_amax": 5855.6962890625
833
+ },
834
+ "video_decoder.decoder.decoder.decoder.layers.22.qkv.projections.k": {
835
+ "activation_amax": 4715.27099609375
836
+ },
837
+ "video_decoder.decoder.decoder.decoder.layers.22.qkv.projections.q": {
838
+ "activation_amax": 4715.27099609375
839
+ },
840
+ "video_decoder.decoder.decoder.decoder.layers.22.qkv.projections.v": {
841
+ "activation_amax": 4715.27099609375
842
+ },
843
+ "video_decoder.decoder.decoder.decoder.layers.23.mlp.down": {
844
+ "activation_amax": 390.5531311035156
845
+ },
846
+ "video_decoder.decoder.decoder.decoder.layers.23.mlp.gate_up.projections.gate": {
847
+ "activation_amax": 4231.27001953125
848
+ },
849
+ "video_decoder.decoder.decoder.decoder.layers.23.mlp.gate_up.projections.up": {
850
+ "activation_amax": 4231.27001953125
851
+ },
852
+ "video_decoder.decoder.decoder.decoder.layers.23.output": {
853
+ "activation_amax": 1432.55517578125
854
+ },
855
+ "video_decoder.decoder.decoder.decoder.layers.23.qkv.projections.k": {
856
+ "activation_amax": 4231.27001953125
857
+ },
858
+ "video_decoder.decoder.decoder.decoder.layers.23.qkv.projections.q": {
859
+ "activation_amax": 4231.27001953125
860
+ },
861
+ "video_decoder.decoder.decoder.decoder.layers.23.qkv.projections.v": {
862
+ "activation_amax": 4231.27001953125
863
+ },
864
+ "video_decoder.decoder.decoder.decoder.layers.24.mlp.down": {
865
+ "activation_amax": 390.5531311035156
866
+ },
867
+ "video_decoder.decoder.decoder.decoder.layers.24.mlp.gate_up.projections.gate": {
868
+ "activation_amax": 3796.94921875
869
+ },
870
+ "video_decoder.decoder.decoder.decoder.layers.24.mlp.gate_up.projections.up": {
871
+ "activation_amax": 3796.94921875
872
+ },
873
+ "video_decoder.decoder.decoder.decoder.layers.24.output": {
874
+ "activation_amax": 5254.6357421875
875
+ },
876
+ "video_decoder.decoder.decoder.decoder.layers.24.qkv.projections.k": {
877
+ "activation_amax": 4231.27001953125
878
+ },
879
+ "video_decoder.decoder.decoder.decoder.layers.24.qkv.projections.q": {
880
+ "activation_amax": 4231.27001953125
881
+ },
882
+ "video_decoder.decoder.decoder.decoder.layers.24.qkv.projections.v": {
883
+ "activation_amax": 4231.27001953125
884
+ },
885
+ "video_decoder.decoder.decoder.decoder.layers.25.mlp.down": {
886
+ "activation_amax": 1285.5098876953125
887
+ },
888
+ "video_decoder.decoder.decoder.decoder.layers.25.mlp.gate_up.projections.gate": {
889
+ "activation_amax": 3407.209716796875
890
+ },
891
+ "video_decoder.decoder.decoder.decoder.layers.25.mlp.gate_up.projections.up": {
892
+ "activation_amax": 3407.209716796875
893
+ },
894
+ "video_decoder.decoder.decoder.decoder.layers.25.output": {
895
+ "activation_amax": 1982.5272216796875
896
+ },
897
+ "video_decoder.decoder.decoder.decoder.layers.25.qkv.projections.k": {
898
+ "activation_amax": 3407.209716796875
899
+ },
900
+ "video_decoder.decoder.decoder.decoder.layers.25.qkv.projections.q": {
901
+ "activation_amax": 3407.209716796875
902
+ },
903
+ "video_decoder.decoder.decoder.decoder.layers.25.qkv.projections.v": {
904
+ "activation_amax": 3407.209716796875
905
+ },
906
+ "video_decoder.decoder.decoder.decoder.layers.26.mlp.down": {
907
+ "activation_amax": 350.4646301269531
908
+ },
909
+ "video_decoder.decoder.decoder.decoder.layers.26.mlp.gate_up.projections.gate": {
910
+ "activation_amax": 3407.209716796875
911
+ },
912
+ "video_decoder.decoder.decoder.decoder.layers.26.mlp.gate_up.projections.up": {
913
+ "activation_amax": 3407.209716796875
914
+ },
915
+ "video_decoder.decoder.decoder.decoder.layers.26.output": {
916
+ "activation_amax": 1982.5272216796875
917
+ },
918
+ "video_decoder.decoder.decoder.decoder.layers.26.qkv.projections.k": {
919
+ "activation_amax": 3407.209716796875
920
+ },
921
+ "video_decoder.decoder.decoder.decoder.layers.26.qkv.projections.q": {
922
+ "activation_amax": 3407.209716796875
923
+ },
924
+ "video_decoder.decoder.decoder.decoder.layers.26.qkv.projections.v": {
925
+ "activation_amax": 3407.209716796875
926
+ },
927
+ "video_decoder.decoder.decoder.decoder.layers.27.mlp.down": {
928
+ "activation_amax": 350.4646301269531
929
+ },
930
+ "video_decoder.decoder.decoder.decoder.layers.27.mlp.gate_up.projections.gate": {
931
+ "activation_amax": 3407.209716796875
932
+ },
933
+ "video_decoder.decoder.decoder.decoder.layers.27.mlp.gate_up.projections.up": {
934
+ "activation_amax": 3407.209716796875
935
+ },
936
+ "video_decoder.decoder.decoder.decoder.layers.27.output": {
937
+ "activation_amax": 4715.27099609375
938
+ },
939
+ "video_decoder.decoder.decoder.decoder.layers.27.qkv.projections.k": {
940
+ "activation_amax": 3407.209716796875
941
+ },
942
+ "video_decoder.decoder.decoder.decoder.layers.27.qkv.projections.q": {
943
+ "activation_amax": 3407.209716796875
944
+ },
945
+ "video_decoder.decoder.decoder.decoder.layers.27.qkv.projections.v": {
946
+ "activation_amax": 3407.209716796875
947
+ },
948
+ "video_decoder.decoder.decoder.decoder.layers.28.mlp.down": {
949
+ "activation_amax": 314.49102783203125
950
+ },
951
+ "video_decoder.decoder.decoder.decoder.layers.28.mlp.gate_up.projections.gate": {
952
+ "activation_amax": 3407.209716796875
953
+ },
954
+ "video_decoder.decoder.decoder.decoder.layers.28.mlp.gate_up.projections.up": {
955
+ "activation_amax": 3407.209716796875
956
+ },
957
+ "video_decoder.decoder.decoder.decoder.layers.28.output": {
958
+ "activation_amax": 747.9899291992188
959
+ },
960
+ "video_decoder.decoder.decoder.decoder.layers.28.qkv.projections.k": {
961
+ "activation_amax": 3057.47509765625
962
+ },
963
+ "video_decoder.decoder.decoder.decoder.layers.28.qkv.projections.q": {
964
+ "activation_amax": 3057.47509765625
965
+ },
966
+ "video_decoder.decoder.decoder.decoder.layers.28.qkv.projections.v": {
967
+ "activation_amax": 3057.47509765625
968
+ },
969
+ "video_decoder.decoder.decoder.decoder.layers.29.mlp.down": {
970
+ "activation_amax": 350.4646301269531
971
+ },
972
+ "video_decoder.decoder.decoder.decoder.layers.29.mlp.gate_up.projections.gate": {
973
+ "activation_amax": 3407.209716796875
974
+ },
975
+ "video_decoder.decoder.decoder.decoder.layers.29.mlp.gate_up.projections.up": {
976
+ "activation_amax": 3407.209716796875
977
+ },
978
+ "video_decoder.decoder.decoder.decoder.layers.29.output": {
979
+ "activation_amax": 1035.150634765625
980
+ },
981
+ "video_decoder.decoder.decoder.decoder.layers.29.qkv.projections.k": {
982
+ "activation_amax": 3057.47509765625
983
+ },
984
+ "video_decoder.decoder.decoder.decoder.layers.29.qkv.projections.q": {
985
+ "activation_amax": 3057.47509765625
986
+ },
987
+ "video_decoder.decoder.decoder.decoder.layers.29.qkv.projections.v": {
988
+ "activation_amax": 3057.47509765625
989
+ },
990
+ "video_decoder.decoder.decoder.decoder.layers.3.mlp.down": {
991
+ "activation_amax": 1035.150634765625
992
+ },
993
+ "video_decoder.decoder.decoder.decoder.layers.3.mlp.gate_up.projections.gate": {
994
+ "activation_amax": 4715.27099609375
995
+ },
996
+ "video_decoder.decoder.decoder.decoder.layers.3.mlp.gate_up.projections.up": {
997
+ "activation_amax": 4715.27099609375
998
+ },
999
+ "video_decoder.decoder.decoder.decoder.layers.3.output": {
1000
+ "activation_amax": 2209.302001953125
1001
+ },
1002
+ "video_decoder.decoder.decoder.decoder.layers.3.qkv.projections.k": {
1003
+ "activation_amax": 4715.27099609375
1004
+ },
1005
+ "video_decoder.decoder.decoder.decoder.layers.3.qkv.projections.q": {
1006
+ "activation_amax": 4715.27099609375
1007
+ },
1008
+ "video_decoder.decoder.decoder.decoder.layers.3.qkv.projections.v": {
1009
+ "activation_amax": 4715.27099609375
1010
+ },
1011
+ "video_decoder.decoder.decoder.decoder.layers.30.mlp.down": {
1012
+ "activation_amax": 1779.0299072265625
1013
+ },
1014
+ "video_decoder.decoder.decoder.decoder.layers.30.mlp.gate_up.projections.gate": {
1015
+ "activation_amax": 3407.209716796875
1016
+ },
1017
+ "video_decoder.decoder.decoder.decoder.layers.30.mlp.gate_up.projections.up": {
1018
+ "activation_amax": 3407.209716796875
1019
+ },
1020
+ "video_decoder.decoder.decoder.decoder.layers.30.output": {
1021
+ "activation_amax": 1285.5098876953125
1022
+ },
1023
+ "video_decoder.decoder.decoder.decoder.layers.30.qkv.projections.k": {
1024
+ "activation_amax": 3057.47509765625
1025
+ },
1026
+ "video_decoder.decoder.decoder.decoder.layers.30.qkv.projections.q": {
1027
+ "activation_amax": 3057.47509765625
1028
+ },
1029
+ "video_decoder.decoder.decoder.decoder.layers.30.qkv.projections.v": {
1030
+ "activation_amax": 3057.47509765625
1031
+ },
1032
+ "video_decoder.decoder.decoder.decoder.layers.31.mlp.down": {
1033
+ "activation_amax": 1285.5098876953125
1034
+ },
1035
+ "video_decoder.decoder.decoder.decoder.layers.31.mlp.gate_up.projections.gate": {
1036
+ "activation_amax": 1285.5098876953125
1037
+ },
1038
+ "video_decoder.decoder.decoder.decoder.layers.31.mlp.gate_up.projections.up": {
1039
+ "activation_amax": 1285.5098876953125
1040
+ },
1041
+ "video_decoder.decoder.decoder.decoder.layers.31.output": {
1042
+ "activation_amax": 3407.209716796875
1043
+ },
1044
+ "video_decoder.decoder.decoder.decoder.layers.31.qkv.projections.k": {
1045
+ "activation_amax": 1285.5098876953125
1046
+ },
1047
+ "video_decoder.decoder.decoder.decoder.layers.31.qkv.projections.q": {
1048
+ "activation_amax": 1285.5098876953125
1049
+ },
1050
+ "video_decoder.decoder.decoder.decoder.layers.31.qkv.projections.v": {
1051
+ "activation_amax": 1285.5098876953125
1052
+ },
1053
+ "video_decoder.decoder.decoder.decoder.layers.32.mlp.down": {
1054
+ "activation_amax": 1596.4205322265625
1055
+ },
1056
+ "video_decoder.decoder.decoder.decoder.layers.32.mlp.gate_up.projections.gate": {
1057
+ "activation_amax": 1285.5098876953125
1058
+ },
1059
+ "video_decoder.decoder.decoder.decoder.layers.32.mlp.gate_up.projections.up": {
1060
+ "activation_amax": 1285.5098876953125
1061
+ },
1062
+ "video_decoder.decoder.decoder.decoder.layers.32.output": {
1063
+ "activation_amax": 3796.94921875
1064
+ },
1065
+ "video_decoder.decoder.decoder.decoder.layers.32.qkv.projections.k": {
1066
+ "activation_amax": 1153.55810546875
1067
+ },
1068
+ "video_decoder.decoder.decoder.decoder.layers.32.qkv.projections.q": {
1069
+ "activation_amax": 1153.55810546875
1070
+ },
1071
+ "video_decoder.decoder.decoder.decoder.layers.32.qkv.projections.v": {
1072
+ "activation_amax": 1153.55810546875
1073
+ },
1074
+ "video_decoder.decoder.decoder.decoder.layers.33.mlp.down": {
1075
+ "activation_amax": 1779.0299072265625
1076
+ },
1077
+ "video_decoder.decoder.decoder.decoder.layers.33.mlp.gate_up.projections.gate": {
1078
+ "activation_amax": 1153.55810546875
1079
+ },
1080
+ "video_decoder.decoder.decoder.decoder.layers.33.mlp.gate_up.projections.up": {
1081
+ "activation_amax": 1153.55810546875
1082
+ },
1083
+ "video_decoder.decoder.decoder.decoder.layers.33.output": {
1084
+ "activation_amax": 4715.27099609375
1085
+ },
1086
+ "video_decoder.decoder.decoder.decoder.layers.33.qkv.projections.k": {
1087
+ "activation_amax": 1035.150634765625
1088
+ },
1089
+ "video_decoder.decoder.decoder.decoder.layers.33.qkv.projections.q": {
1090
+ "activation_amax": 1035.150634765625
1091
+ },
1092
+ "video_decoder.decoder.decoder.decoder.layers.33.qkv.projections.v": {
1093
+ "activation_amax": 1035.150634765625
1094
+ },
1095
+ "video_decoder.decoder.decoder.decoder.layers.34.mlp.down": {
1096
+ "activation_amax": 1779.0299072265625
1097
+ },
1098
+ "video_decoder.decoder.decoder.decoder.layers.34.mlp.gate_up.projections.gate": {
1099
+ "activation_amax": 928.8970947265625
1100
+ },
1101
+ "video_decoder.decoder.decoder.decoder.layers.34.mlp.gate_up.projections.up": {
1102
+ "activation_amax": 928.8970947265625
1103
+ },
1104
+ "video_decoder.decoder.decoder.decoder.layers.34.output": {
1105
+ "activation_amax": 3407.209716796875
1106
+ },
1107
+ "video_decoder.decoder.decoder.decoder.layers.34.qkv.projections.k": {
1108
+ "activation_amax": 928.8970947265625
1109
+ },
1110
+ "video_decoder.decoder.decoder.decoder.layers.34.qkv.projections.q": {
1111
+ "activation_amax": 928.8970947265625
1112
+ },
1113
+ "video_decoder.decoder.decoder.decoder.layers.34.qkv.projections.v": {
1114
+ "activation_amax": 928.8970947265625
1115
+ },
1116
+ "video_decoder.decoder.decoder.decoder.layers.35.mlp.down": {
1117
+ "activation_amax": 2462.01708984375
1118
+ },
1119
+ "video_decoder.decoder.decoder.decoder.layers.35.mlp.gate_up.projections.gate": {
1120
+ "activation_amax": 833.550048828125
1121
+ },
1122
+ "video_decoder.decoder.decoder.decoder.layers.35.mlp.gate_up.projections.up": {
1123
+ "activation_amax": 833.550048828125
1124
+ },
1125
+ "video_decoder.decoder.decoder.decoder.layers.35.output": {
1126
+ "activation_amax": 4231.27001953125
1127
+ },
1128
+ "video_decoder.decoder.decoder.decoder.layers.35.qkv.projections.k": {
1129
+ "activation_amax": 833.550048828125
1130
+ },
1131
+ "video_decoder.decoder.decoder.decoder.layers.35.qkv.projections.q": {
1132
+ "activation_amax": 833.550048828125
1133
+ },
1134
+ "video_decoder.decoder.decoder.decoder.layers.35.qkv.projections.v": {
1135
+ "activation_amax": 833.550048828125
1136
+ },
1137
+ "video_decoder.decoder.decoder.decoder.layers.4.mlp.down": {
1138
+ "activation_amax": 1153.55810546875
1139
+ },
1140
+ "video_decoder.decoder.decoder.decoder.layers.4.mlp.gate_up.projections.gate": {
1141
+ "activation_amax": 5254.6357421875
1142
+ },
1143
+ "video_decoder.decoder.decoder.decoder.layers.4.mlp.gate_up.projections.up": {
1144
+ "activation_amax": 5254.6357421875
1145
+ },
1146
+ "video_decoder.decoder.decoder.decoder.layers.4.output": {
1147
+ "activation_amax": 1779.0299072265625
1148
+ },
1149
+ "video_decoder.decoder.decoder.decoder.layers.4.qkv.projections.k": {
1150
+ "activation_amax": 5254.6357421875
1151
+ },
1152
+ "video_decoder.decoder.decoder.decoder.layers.4.qkv.projections.q": {
1153
+ "activation_amax": 5254.6357421875
1154
+ },
1155
+ "video_decoder.decoder.decoder.decoder.layers.4.qkv.projections.v": {
1156
+ "activation_amax": 5254.6357421875
1157
+ },
1158
+ "video_decoder.decoder.decoder.decoder.layers.5.mlp.down": {
1159
+ "activation_amax": 1432.55517578125
1160
+ },
1161
+ "video_decoder.decoder.decoder.decoder.layers.5.mlp.gate_up.projections.gate": {
1162
+ "activation_amax": 5855.6962890625
1163
+ },
1164
+ "video_decoder.decoder.decoder.decoder.layers.5.mlp.gate_up.projections.up": {
1165
+ "activation_amax": 5855.6962890625
1166
+ },
1167
+ "video_decoder.decoder.decoder.decoder.layers.5.output": {
1168
+ "activation_amax": 2209.302001953125
1169
+ },
1170
+ "video_decoder.decoder.decoder.decoder.layers.5.qkv.projections.k": {
1171
+ "activation_amax": 6525.51025390625
1172
+ },
1173
+ "video_decoder.decoder.decoder.decoder.layers.5.qkv.projections.q": {
1174
+ "activation_amax": 6525.51025390625
1175
+ },
1176
+ "video_decoder.decoder.decoder.decoder.layers.5.qkv.projections.v": {
1177
+ "activation_amax": 6525.51025390625
1178
+ },
1179
+ "video_decoder.decoder.decoder.decoder.layers.6.mlp.down": {
1180
+ "activation_amax": 1596.4205322265625
1181
+ },
1182
+ "video_decoder.decoder.decoder.decoder.layers.6.mlp.gate_up.projections.gate": {
1183
+ "activation_amax": 6525.51025390625
1184
+ },
1185
+ "video_decoder.decoder.decoder.decoder.layers.6.mlp.gate_up.projections.up": {
1186
+ "activation_amax": 6525.51025390625
1187
+ },
1188
+ "video_decoder.decoder.decoder.decoder.layers.6.output": {
1189
+ "activation_amax": 3057.47509765625
1190
+ },
1191
+ "video_decoder.decoder.decoder.decoder.layers.6.qkv.projections.k": {
1192
+ "activation_amax": 7271.94189453125
1193
+ },
1194
+ "video_decoder.decoder.decoder.decoder.layers.6.qkv.projections.q": {
1195
+ "activation_amax": 7271.94189453125
1196
+ },
1197
+ "video_decoder.decoder.decoder.decoder.layers.6.qkv.projections.v": {
1198
+ "activation_amax": 7271.94189453125
1199
+ },
1200
+ "video_decoder.decoder.decoder.decoder.layers.7.mlp.down": {
1201
+ "activation_amax": 1596.4205322265625
1202
+ },
1203
+ "video_decoder.decoder.decoder.decoder.layers.7.mlp.gate_up.projections.gate": {
1204
+ "activation_amax": 7271.94189453125
1205
+ },
1206
+ "video_decoder.decoder.decoder.decoder.layers.7.mlp.gate_up.projections.up": {
1207
+ "activation_amax": 7271.94189453125
1208
+ },
1209
+ "video_decoder.decoder.decoder.decoder.layers.7.output": {
1210
+ "activation_amax": 3057.47509765625
1211
+ },
1212
+ "video_decoder.decoder.decoder.decoder.layers.7.qkv.projections.k": {
1213
+ "activation_amax": 8103.755859375
1214
+ },
1215
+ "video_decoder.decoder.decoder.decoder.layers.7.qkv.projections.q": {
1216
+ "activation_amax": 8103.755859375
1217
+ },
1218
+ "video_decoder.decoder.decoder.decoder.layers.7.qkv.projections.v": {
1219
+ "activation_amax": 8103.755859375
1220
+ },
1221
+ "video_decoder.decoder.decoder.decoder.layers.8.mlp.down": {
1222
+ "activation_amax": 1779.0299072265625
1223
+ },
1224
+ "video_decoder.decoder.decoder.decoder.layers.8.mlp.gate_up.projections.gate": {
1225
+ "activation_amax": 8103.755859375
1226
+ },
1227
+ "video_decoder.decoder.decoder.decoder.layers.8.mlp.gate_up.projections.up": {
1228
+ "activation_amax": 8103.755859375
1229
+ },
1230
+ "video_decoder.decoder.decoder.decoder.layers.8.output": {
1231
+ "activation_amax": 3796.94921875
1232
+ },
1233
+ "video_decoder.decoder.decoder.decoder.layers.8.qkv.projections.k": {
1234
+ "activation_amax": 9030.7177734375
1235
+ },
1236
+ "video_decoder.decoder.decoder.decoder.layers.8.qkv.projections.q": {
1237
+ "activation_amax": 9030.7177734375
1238
+ },
1239
+ "video_decoder.decoder.decoder.decoder.layers.8.qkv.projections.v": {
1240
+ "activation_amax": 9030.7177734375
1241
+ },
1242
+ "video_decoder.decoder.decoder.decoder.layers.9.mlp.down": {
1243
+ "activation_amax": 1982.5272216796875
1244
+ },
1245
+ "video_decoder.decoder.decoder.decoder.layers.9.mlp.gate_up.projections.gate": {
1246
+ "activation_amax": 8103.755859375
1247
+ },
1248
+ "video_decoder.decoder.decoder.decoder.layers.9.mlp.gate_up.projections.up": {
1249
+ "activation_amax": 8103.755859375
1250
+ },
1251
+ "video_decoder.decoder.decoder.decoder.layers.9.output": {
1252
+ "activation_amax": 3407.209716796875
1253
+ },
1254
+ "video_decoder.decoder.decoder.decoder.layers.9.qkv.projections.k": {
1255
+ "activation_amax": 9030.7177734375
1256
+ },
1257
+ "video_decoder.decoder.decoder.decoder.layers.9.qkv.projections.q": {
1258
+ "activation_amax": 9030.7177734375
1259
+ },
1260
+ "video_decoder.decoder.decoder.decoder.layers.9.qkv.projections.v": {
1261
+ "activation_amax": 9030.7177734375
1262
+ }
1263
+ },
1264
+ "quantized_patterns": [
1265
+ "decoder.transformer_blocks.*.{q,k,v,out,gate,up,down}"
1266
+ ]
1267
+ }
1268
+ },
1269
+ "modelopt_commit": "6a4b3f147e14a6fec690fedbced8df402344085d",
1270
+ "numerical_format": {
1271
+ "activation": "a4",
1272
+ "block_scale": "fp8_e4m3",
1273
+ "block_size": 16,
1274
+ "output": "bf16",
1275
+ "tensor_scale": "fp32",
1276
+ "values": "e2m1",
1277
+ "weight": "w4"
1278
+ },
1279
+ "schema_version": 1
1280
+ }
modular_model_index.json ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3ModularPipeline",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "_blocks_class_name": "MiniMaxH3Blocks",
5
+ "text_encoder": [
6
+ "transformers",
7
+ "Qwen3VLForConditionalGeneration",
8
+ {
9
+ "type_hint": [
10
+ "transformers",
11
+ "Qwen3VLForConditionalGeneration"
12
+ ],
13
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
14
+ "subfolder": "text_encoder",
15
+ "variant": null,
16
+ "revision": null
17
+ }
18
+ ],
19
+ "tokenizer": [
20
+ "transformers",
21
+ "Qwen2TokenizerFast",
22
+ {
23
+ "type_hint": [
24
+ "transformers",
25
+ "Qwen2TokenizerFast"
26
+ ],
27
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
28
+ "subfolder": "tokenizer",
29
+ "variant": null,
30
+ "revision": null
31
+ }
32
+ ],
33
+ "processor": [
34
+ "transformers",
35
+ "Qwen3VLProcessor",
36
+ {
37
+ "type_hint": [
38
+ "transformers",
39
+ "Qwen3VLProcessor"
40
+ ],
41
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
42
+ "subfolder": "processor",
43
+ "variant": null,
44
+ "revision": null
45
+ }
46
+ ],
47
+ "vae": [
48
+ "diffusers",
49
+ "AutoencoderKLMiniMaxH3",
50
+ {
51
+ "type_hint": [
52
+ "diffusers",
53
+ "AutoencoderKLMiniMaxH3"
54
+ ],
55
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
56
+ "subfolder": "vae",
57
+ "variant": null,
58
+ "revision": null
59
+ }
60
+ ],
61
+ "audio_vae": [
62
+ "diffusers",
63
+ "AutoencoderKLMiniMaxH3Audio",
64
+ {
65
+ "type_hint": [
66
+ "diffusers",
67
+ "AutoencoderKLMiniMaxH3Audio"
68
+ ],
69
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
70
+ "subfolder": "audio_vae",
71
+ "variant": null,
72
+ "revision": null
73
+ }
74
+ ],
75
+ "transformer": [
76
+ "diffusers",
77
+ "MiniMaxH3Transformer3DModel",
78
+ {
79
+ "type_hint": [
80
+ "diffusers",
81
+ "MiniMaxH3Transformer3DModel"
82
+ ],
83
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
84
+ "subfolder": "transformer",
85
+ "variant": null,
86
+ "revision": null
87
+ }
88
+ ],
89
+ "transformer_ref": [
90
+ "diffusers",
91
+ "MiniMaxH3Transformer3DModel",
92
+ {
93
+ "type_hint": [
94
+ "diffusers",
95
+ "MiniMaxH3Transformer3DModel"
96
+ ],
97
+ "pretrained_model_name_or_path": "MiniMaxAI/MiniMax-H3",
98
+ "subfolder": "transformer_ref",
99
+ "variant": null,
100
+ "revision": null
101
+ }
102
+ ],
103
+ "scheduler": [
104
+ "diffusers",
105
+ "MiniMaxH3Scheduler",
106
+ {
107
+ "type_hint": [
108
+ "diffusers",
109
+ "MiniMaxH3Scheduler"
110
+ ],
111
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
112
+ "subfolder": "scheduler",
113
+ "variant": null,
114
+ "revision": null
115
+ }
116
+ ],
117
+ "audio_scheduler": [
118
+ "diffusers",
119
+ "MiniMaxH3Scheduler",
120
+ {
121
+ "type_hint": [
122
+ "diffusers",
123
+ "MiniMaxH3Scheduler"
124
+ ],
125
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
126
+ "subfolder": "audio_scheduler",
127
+ "variant": null,
128
+ "revision": null
129
+ }
130
+ ]
131
+ }
processor/chat_template.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n"
3
+ }
processor/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
processor/preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 16777216,
4
+ "shortest_edge": 65536
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "image_processor_type": "Qwen2VLImageProcessorFast"
21
+ }
processor/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
processor/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
processor/video_preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 25165824,
4
+ "shortest_edge": 4096
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "video_processor_type": "Qwen3VLVideoProcessor"
21
+ }
processor/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
provenance.json ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": "fasth3-checkpoint-provenance-v1",
3
+ "model_id": "FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree",
4
+ "base_model": "hf://MiniMaxAI/MiniMax-H3@9bfb6693f2cf6de171db46d1aa586f67d773a1da",
5
+ "training_run_id": "20260823T132231Z-v10p5-datafree-sp4",
6
+ "wandb_url": "https://wandb.ai/wlsaidhi/h3-dmd2-vsa/runs/a1etree2",
7
+ "checkpoint_step": 1300,
8
+ "checkpoint_content_sha256": "b36987515e4c75fa4c7aaa632a7842c829ea141b235358a54d782b51230497b3",
9
+ "checkpoint_metadata_sha256": "dcad0fbee2a7c7e75e53435f4fd98fccf3138844883874edf057962ab48fa428",
10
+ "fastvideo_commit": "48a047c05ff4138f20cfa33351499c6ec5945f5d",
11
+ "student_tensor_count": 688,
12
+ "student_tensor_bytes": 70099502592,
13
+ "student_dtype": "bfloat16",
14
+ "dmd_denoising_steps": [999, 749, 500, 250],
15
+ "attention_backend": "VIDEO_SPARSE_ATTN_H3",
16
+ "vsa_tile_size": 64,
17
+ "vsa_sparsity": 0.9,
18
+ "known_recipe_deviation": "Predates later continuous score-clock and FastGen-alignment corrections."
19
+ }
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Scheduler",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "shift": 12.0
5
+ }
text_encoder/chat_template.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n"
3
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3VLForConditionalGeneration"
4
+ ],
5
+ "image_token_id": 151655,
6
+ "model_type": "qwen3_vl",
7
+ "text_config": {
8
+ "attention_bias": false,
9
+ "attention_dropout": 0.0,
10
+ "bos_token_id": 151643,
11
+ "dtype": "bfloat16",
12
+ "eos_token_id": 151645,
13
+ "head_dim": 128,
14
+ "hidden_act": "silu",
15
+ "hidden_size": 5120,
16
+ "initializer_range": 0.02,
17
+ "intermediate_size": 25600,
18
+ "max_position_embeddings": 262144,
19
+ "model_type": "qwen3_vl_text",
20
+ "num_attention_heads": 64,
21
+ "num_hidden_layers": 64,
22
+ "num_key_value_heads": 8,
23
+ "rms_norm_eps": 1e-06,
24
+ "rope_scaling": {
25
+ "mrope_interleaved": true,
26
+ "mrope_section": [
27
+ 24,
28
+ 20,
29
+ 20
30
+ ],
31
+ "rope_type": "default"
32
+ },
33
+ "rope_theta": 5000000,
34
+ "use_cache": true,
35
+ "vocab_size": 151936
36
+ },
37
+ "tie_word_embeddings": false,
38
+ "transformers_version": "4.57.0.dev0",
39
+ "video_token_id": 151656,
40
+ "vision_config": {
41
+ "deepstack_visual_indexes": [
42
+ 8,
43
+ 16,
44
+ 24
45
+ ],
46
+ "depth": 27,
47
+ "hidden_act": "gelu_pytorch_tanh",
48
+ "hidden_size": 1152,
49
+ "in_channels": 3,
50
+ "initializer_range": 0.02,
51
+ "intermediate_size": 4304,
52
+ "model_type": "qwen3_vl",
53
+ "num_heads": 16,
54
+ "num_position_embeddings": 2304,
55
+ "out_hidden_size": 5120,
56
+ "patch_size": 16,
57
+ "spatial_merge_size": 2,
58
+ "temporal_patch_size": 2
59
+ },
60
+ "vision_end_token_id": 151653,
61
+ "vision_start_token_id": 151652
62
+ }
text_encoder/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
text_encoder/model-00001-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b9dfbc930e505402ae9d7e5091a9d7d656cda5f34614f01cfe70bfb0cca27cb
3
+ size 4932328944
text_encoder/model-00002-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8bb44b4ff303fe76fe9e894022fb3dc71b15a2e716592790fe0e3c3e60478fa
3
+ size 4875990528
text_encoder/model-00003-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54f22e8b3168f8dc962fac0d313607ebf52a12b433d4cf3098a0d82d9f042940
3
+ size 4875990552
text_encoder/model-00006-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82f05620d1f718a90c362b221d6a184ff1a0f53301d706882d3df49695fa1974
3
+ size 4875990584
text_encoder/model-00007-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb91da8cb01ff4de3eef0eab1c3e769a734b3a1aafc61734068638a0d6c86934
3
+ size 4875990584
text_encoder/model-00014-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e45b6c9998c77ee5a6577f9f47bc76416c1d4d387169e50c4c9d3134ea51b13b
3
+ size 3270697008
text_encoder/model.safetensors.index.json ADDED
@@ -0,0 +1,1065 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 66714780128
4
+ },
5
+ "weight_map": {
6
+ "lm_head.weight": "model-00014-of-00014.safetensors",
7
+ "model.language_model.embed_tokens.weight": "model-00001-of-00014.safetensors",
8
+ "model.language_model.layers.0.input_layernorm.weight": "model-00001-of-00014.safetensors",
9
+ "model.language_model.layers.0.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
10
+ "model.language_model.layers.0.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
11
+ "model.language_model.layers.0.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
12
+ "model.language_model.layers.0.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
13
+ "model.language_model.layers.0.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
14
+ "model.language_model.layers.0.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
15
+ "model.language_model.layers.0.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
16
+ "model.language_model.layers.0.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
17
+ "model.language_model.layers.0.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
18
+ "model.language_model.layers.0.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
19
+ "model.language_model.layers.1.input_layernorm.weight": "model-00001-of-00014.safetensors",
20
+ "model.language_model.layers.1.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
21
+ "model.language_model.layers.1.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
22
+ "model.language_model.layers.1.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
23
+ "model.language_model.layers.1.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
24
+ "model.language_model.layers.1.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
25
+ "model.language_model.layers.1.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
26
+ "model.language_model.layers.1.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
27
+ "model.language_model.layers.1.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
28
+ "model.language_model.layers.1.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
29
+ "model.language_model.layers.1.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
30
+ "model.language_model.layers.10.input_layernorm.weight": "model-00003-of-00014.safetensors",
31
+ "model.language_model.layers.10.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
32
+ "model.language_model.layers.10.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
33
+ "model.language_model.layers.10.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
34
+ "model.language_model.layers.10.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
35
+ "model.language_model.layers.10.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
36
+ "model.language_model.layers.10.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
37
+ "model.language_model.layers.10.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
38
+ "model.language_model.layers.10.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
39
+ "model.language_model.layers.10.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
40
+ "model.language_model.layers.10.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
41
+ "model.language_model.layers.11.input_layernorm.weight": "model-00003-of-00014.safetensors",
42
+ "model.language_model.layers.11.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
43
+ "model.language_model.layers.11.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
44
+ "model.language_model.layers.11.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
45
+ "model.language_model.layers.11.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
46
+ "model.language_model.layers.11.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
47
+ "model.language_model.layers.11.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
48
+ "model.language_model.layers.11.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
49
+ "model.language_model.layers.11.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
50
+ "model.language_model.layers.11.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
51
+ "model.language_model.layers.11.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
52
+ "model.language_model.layers.12.input_layernorm.weight": "model-00003-of-00014.safetensors",
53
+ "model.language_model.layers.12.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
54
+ "model.language_model.layers.12.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
55
+ "model.language_model.layers.12.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
56
+ "model.language_model.layers.12.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
57
+ "model.language_model.layers.12.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
58
+ "model.language_model.layers.12.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
59
+ "model.language_model.layers.12.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
60
+ "model.language_model.layers.12.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
61
+ "model.language_model.layers.12.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
62
+ "model.language_model.layers.12.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
63
+ "model.language_model.layers.13.input_layernorm.weight": "model-00003-of-00014.safetensors",
64
+ "model.language_model.layers.13.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
65
+ "model.language_model.layers.13.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
66
+ "model.language_model.layers.13.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
67
+ "model.language_model.layers.13.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
68
+ "model.language_model.layers.13.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
69
+ "model.language_model.layers.13.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
70
+ "model.language_model.layers.13.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
71
+ "model.language_model.layers.13.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
72
+ "model.language_model.layers.13.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
73
+ "model.language_model.layers.13.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
74
+ "model.language_model.layers.14.input_layernorm.weight": "model-00004-of-00014.safetensors",
75
+ "model.language_model.layers.14.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
76
+ "model.language_model.layers.14.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
77
+ "model.language_model.layers.14.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
78
+ "model.language_model.layers.14.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
79
+ "model.language_model.layers.14.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
80
+ "model.language_model.layers.14.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
81
+ "model.language_model.layers.14.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
82
+ "model.language_model.layers.14.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
83
+ "model.language_model.layers.14.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
84
+ "model.language_model.layers.14.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
85
+ "model.language_model.layers.15.input_layernorm.weight": "model-00004-of-00014.safetensors",
86
+ "model.language_model.layers.15.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
87
+ "model.language_model.layers.15.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
88
+ "model.language_model.layers.15.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
89
+ "model.language_model.layers.15.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
90
+ "model.language_model.layers.15.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
91
+ "model.language_model.layers.15.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
92
+ "model.language_model.layers.15.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
93
+ "model.language_model.layers.15.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
94
+ "model.language_model.layers.15.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
95
+ "model.language_model.layers.15.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
96
+ "model.language_model.layers.16.input_layernorm.weight": "model-00004-of-00014.safetensors",
97
+ "model.language_model.layers.16.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
98
+ "model.language_model.layers.16.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
99
+ "model.language_model.layers.16.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
100
+ "model.language_model.layers.16.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
101
+ "model.language_model.layers.16.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
102
+ "model.language_model.layers.16.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
103
+ "model.language_model.layers.16.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
104
+ "model.language_model.layers.16.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
105
+ "model.language_model.layers.16.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
106
+ "model.language_model.layers.16.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
107
+ "model.language_model.layers.17.input_layernorm.weight": "model-00004-of-00014.safetensors",
108
+ "model.language_model.layers.17.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
109
+ "model.language_model.layers.17.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
110
+ "model.language_model.layers.17.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
111
+ "model.language_model.layers.17.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
112
+ "model.language_model.layers.17.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
113
+ "model.language_model.layers.17.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
114
+ "model.language_model.layers.17.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
115
+ "model.language_model.layers.17.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
116
+ "model.language_model.layers.17.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
117
+ "model.language_model.layers.17.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
118
+ "model.language_model.layers.18.input_layernorm.weight": "model-00004-of-00014.safetensors",
119
+ "model.language_model.layers.18.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
120
+ "model.language_model.layers.18.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
121
+ "model.language_model.layers.18.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
122
+ "model.language_model.layers.18.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
123
+ "model.language_model.layers.18.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
124
+ "model.language_model.layers.18.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
125
+ "model.language_model.layers.18.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
126
+ "model.language_model.layers.18.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
127
+ "model.language_model.layers.18.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
128
+ "model.language_model.layers.18.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
129
+ "model.language_model.layers.19.input_layernorm.weight": "model-00005-of-00014.safetensors",
130
+ "model.language_model.layers.19.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
131
+ "model.language_model.layers.19.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
132
+ "model.language_model.layers.19.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
133
+ "model.language_model.layers.19.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
134
+ "model.language_model.layers.19.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
135
+ "model.language_model.layers.19.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
136
+ "model.language_model.layers.19.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
137
+ "model.language_model.layers.19.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
138
+ "model.language_model.layers.19.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
139
+ "model.language_model.layers.19.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
140
+ "model.language_model.layers.2.input_layernorm.weight": "model-00001-of-00014.safetensors",
141
+ "model.language_model.layers.2.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
142
+ "model.language_model.layers.2.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
143
+ "model.language_model.layers.2.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
144
+ "model.language_model.layers.2.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
145
+ "model.language_model.layers.2.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
146
+ "model.language_model.layers.2.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
147
+ "model.language_model.layers.2.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
148
+ "model.language_model.layers.2.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
149
+ "model.language_model.layers.2.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
150
+ "model.language_model.layers.2.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
151
+ "model.language_model.layers.20.input_layernorm.weight": "model-00005-of-00014.safetensors",
152
+ "model.language_model.layers.20.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
153
+ "model.language_model.layers.20.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
154
+ "model.language_model.layers.20.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
155
+ "model.language_model.layers.20.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
156
+ "model.language_model.layers.20.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
157
+ "model.language_model.layers.20.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
158
+ "model.language_model.layers.20.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
159
+ "model.language_model.layers.20.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
160
+ "model.language_model.layers.20.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
161
+ "model.language_model.layers.20.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
162
+ "model.language_model.layers.21.input_layernorm.weight": "model-00005-of-00014.safetensors",
163
+ "model.language_model.layers.21.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
164
+ "model.language_model.layers.21.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
165
+ "model.language_model.layers.21.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
166
+ "model.language_model.layers.21.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
167
+ "model.language_model.layers.21.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
168
+ "model.language_model.layers.21.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
169
+ "model.language_model.layers.21.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
170
+ "model.language_model.layers.21.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
171
+ "model.language_model.layers.21.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
172
+ "model.language_model.layers.21.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
173
+ "model.language_model.layers.22.input_layernorm.weight": "model-00005-of-00014.safetensors",
174
+ "model.language_model.layers.22.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
175
+ "model.language_model.layers.22.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
176
+ "model.language_model.layers.22.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
177
+ "model.language_model.layers.22.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
178
+ "model.language_model.layers.22.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
179
+ "model.language_model.layers.22.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
180
+ "model.language_model.layers.22.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
181
+ "model.language_model.layers.22.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
182
+ "model.language_model.layers.22.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
183
+ "model.language_model.layers.22.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
184
+ "model.language_model.layers.23.input_layernorm.weight": "model-00005-of-00014.safetensors",
185
+ "model.language_model.layers.23.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
186
+ "model.language_model.layers.23.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
187
+ "model.language_model.layers.23.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
188
+ "model.language_model.layers.23.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
189
+ "model.language_model.layers.23.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
190
+ "model.language_model.layers.23.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
191
+ "model.language_model.layers.23.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
192
+ "model.language_model.layers.23.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
193
+ "model.language_model.layers.23.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
194
+ "model.language_model.layers.23.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
195
+ "model.language_model.layers.24.input_layernorm.weight": "model-00006-of-00014.safetensors",
196
+ "model.language_model.layers.24.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
197
+ "model.language_model.layers.24.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
198
+ "model.language_model.layers.24.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
199
+ "model.language_model.layers.24.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
200
+ "model.language_model.layers.24.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
201
+ "model.language_model.layers.24.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
202
+ "model.language_model.layers.24.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
203
+ "model.language_model.layers.24.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
204
+ "model.language_model.layers.24.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
205
+ "model.language_model.layers.24.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
206
+ "model.language_model.layers.25.input_layernorm.weight": "model-00006-of-00014.safetensors",
207
+ "model.language_model.layers.25.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
208
+ "model.language_model.layers.25.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
209
+ "model.language_model.layers.25.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
210
+ "model.language_model.layers.25.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
211
+ "model.language_model.layers.25.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
212
+ "model.language_model.layers.25.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
213
+ "model.language_model.layers.25.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
214
+ "model.language_model.layers.25.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
215
+ "model.language_model.layers.25.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
216
+ "model.language_model.layers.25.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
217
+ "model.language_model.layers.26.input_layernorm.weight": "model-00006-of-00014.safetensors",
218
+ "model.language_model.layers.26.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
219
+ "model.language_model.layers.26.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
220
+ "model.language_model.layers.26.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
221
+ "model.language_model.layers.26.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
222
+ "model.language_model.layers.26.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
223
+ "model.language_model.layers.26.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
224
+ "model.language_model.layers.26.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
225
+ "model.language_model.layers.26.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
226
+ "model.language_model.layers.26.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
227
+ "model.language_model.layers.26.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
228
+ "model.language_model.layers.27.input_layernorm.weight": "model-00006-of-00014.safetensors",
229
+ "model.language_model.layers.27.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
230
+ "model.language_model.layers.27.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
231
+ "model.language_model.layers.27.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
232
+ "model.language_model.layers.27.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
233
+ "model.language_model.layers.27.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
234
+ "model.language_model.layers.27.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
235
+ "model.language_model.layers.27.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
236
+ "model.language_model.layers.27.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
237
+ "model.language_model.layers.27.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
238
+ "model.language_model.layers.27.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
239
+ "model.language_model.layers.28.input_layernorm.weight": "model-00006-of-00014.safetensors",
240
+ "model.language_model.layers.28.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
241
+ "model.language_model.layers.28.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
242
+ "model.language_model.layers.28.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
243
+ "model.language_model.layers.28.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
244
+ "model.language_model.layers.28.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
245
+ "model.language_model.layers.28.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
246
+ "model.language_model.layers.28.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
247
+ "model.language_model.layers.28.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
248
+ "model.language_model.layers.28.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
249
+ "model.language_model.layers.28.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
250
+ "model.language_model.layers.29.input_layernorm.weight": "model-00007-of-00014.safetensors",
251
+ "model.language_model.layers.29.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
252
+ "model.language_model.layers.29.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
253
+ "model.language_model.layers.29.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
254
+ "model.language_model.layers.29.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
255
+ "model.language_model.layers.29.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
256
+ "model.language_model.layers.29.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
257
+ "model.language_model.layers.29.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
258
+ "model.language_model.layers.29.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
259
+ "model.language_model.layers.29.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
260
+ "model.language_model.layers.29.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
261
+ "model.language_model.layers.3.input_layernorm.weight": "model-00001-of-00014.safetensors",
262
+ "model.language_model.layers.3.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
263
+ "model.language_model.layers.3.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
264
+ "model.language_model.layers.3.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
265
+ "model.language_model.layers.3.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
266
+ "model.language_model.layers.3.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
267
+ "model.language_model.layers.3.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
268
+ "model.language_model.layers.3.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
269
+ "model.language_model.layers.3.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
270
+ "model.language_model.layers.3.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
271
+ "model.language_model.layers.3.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
272
+ "model.language_model.layers.30.input_layernorm.weight": "model-00007-of-00014.safetensors",
273
+ "model.language_model.layers.30.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
274
+ "model.language_model.layers.30.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
275
+ "model.language_model.layers.30.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
276
+ "model.language_model.layers.30.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
277
+ "model.language_model.layers.30.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
278
+ "model.language_model.layers.30.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
279
+ "model.language_model.layers.30.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
280
+ "model.language_model.layers.30.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
281
+ "model.language_model.layers.30.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
282
+ "model.language_model.layers.30.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
283
+ "model.language_model.layers.31.input_layernorm.weight": "model-00007-of-00014.safetensors",
284
+ "model.language_model.layers.31.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
285
+ "model.language_model.layers.31.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
286
+ "model.language_model.layers.31.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
287
+ "model.language_model.layers.31.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
288
+ "model.language_model.layers.31.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
289
+ "model.language_model.layers.31.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
290
+ "model.language_model.layers.31.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
291
+ "model.language_model.layers.31.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
292
+ "model.language_model.layers.31.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
293
+ "model.language_model.layers.31.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
294
+ "model.language_model.layers.32.input_layernorm.weight": "model-00007-of-00014.safetensors",
295
+ "model.language_model.layers.32.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
296
+ "model.language_model.layers.32.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
297
+ "model.language_model.layers.32.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
298
+ "model.language_model.layers.32.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
299
+ "model.language_model.layers.32.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
300
+ "model.language_model.layers.32.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
301
+ "model.language_model.layers.32.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
302
+ "model.language_model.layers.32.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
303
+ "model.language_model.layers.32.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
304
+ "model.language_model.layers.32.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
305
+ "model.language_model.layers.33.input_layernorm.weight": "model-00007-of-00014.safetensors",
306
+ "model.language_model.layers.33.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
307
+ "model.language_model.layers.33.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
308
+ "model.language_model.layers.33.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
309
+ "model.language_model.layers.33.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
310
+ "model.language_model.layers.33.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
311
+ "model.language_model.layers.33.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
312
+ "model.language_model.layers.33.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
313
+ "model.language_model.layers.33.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
314
+ "model.language_model.layers.33.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
315
+ "model.language_model.layers.33.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
316
+ "model.language_model.layers.34.input_layernorm.weight": "model-00008-of-00014.safetensors",
317
+ "model.language_model.layers.34.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
318
+ "model.language_model.layers.34.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
319
+ "model.language_model.layers.34.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
320
+ "model.language_model.layers.34.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
321
+ "model.language_model.layers.34.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
322
+ "model.language_model.layers.34.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
323
+ "model.language_model.layers.34.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
324
+ "model.language_model.layers.34.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
325
+ "model.language_model.layers.34.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
326
+ "model.language_model.layers.34.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
327
+ "model.language_model.layers.35.input_layernorm.weight": "model-00008-of-00014.safetensors",
328
+ "model.language_model.layers.35.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
329
+ "model.language_model.layers.35.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
330
+ "model.language_model.layers.35.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
331
+ "model.language_model.layers.35.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
332
+ "model.language_model.layers.35.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
333
+ "model.language_model.layers.35.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
334
+ "model.language_model.layers.35.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
335
+ "model.language_model.layers.35.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
336
+ "model.language_model.layers.35.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
337
+ "model.language_model.layers.35.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
338
+ "model.language_model.layers.36.input_layernorm.weight": "model-00008-of-00014.safetensors",
339
+ "model.language_model.layers.36.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
340
+ "model.language_model.layers.36.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
341
+ "model.language_model.layers.36.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
342
+ "model.language_model.layers.36.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
343
+ "model.language_model.layers.36.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
344
+ "model.language_model.layers.36.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
345
+ "model.language_model.layers.36.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
346
+ "model.language_model.layers.36.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
347
+ "model.language_model.layers.36.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
348
+ "model.language_model.layers.36.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
349
+ "model.language_model.layers.37.input_layernorm.weight": "model-00008-of-00014.safetensors",
350
+ "model.language_model.layers.37.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
351
+ "model.language_model.layers.37.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
352
+ "model.language_model.layers.37.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
353
+ "model.language_model.layers.37.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
354
+ "model.language_model.layers.37.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
355
+ "model.language_model.layers.37.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
356
+ "model.language_model.layers.37.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
357
+ "model.language_model.layers.37.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
358
+ "model.language_model.layers.37.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
359
+ "model.language_model.layers.37.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
360
+ "model.language_model.layers.38.input_layernorm.weight": "model-00008-of-00014.safetensors",
361
+ "model.language_model.layers.38.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
362
+ "model.language_model.layers.38.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
363
+ "model.language_model.layers.38.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
364
+ "model.language_model.layers.38.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
365
+ "model.language_model.layers.38.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
366
+ "model.language_model.layers.38.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
367
+ "model.language_model.layers.38.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
368
+ "model.language_model.layers.38.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
369
+ "model.language_model.layers.38.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
370
+ "model.language_model.layers.38.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
371
+ "model.language_model.layers.39.input_layernorm.weight": "model-00009-of-00014.safetensors",
372
+ "model.language_model.layers.39.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
373
+ "model.language_model.layers.39.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
374
+ "model.language_model.layers.39.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
375
+ "model.language_model.layers.39.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
376
+ "model.language_model.layers.39.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
377
+ "model.language_model.layers.39.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
378
+ "model.language_model.layers.39.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
379
+ "model.language_model.layers.39.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
380
+ "model.language_model.layers.39.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
381
+ "model.language_model.layers.39.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
382
+ "model.language_model.layers.4.input_layernorm.weight": "model-00002-of-00014.safetensors",
383
+ "model.language_model.layers.4.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
384
+ "model.language_model.layers.4.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
385
+ "model.language_model.layers.4.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
386
+ "model.language_model.layers.4.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
387
+ "model.language_model.layers.4.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
388
+ "model.language_model.layers.4.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
389
+ "model.language_model.layers.4.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
390
+ "model.language_model.layers.4.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
391
+ "model.language_model.layers.4.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
392
+ "model.language_model.layers.4.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
393
+ "model.language_model.layers.40.input_layernorm.weight": "model-00009-of-00014.safetensors",
394
+ "model.language_model.layers.40.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
395
+ "model.language_model.layers.40.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
396
+ "model.language_model.layers.40.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
397
+ "model.language_model.layers.40.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
398
+ "model.language_model.layers.40.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
399
+ "model.language_model.layers.40.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
400
+ "model.language_model.layers.40.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
401
+ "model.language_model.layers.40.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
402
+ "model.language_model.layers.40.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
403
+ "model.language_model.layers.40.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
404
+ "model.language_model.layers.41.input_layernorm.weight": "model-00009-of-00014.safetensors",
405
+ "model.language_model.layers.41.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
406
+ "model.language_model.layers.41.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
407
+ "model.language_model.layers.41.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
408
+ "model.language_model.layers.41.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
409
+ "model.language_model.layers.41.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
410
+ "model.language_model.layers.41.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
411
+ "model.language_model.layers.41.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
412
+ "model.language_model.layers.41.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
413
+ "model.language_model.layers.41.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
414
+ "model.language_model.layers.41.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
415
+ "model.language_model.layers.42.input_layernorm.weight": "model-00009-of-00014.safetensors",
416
+ "model.language_model.layers.42.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
417
+ "model.language_model.layers.42.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
418
+ "model.language_model.layers.42.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
419
+ "model.language_model.layers.42.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
420
+ "model.language_model.layers.42.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
421
+ "model.language_model.layers.42.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
422
+ "model.language_model.layers.42.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
423
+ "model.language_model.layers.42.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
424
+ "model.language_model.layers.42.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
425
+ "model.language_model.layers.42.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
426
+ "model.language_model.layers.43.input_layernorm.weight": "model-00009-of-00014.safetensors",
427
+ "model.language_model.layers.43.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
428
+ "model.language_model.layers.43.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
429
+ "model.language_model.layers.43.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
430
+ "model.language_model.layers.43.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
431
+ "model.language_model.layers.43.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
432
+ "model.language_model.layers.43.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
433
+ "model.language_model.layers.43.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
434
+ "model.language_model.layers.43.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
435
+ "model.language_model.layers.43.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
436
+ "model.language_model.layers.43.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
437
+ "model.language_model.layers.44.input_layernorm.weight": "model-00010-of-00014.safetensors",
438
+ "model.language_model.layers.44.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
439
+ "model.language_model.layers.44.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
440
+ "model.language_model.layers.44.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
441
+ "model.language_model.layers.44.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
442
+ "model.language_model.layers.44.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
443
+ "model.language_model.layers.44.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
444
+ "model.language_model.layers.44.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
445
+ "model.language_model.layers.44.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
446
+ "model.language_model.layers.44.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
447
+ "model.language_model.layers.44.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
448
+ "model.language_model.layers.45.input_layernorm.weight": "model-00010-of-00014.safetensors",
449
+ "model.language_model.layers.45.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
450
+ "model.language_model.layers.45.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
451
+ "model.language_model.layers.45.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
452
+ "model.language_model.layers.45.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
453
+ "model.language_model.layers.45.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
454
+ "model.language_model.layers.45.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
455
+ "model.language_model.layers.45.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
456
+ "model.language_model.layers.45.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
457
+ "model.language_model.layers.45.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
458
+ "model.language_model.layers.45.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
459
+ "model.language_model.layers.46.input_layernorm.weight": "model-00010-of-00014.safetensors",
460
+ "model.language_model.layers.46.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
461
+ "model.language_model.layers.46.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
462
+ "model.language_model.layers.46.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
463
+ "model.language_model.layers.46.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
464
+ "model.language_model.layers.46.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
465
+ "model.language_model.layers.46.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
466
+ "model.language_model.layers.46.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
467
+ "model.language_model.layers.46.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
468
+ "model.language_model.layers.46.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
469
+ "model.language_model.layers.46.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
470
+ "model.language_model.layers.47.input_layernorm.weight": "model-00010-of-00014.safetensors",
471
+ "model.language_model.layers.47.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
472
+ "model.language_model.layers.47.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
473
+ "model.language_model.layers.47.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
474
+ "model.language_model.layers.47.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
475
+ "model.language_model.layers.47.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
476
+ "model.language_model.layers.47.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
477
+ "model.language_model.layers.47.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
478
+ "model.language_model.layers.47.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
479
+ "model.language_model.layers.47.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
480
+ "model.language_model.layers.47.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
481
+ "model.language_model.layers.48.input_layernorm.weight": "model-00010-of-00014.safetensors",
482
+ "model.language_model.layers.48.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
483
+ "model.language_model.layers.48.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
484
+ "model.language_model.layers.48.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
485
+ "model.language_model.layers.48.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
486
+ "model.language_model.layers.48.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
487
+ "model.language_model.layers.48.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
488
+ "model.language_model.layers.48.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
489
+ "model.language_model.layers.48.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
490
+ "model.language_model.layers.48.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
491
+ "model.language_model.layers.48.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
492
+ "model.language_model.layers.49.input_layernorm.weight": "model-00011-of-00014.safetensors",
493
+ "model.language_model.layers.49.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
494
+ "model.language_model.layers.49.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
495
+ "model.language_model.layers.49.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
496
+ "model.language_model.layers.49.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
497
+ "model.language_model.layers.49.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
498
+ "model.language_model.layers.49.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
499
+ "model.language_model.layers.49.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
500
+ "model.language_model.layers.49.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
501
+ "model.language_model.layers.49.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
502
+ "model.language_model.layers.49.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
503
+ "model.language_model.layers.5.input_layernorm.weight": "model-00002-of-00014.safetensors",
504
+ "model.language_model.layers.5.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
505
+ "model.language_model.layers.5.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
506
+ "model.language_model.layers.5.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
507
+ "model.language_model.layers.5.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
508
+ "model.language_model.layers.5.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
509
+ "model.language_model.layers.5.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
510
+ "model.language_model.layers.5.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
511
+ "model.language_model.layers.5.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
512
+ "model.language_model.layers.5.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
513
+ "model.language_model.layers.5.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
514
+ "model.language_model.layers.50.input_layernorm.weight": "model-00011-of-00014.safetensors",
515
+ "model.language_model.layers.50.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
516
+ "model.language_model.layers.50.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
517
+ "model.language_model.layers.50.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
518
+ "model.language_model.layers.50.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
519
+ "model.language_model.layers.50.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
520
+ "model.language_model.layers.50.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
521
+ "model.language_model.layers.50.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
522
+ "model.language_model.layers.50.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
523
+ "model.language_model.layers.50.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
524
+ "model.language_model.layers.50.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
525
+ "model.language_model.layers.51.input_layernorm.weight": "model-00011-of-00014.safetensors",
526
+ "model.language_model.layers.51.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
527
+ "model.language_model.layers.51.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
528
+ "model.language_model.layers.51.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
529
+ "model.language_model.layers.51.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
530
+ "model.language_model.layers.51.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
531
+ "model.language_model.layers.51.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
532
+ "model.language_model.layers.51.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
533
+ "model.language_model.layers.51.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
534
+ "model.language_model.layers.51.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
535
+ "model.language_model.layers.51.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
536
+ "model.language_model.layers.52.input_layernorm.weight": "model-00011-of-00014.safetensors",
537
+ "model.language_model.layers.52.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
538
+ "model.language_model.layers.52.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
539
+ "model.language_model.layers.52.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
540
+ "model.language_model.layers.52.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
541
+ "model.language_model.layers.52.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
542
+ "model.language_model.layers.52.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
543
+ "model.language_model.layers.52.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
544
+ "model.language_model.layers.52.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
545
+ "model.language_model.layers.52.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
546
+ "model.language_model.layers.52.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
547
+ "model.language_model.layers.53.input_layernorm.weight": "model-00011-of-00014.safetensors",
548
+ "model.language_model.layers.53.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
549
+ "model.language_model.layers.53.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
550
+ "model.language_model.layers.53.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
551
+ "model.language_model.layers.53.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
552
+ "model.language_model.layers.53.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
553
+ "model.language_model.layers.53.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
554
+ "model.language_model.layers.53.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
555
+ "model.language_model.layers.53.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
556
+ "model.language_model.layers.53.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
557
+ "model.language_model.layers.53.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
558
+ "model.language_model.layers.54.input_layernorm.weight": "model-00012-of-00014.safetensors",
559
+ "model.language_model.layers.54.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
560
+ "model.language_model.layers.54.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
561
+ "model.language_model.layers.54.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
562
+ "model.language_model.layers.54.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
563
+ "model.language_model.layers.54.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
564
+ "model.language_model.layers.54.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
565
+ "model.language_model.layers.54.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
566
+ "model.language_model.layers.54.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
567
+ "model.language_model.layers.54.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
568
+ "model.language_model.layers.54.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
569
+ "model.language_model.layers.55.input_layernorm.weight": "model-00012-of-00014.safetensors",
570
+ "model.language_model.layers.55.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
571
+ "model.language_model.layers.55.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
572
+ "model.language_model.layers.55.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
573
+ "model.language_model.layers.55.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
574
+ "model.language_model.layers.55.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
575
+ "model.language_model.layers.55.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
576
+ "model.language_model.layers.55.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
577
+ "model.language_model.layers.55.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
578
+ "model.language_model.layers.55.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
579
+ "model.language_model.layers.55.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
580
+ "model.language_model.layers.56.input_layernorm.weight": "model-00012-of-00014.safetensors",
581
+ "model.language_model.layers.56.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
582
+ "model.language_model.layers.56.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
583
+ "model.language_model.layers.56.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
584
+ "model.language_model.layers.56.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
585
+ "model.language_model.layers.56.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
586
+ "model.language_model.layers.56.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
587
+ "model.language_model.layers.56.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
588
+ "model.language_model.layers.56.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
589
+ "model.language_model.layers.56.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
590
+ "model.language_model.layers.56.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
591
+ "model.language_model.layers.57.input_layernorm.weight": "model-00012-of-00014.safetensors",
592
+ "model.language_model.layers.57.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
593
+ "model.language_model.layers.57.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
594
+ "model.language_model.layers.57.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
595
+ "model.language_model.layers.57.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
596
+ "model.language_model.layers.57.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
597
+ "model.language_model.layers.57.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
598
+ "model.language_model.layers.57.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
599
+ "model.language_model.layers.57.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
600
+ "model.language_model.layers.57.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
601
+ "model.language_model.layers.57.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
602
+ "model.language_model.layers.58.input_layernorm.weight": "model-00012-of-00014.safetensors",
603
+ "model.language_model.layers.58.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
604
+ "model.language_model.layers.58.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
605
+ "model.language_model.layers.58.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
606
+ "model.language_model.layers.58.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
607
+ "model.language_model.layers.58.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
608
+ "model.language_model.layers.58.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
609
+ "model.language_model.layers.58.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
610
+ "model.language_model.layers.58.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
611
+ "model.language_model.layers.58.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
612
+ "model.language_model.layers.58.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
613
+ "model.language_model.layers.59.input_layernorm.weight": "model-00013-of-00014.safetensors",
614
+ "model.language_model.layers.59.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
615
+ "model.language_model.layers.59.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
616
+ "model.language_model.layers.59.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
617
+ "model.language_model.layers.59.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
618
+ "model.language_model.layers.59.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
619
+ "model.language_model.layers.59.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
620
+ "model.language_model.layers.59.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
621
+ "model.language_model.layers.59.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
622
+ "model.language_model.layers.59.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
623
+ "model.language_model.layers.59.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
624
+ "model.language_model.layers.6.input_layernorm.weight": "model-00002-of-00014.safetensors",
625
+ "model.language_model.layers.6.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
626
+ "model.language_model.layers.6.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
627
+ "model.language_model.layers.6.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
628
+ "model.language_model.layers.6.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
629
+ "model.language_model.layers.6.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
630
+ "model.language_model.layers.6.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
631
+ "model.language_model.layers.6.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
632
+ "model.language_model.layers.6.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
633
+ "model.language_model.layers.6.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
634
+ "model.language_model.layers.6.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
635
+ "model.language_model.layers.60.input_layernorm.weight": "model-00013-of-00014.safetensors",
636
+ "model.language_model.layers.60.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
637
+ "model.language_model.layers.60.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
638
+ "model.language_model.layers.60.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
639
+ "model.language_model.layers.60.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
640
+ "model.language_model.layers.60.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
641
+ "model.language_model.layers.60.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
642
+ "model.language_model.layers.60.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
643
+ "model.language_model.layers.60.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
644
+ "model.language_model.layers.60.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
645
+ "model.language_model.layers.60.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
646
+ "model.language_model.layers.61.input_layernorm.weight": "model-00013-of-00014.safetensors",
647
+ "model.language_model.layers.61.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
648
+ "model.language_model.layers.61.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
649
+ "model.language_model.layers.61.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
650
+ "model.language_model.layers.61.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
651
+ "model.language_model.layers.61.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
652
+ "model.language_model.layers.61.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
653
+ "model.language_model.layers.61.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
654
+ "model.language_model.layers.61.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
655
+ "model.language_model.layers.61.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
656
+ "model.language_model.layers.61.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
657
+ "model.language_model.layers.62.input_layernorm.weight": "model-00013-of-00014.safetensors",
658
+ "model.language_model.layers.62.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
659
+ "model.language_model.layers.62.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
660
+ "model.language_model.layers.62.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
661
+ "model.language_model.layers.62.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
662
+ "model.language_model.layers.62.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
663
+ "model.language_model.layers.62.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
664
+ "model.language_model.layers.62.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
665
+ "model.language_model.layers.62.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
666
+ "model.language_model.layers.62.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
667
+ "model.language_model.layers.62.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
668
+ "model.language_model.layers.63.input_layernorm.weight": "model-00013-of-00014.safetensors",
669
+ "model.language_model.layers.63.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
670
+ "model.language_model.layers.63.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
671
+ "model.language_model.layers.63.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
672
+ "model.language_model.layers.63.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
673
+ "model.language_model.layers.63.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
674
+ "model.language_model.layers.63.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
675
+ "model.language_model.layers.63.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
676
+ "model.language_model.layers.63.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
677
+ "model.language_model.layers.63.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
678
+ "model.language_model.layers.63.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
679
+ "model.language_model.layers.7.input_layernorm.weight": "model-00002-of-00014.safetensors",
680
+ "model.language_model.layers.7.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
681
+ "model.language_model.layers.7.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
682
+ "model.language_model.layers.7.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
683
+ "model.language_model.layers.7.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
684
+ "model.language_model.layers.7.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
685
+ "model.language_model.layers.7.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
686
+ "model.language_model.layers.7.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
687
+ "model.language_model.layers.7.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
688
+ "model.language_model.layers.7.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
689
+ "model.language_model.layers.7.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
690
+ "model.language_model.layers.8.input_layernorm.weight": "model-00002-of-00014.safetensors",
691
+ "model.language_model.layers.8.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
692
+ "model.language_model.layers.8.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
693
+ "model.language_model.layers.8.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
694
+ "model.language_model.layers.8.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
695
+ "model.language_model.layers.8.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
696
+ "model.language_model.layers.8.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
697
+ "model.language_model.layers.8.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
698
+ "model.language_model.layers.8.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
699
+ "model.language_model.layers.8.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
700
+ "model.language_model.layers.8.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
701
+ "model.language_model.layers.9.input_layernorm.weight": "model-00003-of-00014.safetensors",
702
+ "model.language_model.layers.9.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
703
+ "model.language_model.layers.9.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
704
+ "model.language_model.layers.9.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
705
+ "model.language_model.layers.9.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
706
+ "model.language_model.layers.9.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
707
+ "model.language_model.layers.9.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
708
+ "model.language_model.layers.9.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
709
+ "model.language_model.layers.9.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
710
+ "model.language_model.layers.9.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
711
+ "model.language_model.layers.9.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
712
+ "model.language_model.norm.weight": "model-00014-of-00014.safetensors",
713
+ "model.visual.blocks.0.attn.proj.bias": "model-00014-of-00014.safetensors",
714
+ "model.visual.blocks.0.attn.proj.weight": "model-00014-of-00014.safetensors",
715
+ "model.visual.blocks.0.attn.qkv.bias": "model-00014-of-00014.safetensors",
716
+ "model.visual.blocks.0.attn.qkv.weight": "model-00014-of-00014.safetensors",
717
+ "model.visual.blocks.0.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
718
+ "model.visual.blocks.0.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
719
+ "model.visual.blocks.0.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
720
+ "model.visual.blocks.0.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
721
+ "model.visual.blocks.0.norm1.bias": "model-00014-of-00014.safetensors",
722
+ "model.visual.blocks.0.norm1.weight": "model-00014-of-00014.safetensors",
723
+ "model.visual.blocks.0.norm2.bias": "model-00014-of-00014.safetensors",
724
+ "model.visual.blocks.0.norm2.weight": "model-00014-of-00014.safetensors",
725
+ "model.visual.blocks.1.attn.proj.bias": "model-00014-of-00014.safetensors",
726
+ "model.visual.blocks.1.attn.proj.weight": "model-00014-of-00014.safetensors",
727
+ "model.visual.blocks.1.attn.qkv.bias": "model-00014-of-00014.safetensors",
728
+ "model.visual.blocks.1.attn.qkv.weight": "model-00014-of-00014.safetensors",
729
+ "model.visual.blocks.1.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
730
+ "model.visual.blocks.1.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
731
+ "model.visual.blocks.1.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
732
+ "model.visual.blocks.1.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
733
+ "model.visual.blocks.1.norm1.bias": "model-00014-of-00014.safetensors",
734
+ "model.visual.blocks.1.norm1.weight": "model-00014-of-00014.safetensors",
735
+ "model.visual.blocks.1.norm2.bias": "model-00014-of-00014.safetensors",
736
+ "model.visual.blocks.1.norm2.weight": "model-00014-of-00014.safetensors",
737
+ "model.visual.blocks.10.attn.proj.bias": "model-00014-of-00014.safetensors",
738
+ "model.visual.blocks.10.attn.proj.weight": "model-00014-of-00014.safetensors",
739
+ "model.visual.blocks.10.attn.qkv.bias": "model-00014-of-00014.safetensors",
740
+ "model.visual.blocks.10.attn.qkv.weight": "model-00014-of-00014.safetensors",
741
+ "model.visual.blocks.10.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
742
+ "model.visual.blocks.10.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
743
+ "model.visual.blocks.10.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
744
+ "model.visual.blocks.10.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
745
+ "model.visual.blocks.10.norm1.bias": "model-00014-of-00014.safetensors",
746
+ "model.visual.blocks.10.norm1.weight": "model-00014-of-00014.safetensors",
747
+ "model.visual.blocks.10.norm2.bias": "model-00014-of-00014.safetensors",
748
+ "model.visual.blocks.10.norm2.weight": "model-00014-of-00014.safetensors",
749
+ "model.visual.blocks.11.attn.proj.bias": "model-00014-of-00014.safetensors",
750
+ "model.visual.blocks.11.attn.proj.weight": "model-00014-of-00014.safetensors",
751
+ "model.visual.blocks.11.attn.qkv.bias": "model-00014-of-00014.safetensors",
752
+ "model.visual.blocks.11.attn.qkv.weight": "model-00014-of-00014.safetensors",
753
+ "model.visual.blocks.11.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
754
+ "model.visual.blocks.11.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
755
+ "model.visual.blocks.11.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
756
+ "model.visual.blocks.11.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
757
+ "model.visual.blocks.11.norm1.bias": "model-00014-of-00014.safetensors",
758
+ "model.visual.blocks.11.norm1.weight": "model-00014-of-00014.safetensors",
759
+ "model.visual.blocks.11.norm2.bias": "model-00014-of-00014.safetensors",
760
+ "model.visual.blocks.11.norm2.weight": "model-00014-of-00014.safetensors",
761
+ "model.visual.blocks.12.attn.proj.bias": "model-00014-of-00014.safetensors",
762
+ "model.visual.blocks.12.attn.proj.weight": "model-00014-of-00014.safetensors",
763
+ "model.visual.blocks.12.attn.qkv.bias": "model-00014-of-00014.safetensors",
764
+ "model.visual.blocks.12.attn.qkv.weight": "model-00014-of-00014.safetensors",
765
+ "model.visual.blocks.12.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
766
+ "model.visual.blocks.12.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
767
+ "model.visual.blocks.12.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
768
+ "model.visual.blocks.12.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
769
+ "model.visual.blocks.12.norm1.bias": "model-00014-of-00014.safetensors",
770
+ "model.visual.blocks.12.norm1.weight": "model-00014-of-00014.safetensors",
771
+ "model.visual.blocks.12.norm2.bias": "model-00014-of-00014.safetensors",
772
+ "model.visual.blocks.12.norm2.weight": "model-00014-of-00014.safetensors",
773
+ "model.visual.blocks.13.attn.proj.bias": "model-00014-of-00014.safetensors",
774
+ "model.visual.blocks.13.attn.proj.weight": "model-00014-of-00014.safetensors",
775
+ "model.visual.blocks.13.attn.qkv.bias": "model-00014-of-00014.safetensors",
776
+ "model.visual.blocks.13.attn.qkv.weight": "model-00014-of-00014.safetensors",
777
+ "model.visual.blocks.13.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
778
+ "model.visual.blocks.13.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
779
+ "model.visual.blocks.13.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
780
+ "model.visual.blocks.13.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
781
+ "model.visual.blocks.13.norm1.bias": "model-00014-of-00014.safetensors",
782
+ "model.visual.blocks.13.norm1.weight": "model-00014-of-00014.safetensors",
783
+ "model.visual.blocks.13.norm2.bias": "model-00014-of-00014.safetensors",
784
+ "model.visual.blocks.13.norm2.weight": "model-00014-of-00014.safetensors",
785
+ "model.visual.blocks.14.attn.proj.bias": "model-00014-of-00014.safetensors",
786
+ "model.visual.blocks.14.attn.proj.weight": "model-00014-of-00014.safetensors",
787
+ "model.visual.blocks.14.attn.qkv.bias": "model-00014-of-00014.safetensors",
788
+ "model.visual.blocks.14.attn.qkv.weight": "model-00014-of-00014.safetensors",
789
+ "model.visual.blocks.14.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
790
+ "model.visual.blocks.14.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
791
+ "model.visual.blocks.14.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
792
+ "model.visual.blocks.14.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
793
+ "model.visual.blocks.14.norm1.bias": "model-00014-of-00014.safetensors",
794
+ "model.visual.blocks.14.norm1.weight": "model-00014-of-00014.safetensors",
795
+ "model.visual.blocks.14.norm2.bias": "model-00014-of-00014.safetensors",
796
+ "model.visual.blocks.14.norm2.weight": "model-00014-of-00014.safetensors",
797
+ "model.visual.blocks.15.attn.proj.bias": "model-00014-of-00014.safetensors",
798
+ "model.visual.blocks.15.attn.proj.weight": "model-00014-of-00014.safetensors",
799
+ "model.visual.blocks.15.attn.qkv.bias": "model-00014-of-00014.safetensors",
800
+ "model.visual.blocks.15.attn.qkv.weight": "model-00014-of-00014.safetensors",
801
+ "model.visual.blocks.15.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
802
+ "model.visual.blocks.15.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
803
+ "model.visual.blocks.15.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
804
+ "model.visual.blocks.15.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
805
+ "model.visual.blocks.15.norm1.bias": "model-00014-of-00014.safetensors",
806
+ "model.visual.blocks.15.norm1.weight": "model-00014-of-00014.safetensors",
807
+ "model.visual.blocks.15.norm2.bias": "model-00014-of-00014.safetensors",
808
+ "model.visual.blocks.15.norm2.weight": "model-00014-of-00014.safetensors",
809
+ "model.visual.blocks.16.attn.proj.bias": "model-00014-of-00014.safetensors",
810
+ "model.visual.blocks.16.attn.proj.weight": "model-00014-of-00014.safetensors",
811
+ "model.visual.blocks.16.attn.qkv.bias": "model-00014-of-00014.safetensors",
812
+ "model.visual.blocks.16.attn.qkv.weight": "model-00014-of-00014.safetensors",
813
+ "model.visual.blocks.16.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
814
+ "model.visual.blocks.16.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
815
+ "model.visual.blocks.16.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
816
+ "model.visual.blocks.16.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
817
+ "model.visual.blocks.16.norm1.bias": "model-00014-of-00014.safetensors",
818
+ "model.visual.blocks.16.norm1.weight": "model-00014-of-00014.safetensors",
819
+ "model.visual.blocks.16.norm2.bias": "model-00014-of-00014.safetensors",
820
+ "model.visual.blocks.16.norm2.weight": "model-00014-of-00014.safetensors",
821
+ "model.visual.blocks.17.attn.proj.bias": "model-00014-of-00014.safetensors",
822
+ "model.visual.blocks.17.attn.proj.weight": "model-00014-of-00014.safetensors",
823
+ "model.visual.blocks.17.attn.qkv.bias": "model-00014-of-00014.safetensors",
824
+ "model.visual.blocks.17.attn.qkv.weight": "model-00014-of-00014.safetensors",
825
+ "model.visual.blocks.17.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
826
+ "model.visual.blocks.17.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
827
+ "model.visual.blocks.17.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
828
+ "model.visual.blocks.17.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
829
+ "model.visual.blocks.17.norm1.bias": "model-00014-of-00014.safetensors",
830
+ "model.visual.blocks.17.norm1.weight": "model-00014-of-00014.safetensors",
831
+ "model.visual.blocks.17.norm2.bias": "model-00014-of-00014.safetensors",
832
+ "model.visual.blocks.17.norm2.weight": "model-00014-of-00014.safetensors",
833
+ "model.visual.blocks.18.attn.proj.bias": "model-00014-of-00014.safetensors",
834
+ "model.visual.blocks.18.attn.proj.weight": "model-00014-of-00014.safetensors",
835
+ "model.visual.blocks.18.attn.qkv.bias": "model-00014-of-00014.safetensors",
836
+ "model.visual.blocks.18.attn.qkv.weight": "model-00014-of-00014.safetensors",
837
+ "model.visual.blocks.18.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
838
+ "model.visual.blocks.18.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
839
+ "model.visual.blocks.18.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
840
+ "model.visual.blocks.18.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
841
+ "model.visual.blocks.18.norm1.bias": "model-00014-of-00014.safetensors",
842
+ "model.visual.blocks.18.norm1.weight": "model-00014-of-00014.safetensors",
843
+ "model.visual.blocks.18.norm2.bias": "model-00014-of-00014.safetensors",
844
+ "model.visual.blocks.18.norm2.weight": "model-00014-of-00014.safetensors",
845
+ "model.visual.blocks.19.attn.proj.bias": "model-00014-of-00014.safetensors",
846
+ "model.visual.blocks.19.attn.proj.weight": "model-00014-of-00014.safetensors",
847
+ "model.visual.blocks.19.attn.qkv.bias": "model-00014-of-00014.safetensors",
848
+ "model.visual.blocks.19.attn.qkv.weight": "model-00014-of-00014.safetensors",
849
+ "model.visual.blocks.19.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
850
+ "model.visual.blocks.19.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
851
+ "model.visual.blocks.19.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
852
+ "model.visual.blocks.19.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
853
+ "model.visual.blocks.19.norm1.bias": "model-00014-of-00014.safetensors",
854
+ "model.visual.blocks.19.norm1.weight": "model-00014-of-00014.safetensors",
855
+ "model.visual.blocks.19.norm2.bias": "model-00014-of-00014.safetensors",
856
+ "model.visual.blocks.19.norm2.weight": "model-00014-of-00014.safetensors",
857
+ "model.visual.blocks.2.attn.proj.bias": "model-00014-of-00014.safetensors",
858
+ "model.visual.blocks.2.attn.proj.weight": "model-00014-of-00014.safetensors",
859
+ "model.visual.blocks.2.attn.qkv.bias": "model-00014-of-00014.safetensors",
860
+ "model.visual.blocks.2.attn.qkv.weight": "model-00014-of-00014.safetensors",
861
+ "model.visual.blocks.2.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
862
+ "model.visual.blocks.2.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
863
+ "model.visual.blocks.2.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
864
+ "model.visual.blocks.2.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
865
+ "model.visual.blocks.2.norm1.bias": "model-00014-of-00014.safetensors",
866
+ "model.visual.blocks.2.norm1.weight": "model-00014-of-00014.safetensors",
867
+ "model.visual.blocks.2.norm2.bias": "model-00014-of-00014.safetensors",
868
+ "model.visual.blocks.2.norm2.weight": "model-00014-of-00014.safetensors",
869
+ "model.visual.blocks.20.attn.proj.bias": "model-00014-of-00014.safetensors",
870
+ "model.visual.blocks.20.attn.proj.weight": "model-00014-of-00014.safetensors",
871
+ "model.visual.blocks.20.attn.qkv.bias": "model-00014-of-00014.safetensors",
872
+ "model.visual.blocks.20.attn.qkv.weight": "model-00014-of-00014.safetensors",
873
+ "model.visual.blocks.20.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
874
+ "model.visual.blocks.20.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
875
+ "model.visual.blocks.20.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
876
+ "model.visual.blocks.20.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
877
+ "model.visual.blocks.20.norm1.bias": "model-00014-of-00014.safetensors",
878
+ "model.visual.blocks.20.norm1.weight": "model-00014-of-00014.safetensors",
879
+ "model.visual.blocks.20.norm2.bias": "model-00014-of-00014.safetensors",
880
+ "model.visual.blocks.20.norm2.weight": "model-00014-of-00014.safetensors",
881
+ "model.visual.blocks.21.attn.proj.bias": "model-00014-of-00014.safetensors",
882
+ "model.visual.blocks.21.attn.proj.weight": "model-00014-of-00014.safetensors",
883
+ "model.visual.blocks.21.attn.qkv.bias": "model-00014-of-00014.safetensors",
884
+ "model.visual.blocks.21.attn.qkv.weight": "model-00014-of-00014.safetensors",
885
+ "model.visual.blocks.21.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
886
+ "model.visual.blocks.21.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
887
+ "model.visual.blocks.21.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
888
+ "model.visual.blocks.21.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
889
+ "model.visual.blocks.21.norm1.bias": "model-00014-of-00014.safetensors",
890
+ "model.visual.blocks.21.norm1.weight": "model-00014-of-00014.safetensors",
891
+ "model.visual.blocks.21.norm2.bias": "model-00014-of-00014.safetensors",
892
+ "model.visual.blocks.21.norm2.weight": "model-00014-of-00014.safetensors",
893
+ "model.visual.blocks.22.attn.proj.bias": "model-00014-of-00014.safetensors",
894
+ "model.visual.blocks.22.attn.proj.weight": "model-00014-of-00014.safetensors",
895
+ "model.visual.blocks.22.attn.qkv.bias": "model-00014-of-00014.safetensors",
896
+ "model.visual.blocks.22.attn.qkv.weight": "model-00014-of-00014.safetensors",
897
+ "model.visual.blocks.22.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
898
+ "model.visual.blocks.22.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
899
+ "model.visual.blocks.22.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
900
+ "model.visual.blocks.22.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
901
+ "model.visual.blocks.22.norm1.bias": "model-00014-of-00014.safetensors",
902
+ "model.visual.blocks.22.norm1.weight": "model-00014-of-00014.safetensors",
903
+ "model.visual.blocks.22.norm2.bias": "model-00014-of-00014.safetensors",
904
+ "model.visual.blocks.22.norm2.weight": "model-00014-of-00014.safetensors",
905
+ "model.visual.blocks.23.attn.proj.bias": "model-00014-of-00014.safetensors",
906
+ "model.visual.blocks.23.attn.proj.weight": "model-00014-of-00014.safetensors",
907
+ "model.visual.blocks.23.attn.qkv.bias": "model-00014-of-00014.safetensors",
908
+ "model.visual.blocks.23.attn.qkv.weight": "model-00014-of-00014.safetensors",
909
+ "model.visual.blocks.23.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
910
+ "model.visual.blocks.23.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
911
+ "model.visual.blocks.23.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
912
+ "model.visual.blocks.23.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
913
+ "model.visual.blocks.23.norm1.bias": "model-00014-of-00014.safetensors",
914
+ "model.visual.blocks.23.norm1.weight": "model-00014-of-00014.safetensors",
915
+ "model.visual.blocks.23.norm2.bias": "model-00014-of-00014.safetensors",
916
+ "model.visual.blocks.23.norm2.weight": "model-00014-of-00014.safetensors",
917
+ "model.visual.blocks.24.attn.proj.bias": "model-00014-of-00014.safetensors",
918
+ "model.visual.blocks.24.attn.proj.weight": "model-00014-of-00014.safetensors",
919
+ "model.visual.blocks.24.attn.qkv.bias": "model-00014-of-00014.safetensors",
920
+ "model.visual.blocks.24.attn.qkv.weight": "model-00014-of-00014.safetensors",
921
+ "model.visual.blocks.24.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
922
+ "model.visual.blocks.24.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
923
+ "model.visual.blocks.24.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
924
+ "model.visual.blocks.24.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
925
+ "model.visual.blocks.24.norm1.bias": "model-00014-of-00014.safetensors",
926
+ "model.visual.blocks.24.norm1.weight": "model-00014-of-00014.safetensors",
927
+ "model.visual.blocks.24.norm2.bias": "model-00014-of-00014.safetensors",
928
+ "model.visual.blocks.24.norm2.weight": "model-00014-of-00014.safetensors",
929
+ "model.visual.blocks.25.attn.proj.bias": "model-00014-of-00014.safetensors",
930
+ "model.visual.blocks.25.attn.proj.weight": "model-00014-of-00014.safetensors",
931
+ "model.visual.blocks.25.attn.qkv.bias": "model-00014-of-00014.safetensors",
932
+ "model.visual.blocks.25.attn.qkv.weight": "model-00014-of-00014.safetensors",
933
+ "model.visual.blocks.25.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
934
+ "model.visual.blocks.25.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
935
+ "model.visual.blocks.25.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
936
+ "model.visual.blocks.25.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
937
+ "model.visual.blocks.25.norm1.bias": "model-00014-of-00014.safetensors",
938
+ "model.visual.blocks.25.norm1.weight": "model-00014-of-00014.safetensors",
939
+ "model.visual.blocks.25.norm2.bias": "model-00014-of-00014.safetensors",
940
+ "model.visual.blocks.25.norm2.weight": "model-00014-of-00014.safetensors",
941
+ "model.visual.blocks.26.attn.proj.bias": "model-00014-of-00014.safetensors",
942
+ "model.visual.blocks.26.attn.proj.weight": "model-00014-of-00014.safetensors",
943
+ "model.visual.blocks.26.attn.qkv.bias": "model-00014-of-00014.safetensors",
944
+ "model.visual.blocks.26.attn.qkv.weight": "model-00014-of-00014.safetensors",
945
+ "model.visual.blocks.26.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
946
+ "model.visual.blocks.26.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
947
+ "model.visual.blocks.26.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
948
+ "model.visual.blocks.26.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
949
+ "model.visual.blocks.26.norm1.bias": "model-00014-of-00014.safetensors",
950
+ "model.visual.blocks.26.norm1.weight": "model-00014-of-00014.safetensors",
951
+ "model.visual.blocks.26.norm2.bias": "model-00014-of-00014.safetensors",
952
+ "model.visual.blocks.26.norm2.weight": "model-00014-of-00014.safetensors",
953
+ "model.visual.blocks.3.attn.proj.bias": "model-00014-of-00014.safetensors",
954
+ "model.visual.blocks.3.attn.proj.weight": "model-00014-of-00014.safetensors",
955
+ "model.visual.blocks.3.attn.qkv.bias": "model-00014-of-00014.safetensors",
956
+ "model.visual.blocks.3.attn.qkv.weight": "model-00014-of-00014.safetensors",
957
+ "model.visual.blocks.3.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
958
+ "model.visual.blocks.3.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
959
+ "model.visual.blocks.3.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
960
+ "model.visual.blocks.3.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
961
+ "model.visual.blocks.3.norm1.bias": "model-00014-of-00014.safetensors",
962
+ "model.visual.blocks.3.norm1.weight": "model-00014-of-00014.safetensors",
963
+ "model.visual.blocks.3.norm2.bias": "model-00014-of-00014.safetensors",
964
+ "model.visual.blocks.3.norm2.weight": "model-00014-of-00014.safetensors",
965
+ "model.visual.blocks.4.attn.proj.bias": "model-00014-of-00014.safetensors",
966
+ "model.visual.blocks.4.attn.proj.weight": "model-00014-of-00014.safetensors",
967
+ "model.visual.blocks.4.attn.qkv.bias": "model-00014-of-00014.safetensors",
968
+ "model.visual.blocks.4.attn.qkv.weight": "model-00014-of-00014.safetensors",
969
+ "model.visual.blocks.4.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
970
+ "model.visual.blocks.4.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
971
+ "model.visual.blocks.4.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
972
+ "model.visual.blocks.4.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
973
+ "model.visual.blocks.4.norm1.bias": "model-00014-of-00014.safetensors",
974
+ "model.visual.blocks.4.norm1.weight": "model-00014-of-00014.safetensors",
975
+ "model.visual.blocks.4.norm2.bias": "model-00014-of-00014.safetensors",
976
+ "model.visual.blocks.4.norm2.weight": "model-00014-of-00014.safetensors",
977
+ "model.visual.blocks.5.attn.proj.bias": "model-00014-of-00014.safetensors",
978
+ "model.visual.blocks.5.attn.proj.weight": "model-00014-of-00014.safetensors",
979
+ "model.visual.blocks.5.attn.qkv.bias": "model-00014-of-00014.safetensors",
980
+ "model.visual.blocks.5.attn.qkv.weight": "model-00014-of-00014.safetensors",
981
+ "model.visual.blocks.5.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
982
+ "model.visual.blocks.5.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
983
+ "model.visual.blocks.5.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
984
+ "model.visual.blocks.5.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
985
+ "model.visual.blocks.5.norm1.bias": "model-00014-of-00014.safetensors",
986
+ "model.visual.blocks.5.norm1.weight": "model-00014-of-00014.safetensors",
987
+ "model.visual.blocks.5.norm2.bias": "model-00014-of-00014.safetensors",
988
+ "model.visual.blocks.5.norm2.weight": "model-00014-of-00014.safetensors",
989
+ "model.visual.blocks.6.attn.proj.bias": "model-00014-of-00014.safetensors",
990
+ "model.visual.blocks.6.attn.proj.weight": "model-00014-of-00014.safetensors",
991
+ "model.visual.blocks.6.attn.qkv.bias": "model-00014-of-00014.safetensors",
992
+ "model.visual.blocks.6.attn.qkv.weight": "model-00014-of-00014.safetensors",
993
+ "model.visual.blocks.6.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
994
+ "model.visual.blocks.6.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
995
+ "model.visual.blocks.6.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
996
+ "model.visual.blocks.6.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
997
+ "model.visual.blocks.6.norm1.bias": "model-00014-of-00014.safetensors",
998
+ "model.visual.blocks.6.norm1.weight": "model-00014-of-00014.safetensors",
999
+ "model.visual.blocks.6.norm2.bias": "model-00014-of-00014.safetensors",
1000
+ "model.visual.blocks.6.norm2.weight": "model-00014-of-00014.safetensors",
1001
+ "model.visual.blocks.7.attn.proj.bias": "model-00014-of-00014.safetensors",
1002
+ "model.visual.blocks.7.attn.proj.weight": "model-00014-of-00014.safetensors",
1003
+ "model.visual.blocks.7.attn.qkv.bias": "model-00014-of-00014.safetensors",
1004
+ "model.visual.blocks.7.attn.qkv.weight": "model-00014-of-00014.safetensors",
1005
+ "model.visual.blocks.7.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1006
+ "model.visual.blocks.7.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1007
+ "model.visual.blocks.7.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1008
+ "model.visual.blocks.7.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1009
+ "model.visual.blocks.7.norm1.bias": "model-00014-of-00014.safetensors",
1010
+ "model.visual.blocks.7.norm1.weight": "model-00014-of-00014.safetensors",
1011
+ "model.visual.blocks.7.norm2.bias": "model-00014-of-00014.safetensors",
1012
+ "model.visual.blocks.7.norm2.weight": "model-00014-of-00014.safetensors",
1013
+ "model.visual.blocks.8.attn.proj.bias": "model-00014-of-00014.safetensors",
1014
+ "model.visual.blocks.8.attn.proj.weight": "model-00014-of-00014.safetensors",
1015
+ "model.visual.blocks.8.attn.qkv.bias": "model-00014-of-00014.safetensors",
1016
+ "model.visual.blocks.8.attn.qkv.weight": "model-00014-of-00014.safetensors",
1017
+ "model.visual.blocks.8.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1018
+ "model.visual.blocks.8.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1019
+ "model.visual.blocks.8.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1020
+ "model.visual.blocks.8.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1021
+ "model.visual.blocks.8.norm1.bias": "model-00014-of-00014.safetensors",
1022
+ "model.visual.blocks.8.norm1.weight": "model-00014-of-00014.safetensors",
1023
+ "model.visual.blocks.8.norm2.bias": "model-00014-of-00014.safetensors",
1024
+ "model.visual.blocks.8.norm2.weight": "model-00014-of-00014.safetensors",
1025
+ "model.visual.blocks.9.attn.proj.bias": "model-00014-of-00014.safetensors",
1026
+ "model.visual.blocks.9.attn.proj.weight": "model-00014-of-00014.safetensors",
1027
+ "model.visual.blocks.9.attn.qkv.bias": "model-00014-of-00014.safetensors",
1028
+ "model.visual.blocks.9.attn.qkv.weight": "model-00014-of-00014.safetensors",
1029
+ "model.visual.blocks.9.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1030
+ "model.visual.blocks.9.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1031
+ "model.visual.blocks.9.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1032
+ "model.visual.blocks.9.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1033
+ "model.visual.blocks.9.norm1.bias": "model-00014-of-00014.safetensors",
1034
+ "model.visual.blocks.9.norm1.weight": "model-00014-of-00014.safetensors",
1035
+ "model.visual.blocks.9.norm2.bias": "model-00014-of-00014.safetensors",
1036
+ "model.visual.blocks.9.norm2.weight": "model-00014-of-00014.safetensors",
1037
+ "model.visual.deepstack_merger_list.0.linear_fc1.bias": "model-00014-of-00014.safetensors",
1038
+ "model.visual.deepstack_merger_list.0.linear_fc1.weight": "model-00014-of-00014.safetensors",
1039
+ "model.visual.deepstack_merger_list.0.linear_fc2.bias": "model-00014-of-00014.safetensors",
1040
+ "model.visual.deepstack_merger_list.0.linear_fc2.weight": "model-00014-of-00014.safetensors",
1041
+ "model.visual.deepstack_merger_list.0.norm.bias": "model-00014-of-00014.safetensors",
1042
+ "model.visual.deepstack_merger_list.0.norm.weight": "model-00014-of-00014.safetensors",
1043
+ "model.visual.deepstack_merger_list.1.linear_fc1.bias": "model-00014-of-00014.safetensors",
1044
+ "model.visual.deepstack_merger_list.1.linear_fc1.weight": "model-00014-of-00014.safetensors",
1045
+ "model.visual.deepstack_merger_list.1.linear_fc2.bias": "model-00014-of-00014.safetensors",
1046
+ "model.visual.deepstack_merger_list.1.linear_fc2.weight": "model-00014-of-00014.safetensors",
1047
+ "model.visual.deepstack_merger_list.1.norm.bias": "model-00014-of-00014.safetensors",
1048
+ "model.visual.deepstack_merger_list.1.norm.weight": "model-00014-of-00014.safetensors",
1049
+ "model.visual.deepstack_merger_list.2.linear_fc1.bias": "model-00014-of-00014.safetensors",
1050
+ "model.visual.deepstack_merger_list.2.linear_fc1.weight": "model-00014-of-00014.safetensors",
1051
+ "model.visual.deepstack_merger_list.2.linear_fc2.bias": "model-00014-of-00014.safetensors",
1052
+ "model.visual.deepstack_merger_list.2.linear_fc2.weight": "model-00014-of-00014.safetensors",
1053
+ "model.visual.deepstack_merger_list.2.norm.bias": "model-00014-of-00014.safetensors",
1054
+ "model.visual.deepstack_merger_list.2.norm.weight": "model-00014-of-00014.safetensors",
1055
+ "model.visual.merger.linear_fc1.bias": "model-00014-of-00014.safetensors",
1056
+ "model.visual.merger.linear_fc1.weight": "model-00014-of-00014.safetensors",
1057
+ "model.visual.merger.linear_fc2.bias": "model-00014-of-00014.safetensors",
1058
+ "model.visual.merger.linear_fc2.weight": "model-00014-of-00014.safetensors",
1059
+ "model.visual.merger.norm.bias": "model-00014-of-00014.safetensors",
1060
+ "model.visual.merger.norm.weight": "model-00014-of-00014.safetensors",
1061
+ "model.visual.patch_embed.proj.bias": "model-00014-of-00014.safetensors",
1062
+ "model.visual.patch_embed.proj.weight": "model-00014-of-00014.safetensors",
1063
+ "model.visual.pos_embed.weight": "model-00014-of-00014.safetensors"
1064
+ }
1065
+ }
text_encoder/preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 16777216,
4
+ "shortest_edge": 65536
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "image_processor_type": "Qwen2VLImageProcessorFast"
21
+ }
text_encoder/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
text_encoder/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
text_encoder/video_preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 25165824,
4
+ "shortest_edge": 4096
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "video_processor_type": "Qwen3VLVideoProcessor"
21
+ }
text_encoder/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
transformer/config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Transformer3DModel",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "num_attention_heads": 56,
5
+ "attention_head_dim": 128,
6
+ "hidden_size": 5376,
7
+ "num_layers": 50,
8
+ "num_refiner_layers": 2,
9
+ "ffn_dim": 14336,
10
+ "in_channels": 24,
11
+ "audio_in_channels": 32,
12
+ "patch_size": [
13
+ 1,
14
+ 2,
15
+ 2
16
+ ],
17
+ "text_dim": 5120,
18
+ "freq_dim": 256,
19
+ "time_embed_hidden_dim": 5376,
20
+ "time_embed_dim": 2688,
21
+ "rope_freq_dim": 16,
22
+ "rope_theta": 10000.0,
23
+ "norm_eps": 1e-05,
24
+ "qk_norm_eps": 1e-05,
25
+ "final_norm_eps": 1e-05
26
+ }
transformer/diffusion_pytorch_model-00002-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a11227cb6c67446498fc44a92bf45683425da4e06ca09282a2707a260e90584
3
+ size 3989259848
transformer/diffusion_pytorch_model-00003-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aafaa4c41e4022d58f236b990672545e829c9629a678a0dc4e220a4d29a1446
3
+ size 3989259864
transformer/diffusion_pytorch_model-00007-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8ceaad5fdfd8bb70ffff4c4c5d0cb164f05e609fc3a428b1e171d2ad519c6a6
3
+ size 3989259832
transformer/diffusion_pytorch_model-00008-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f29d771bad140fffc723d3c9fa4910cf3d450058387c83f74b974ee61b0dee5e
3
+ size 3989259864
transformer/diffusion_pytorch_model-00009-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49da116f9b79e3a1b50b3085cbaa62ed1511f498ec1e209544a1567183456dab
3
+ size 3546104680
transformer/diffusion_pytorch_model-00010-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:550290b051f89ca10a40209fd3d79334e91110088a522cc9544776b43aa17da8
3
+ size 4099832972
transformer/diffusion_pytorch_model.safetensors.index.json ADDED
@@ -0,0 +1,895 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 70099502592
4
+ },
5
+ "weight_map": {
6
+ "audio_proj_in.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
7
+ "audio_proj_in.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
8
+ "audio_proj_out.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
9
+ "audio_proj_out.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
10
+ "context_embedder.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
11
+ "context_embedder.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
12
+ "norm_out.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
13
+ "norm_out.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
14
+ "norm_out.norm.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
15
+ "proj_in.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
16
+ "proj_in.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
17
+ "proj_out.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
18
+ "proj_out.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
19
+ "time_embedder.linear_1.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
20
+ "time_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
21
+ "time_embedder.linear_2.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
22
+ "time_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
23
+ "token_refiner.final_norm.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
24
+ "token_refiner.refiner_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
25
+ "token_refiner.refiner_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
26
+ "token_refiner.refiner_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
27
+ "token_refiner.refiner_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
28
+ "token_refiner.refiner_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
29
+ "token_refiner.refiner_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
30
+ "token_refiner.refiner_blocks.0.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
31
+ "token_refiner.refiner_blocks.0.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
32
+ "token_refiner.refiner_blocks.0.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
33
+ "token_refiner.refiner_blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
34
+ "token_refiner.refiner_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
35
+ "token_refiner.refiner_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
36
+ "token_refiner.refiner_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
37
+ "token_refiner.refiner_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
38
+ "token_refiner.refiner_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
39
+ "token_refiner.refiner_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
40
+ "token_refiner.refiner_blocks.1.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
41
+ "token_refiner.refiner_blocks.1.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
42
+ "token_refiner.refiner_blocks.1.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
43
+ "token_refiner.refiner_blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
44
+ "transformer_blocks.0.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
45
+ "transformer_blocks.0.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
46
+ "transformer_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
47
+ "transformer_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
48
+ "transformer_blocks.0.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
49
+ "transformer_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
50
+ "transformer_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
51
+ "transformer_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
52
+ "transformer_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
53
+ "transformer_blocks.0.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
54
+ "transformer_blocks.0.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
55
+ "transformer_blocks.0.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
56
+ "transformer_blocks.0.ff.net.2.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
57
+ "transformer_blocks.0.ff.net.2.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
58
+ "transformer_blocks.0.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
59
+ "transformer_blocks.0.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
60
+ "transformer_blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
61
+ "transformer_blocks.1.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
62
+ "transformer_blocks.1.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
63
+ "transformer_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
64
+ "transformer_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
65
+ "transformer_blocks.1.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
66
+ "transformer_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
67
+ "transformer_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
68
+ "transformer_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
69
+ "transformer_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
70
+ "transformer_blocks.1.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
71
+ "transformer_blocks.1.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
72
+ "transformer_blocks.1.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
73
+ "transformer_blocks.1.ff.net.2.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
74
+ "transformer_blocks.1.ff.net.2.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
75
+ "transformer_blocks.1.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
76
+ "transformer_blocks.1.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
77
+ "transformer_blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
78
+ "transformer_blocks.10.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
79
+ "transformer_blocks.10.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
80
+ "transformer_blocks.10.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
81
+ "transformer_blocks.10.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
82
+ "transformer_blocks.10.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
83
+ "transformer_blocks.10.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
84
+ "transformer_blocks.10.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
85
+ "transformer_blocks.10.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
86
+ "transformer_blocks.10.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
87
+ "transformer_blocks.10.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
88
+ "transformer_blocks.10.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
89
+ "transformer_blocks.10.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
90
+ "transformer_blocks.10.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
91
+ "transformer_blocks.10.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
92
+ "transformer_blocks.10.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
93
+ "transformer_blocks.10.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
94
+ "transformer_blocks.10.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
95
+ "transformer_blocks.11.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
96
+ "transformer_blocks.11.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
97
+ "transformer_blocks.11.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
98
+ "transformer_blocks.11.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
99
+ "transformer_blocks.11.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
100
+ "transformer_blocks.11.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
101
+ "transformer_blocks.11.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
102
+ "transformer_blocks.11.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
103
+ "transformer_blocks.11.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
104
+ "transformer_blocks.11.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
105
+ "transformer_blocks.11.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
106
+ "transformer_blocks.11.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
107
+ "transformer_blocks.11.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
108
+ "transformer_blocks.11.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
109
+ "transformer_blocks.11.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
110
+ "transformer_blocks.11.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
111
+ "transformer_blocks.11.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
112
+ "transformer_blocks.12.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
113
+ "transformer_blocks.12.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
114
+ "transformer_blocks.12.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
115
+ "transformer_blocks.12.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
116
+ "transformer_blocks.12.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
117
+ "transformer_blocks.12.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
118
+ "transformer_blocks.12.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
119
+ "transformer_blocks.12.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
120
+ "transformer_blocks.12.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
121
+ "transformer_blocks.12.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
122
+ "transformer_blocks.12.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
123
+ "transformer_blocks.12.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
124
+ "transformer_blocks.12.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
125
+ "transformer_blocks.12.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
126
+ "transformer_blocks.12.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
127
+ "transformer_blocks.12.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
128
+ "transformer_blocks.12.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
129
+ "transformer_blocks.13.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
130
+ "transformer_blocks.13.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
131
+ "transformer_blocks.13.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
132
+ "transformer_blocks.13.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
133
+ "transformer_blocks.13.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
134
+ "transformer_blocks.13.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
135
+ "transformer_blocks.13.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
136
+ "transformer_blocks.13.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
137
+ "transformer_blocks.13.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
138
+ "transformer_blocks.13.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
139
+ "transformer_blocks.13.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
140
+ "transformer_blocks.13.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
141
+ "transformer_blocks.13.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
142
+ "transformer_blocks.13.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
143
+ "transformer_blocks.13.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
144
+ "transformer_blocks.13.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
145
+ "transformer_blocks.13.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
146
+ "transformer_blocks.14.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
147
+ "transformer_blocks.14.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
148
+ "transformer_blocks.14.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
149
+ "transformer_blocks.14.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
150
+ "transformer_blocks.14.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
151
+ "transformer_blocks.14.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
152
+ "transformer_blocks.14.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
153
+ "transformer_blocks.14.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
154
+ "transformer_blocks.14.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
155
+ "transformer_blocks.14.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
156
+ "transformer_blocks.14.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
157
+ "transformer_blocks.14.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
158
+ "transformer_blocks.14.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
159
+ "transformer_blocks.14.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
160
+ "transformer_blocks.14.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
161
+ "transformer_blocks.14.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
162
+ "transformer_blocks.14.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
163
+ "transformer_blocks.15.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
164
+ "transformer_blocks.15.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
165
+ "transformer_blocks.15.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
166
+ "transformer_blocks.15.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
167
+ "transformer_blocks.15.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
168
+ "transformer_blocks.15.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
169
+ "transformer_blocks.15.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
170
+ "transformer_blocks.15.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
171
+ "transformer_blocks.15.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
172
+ "transformer_blocks.15.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
173
+ "transformer_blocks.15.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
174
+ "transformer_blocks.15.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
175
+ "transformer_blocks.15.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
176
+ "transformer_blocks.15.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
177
+ "transformer_blocks.15.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
178
+ "transformer_blocks.15.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
179
+ "transformer_blocks.15.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
180
+ "transformer_blocks.16.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
181
+ "transformer_blocks.16.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
182
+ "transformer_blocks.16.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
183
+ "transformer_blocks.16.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
184
+ "transformer_blocks.16.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
185
+ "transformer_blocks.16.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
186
+ "transformer_blocks.16.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
187
+ "transformer_blocks.16.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
188
+ "transformer_blocks.16.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
189
+ "transformer_blocks.16.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
190
+ "transformer_blocks.16.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
191
+ "transformer_blocks.16.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
192
+ "transformer_blocks.16.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
193
+ "transformer_blocks.16.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
194
+ "transformer_blocks.16.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
195
+ "transformer_blocks.16.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
196
+ "transformer_blocks.16.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
197
+ "transformer_blocks.17.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
198
+ "transformer_blocks.17.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
199
+ "transformer_blocks.17.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
200
+ "transformer_blocks.17.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
201
+ "transformer_blocks.17.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
202
+ "transformer_blocks.17.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
203
+ "transformer_blocks.17.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
204
+ "transformer_blocks.17.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
205
+ "transformer_blocks.17.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
206
+ "transformer_blocks.17.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
207
+ "transformer_blocks.17.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
208
+ "transformer_blocks.17.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
209
+ "transformer_blocks.17.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
210
+ "transformer_blocks.17.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
211
+ "transformer_blocks.17.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
212
+ "transformer_blocks.17.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
213
+ "transformer_blocks.17.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
214
+ "transformer_blocks.18.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
215
+ "transformer_blocks.18.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
216
+ "transformer_blocks.18.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
217
+ "transformer_blocks.18.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
218
+ "transformer_blocks.18.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
219
+ "transformer_blocks.18.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
220
+ "transformer_blocks.18.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
221
+ "transformer_blocks.18.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
222
+ "transformer_blocks.18.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
223
+ "transformer_blocks.18.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
224
+ "transformer_blocks.18.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
225
+ "transformer_blocks.18.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
226
+ "transformer_blocks.18.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
227
+ "transformer_blocks.18.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
228
+ "transformer_blocks.18.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
229
+ "transformer_blocks.18.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
230
+ "transformer_blocks.18.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
231
+ "transformer_blocks.19.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
232
+ "transformer_blocks.19.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
233
+ "transformer_blocks.19.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
234
+ "transformer_blocks.19.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
235
+ "transformer_blocks.19.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
236
+ "transformer_blocks.19.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
237
+ "transformer_blocks.19.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
238
+ "transformer_blocks.19.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
239
+ "transformer_blocks.19.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
240
+ "transformer_blocks.19.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
241
+ "transformer_blocks.19.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
242
+ "transformer_blocks.19.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
243
+ "transformer_blocks.19.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
244
+ "transformer_blocks.19.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
245
+ "transformer_blocks.19.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
246
+ "transformer_blocks.19.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
247
+ "transformer_blocks.19.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
248
+ "transformer_blocks.2.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
249
+ "transformer_blocks.2.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
250
+ "transformer_blocks.2.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
251
+ "transformer_blocks.2.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
252
+ "transformer_blocks.2.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
253
+ "transformer_blocks.2.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
254
+ "transformer_blocks.2.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
255
+ "transformer_blocks.2.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
256
+ "transformer_blocks.2.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
257
+ "transformer_blocks.2.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
258
+ "transformer_blocks.2.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
259
+ "transformer_blocks.2.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
260
+ "transformer_blocks.2.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
261
+ "transformer_blocks.2.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
262
+ "transformer_blocks.2.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
263
+ "transformer_blocks.2.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
264
+ "transformer_blocks.2.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
265
+ "transformer_blocks.20.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
266
+ "transformer_blocks.20.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
267
+ "transformer_blocks.20.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
268
+ "transformer_blocks.20.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
269
+ "transformer_blocks.20.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
270
+ "transformer_blocks.20.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
271
+ "transformer_blocks.20.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
272
+ "transformer_blocks.20.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
273
+ "transformer_blocks.20.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
274
+ "transformer_blocks.20.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
275
+ "transformer_blocks.20.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
276
+ "transformer_blocks.20.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
277
+ "transformer_blocks.20.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
278
+ "transformer_blocks.20.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
279
+ "transformer_blocks.20.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
280
+ "transformer_blocks.20.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
281
+ "transformer_blocks.20.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
282
+ "transformer_blocks.21.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
283
+ "transformer_blocks.21.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
284
+ "transformer_blocks.21.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
285
+ "transformer_blocks.21.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
286
+ "transformer_blocks.21.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
287
+ "transformer_blocks.21.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
288
+ "transformer_blocks.21.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
289
+ "transformer_blocks.21.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
290
+ "transformer_blocks.21.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
291
+ "transformer_blocks.21.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
292
+ "transformer_blocks.21.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
293
+ "transformer_blocks.21.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
294
+ "transformer_blocks.21.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
295
+ "transformer_blocks.21.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
296
+ "transformer_blocks.21.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
297
+ "transformer_blocks.21.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
298
+ "transformer_blocks.21.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
299
+ "transformer_blocks.22.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
300
+ "transformer_blocks.22.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
301
+ "transformer_blocks.22.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
302
+ "transformer_blocks.22.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
303
+ "transformer_blocks.22.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
304
+ "transformer_blocks.22.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
305
+ "transformer_blocks.22.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
306
+ "transformer_blocks.22.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
307
+ "transformer_blocks.22.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
308
+ "transformer_blocks.22.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
309
+ "transformer_blocks.22.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
310
+ "transformer_blocks.22.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
311
+ "transformer_blocks.22.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
312
+ "transformer_blocks.22.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
313
+ "transformer_blocks.22.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
314
+ "transformer_blocks.22.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
315
+ "transformer_blocks.22.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
316
+ "transformer_blocks.23.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
317
+ "transformer_blocks.23.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
318
+ "transformer_blocks.23.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
319
+ "transformer_blocks.23.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
320
+ "transformer_blocks.23.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
321
+ "transformer_blocks.23.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
322
+ "transformer_blocks.23.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
323
+ "transformer_blocks.23.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
324
+ "transformer_blocks.23.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
325
+ "transformer_blocks.23.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
326
+ "transformer_blocks.23.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
327
+ "transformer_blocks.23.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
328
+ "transformer_blocks.23.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
329
+ "transformer_blocks.23.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
330
+ "transformer_blocks.23.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
331
+ "transformer_blocks.23.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
332
+ "transformer_blocks.23.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
333
+ "transformer_blocks.24.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
334
+ "transformer_blocks.24.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
335
+ "transformer_blocks.24.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
336
+ "transformer_blocks.24.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
337
+ "transformer_blocks.24.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
338
+ "transformer_blocks.24.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
339
+ "transformer_blocks.24.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
340
+ "transformer_blocks.24.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
341
+ "transformer_blocks.24.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
342
+ "transformer_blocks.24.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
343
+ "transformer_blocks.24.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
344
+ "transformer_blocks.24.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
345
+ "transformer_blocks.24.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
346
+ "transformer_blocks.24.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
347
+ "transformer_blocks.24.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
348
+ "transformer_blocks.24.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
349
+ "transformer_blocks.24.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
350
+ "transformer_blocks.25.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
351
+ "transformer_blocks.25.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
352
+ "transformer_blocks.25.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
353
+ "transformer_blocks.25.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
354
+ "transformer_blocks.25.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
355
+ "transformer_blocks.25.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
356
+ "transformer_blocks.25.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
357
+ "transformer_blocks.25.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
358
+ "transformer_blocks.25.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
359
+ "transformer_blocks.25.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
360
+ "transformer_blocks.25.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
361
+ "transformer_blocks.25.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
362
+ "transformer_blocks.25.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
363
+ "transformer_blocks.25.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
364
+ "transformer_blocks.25.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
365
+ "transformer_blocks.25.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
366
+ "transformer_blocks.25.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
367
+ "transformer_blocks.26.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
368
+ "transformer_blocks.26.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
369
+ "transformer_blocks.26.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
370
+ "transformer_blocks.26.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
371
+ "transformer_blocks.26.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
372
+ "transformer_blocks.26.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
373
+ "transformer_blocks.26.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
374
+ "transformer_blocks.26.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
375
+ "transformer_blocks.26.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
376
+ "transformer_blocks.26.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
377
+ "transformer_blocks.26.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
378
+ "transformer_blocks.26.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
379
+ "transformer_blocks.26.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
380
+ "transformer_blocks.26.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
381
+ "transformer_blocks.26.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
382
+ "transformer_blocks.26.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
383
+ "transformer_blocks.26.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
384
+ "transformer_blocks.27.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
385
+ "transformer_blocks.27.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
386
+ "transformer_blocks.27.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
387
+ "transformer_blocks.27.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
388
+ "transformer_blocks.27.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
389
+ "transformer_blocks.27.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
390
+ "transformer_blocks.27.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
391
+ "transformer_blocks.27.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
392
+ "transformer_blocks.27.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
393
+ "transformer_blocks.27.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
394
+ "transformer_blocks.27.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
395
+ "transformer_blocks.27.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
396
+ "transformer_blocks.27.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
397
+ "transformer_blocks.27.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
398
+ "transformer_blocks.27.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
399
+ "transformer_blocks.27.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
400
+ "transformer_blocks.27.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
401
+ "transformer_blocks.28.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
402
+ "transformer_blocks.28.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
403
+ "transformer_blocks.28.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
404
+ "transformer_blocks.28.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
405
+ "transformer_blocks.28.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
406
+ "transformer_blocks.28.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
407
+ "transformer_blocks.28.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
408
+ "transformer_blocks.28.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
409
+ "transformer_blocks.28.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
410
+ "transformer_blocks.28.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
411
+ "transformer_blocks.28.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
412
+ "transformer_blocks.28.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
413
+ "transformer_blocks.28.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
414
+ "transformer_blocks.28.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
415
+ "transformer_blocks.28.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
416
+ "transformer_blocks.28.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
417
+ "transformer_blocks.28.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
418
+ "transformer_blocks.29.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
419
+ "transformer_blocks.29.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
420
+ "transformer_blocks.29.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
421
+ "transformer_blocks.29.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
422
+ "transformer_blocks.29.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
423
+ "transformer_blocks.29.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
424
+ "transformer_blocks.29.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
425
+ "transformer_blocks.29.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
426
+ "transformer_blocks.29.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
427
+ "transformer_blocks.29.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
428
+ "transformer_blocks.29.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
429
+ "transformer_blocks.29.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
430
+ "transformer_blocks.29.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
431
+ "transformer_blocks.29.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
432
+ "transformer_blocks.29.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
433
+ "transformer_blocks.29.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
434
+ "transformer_blocks.29.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
435
+ "transformer_blocks.3.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
436
+ "transformer_blocks.3.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
437
+ "transformer_blocks.3.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
438
+ "transformer_blocks.3.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
439
+ "transformer_blocks.3.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
440
+ "transformer_blocks.3.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
441
+ "transformer_blocks.3.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
442
+ "transformer_blocks.3.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
443
+ "transformer_blocks.3.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
444
+ "transformer_blocks.3.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
445
+ "transformer_blocks.3.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
446
+ "transformer_blocks.3.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
447
+ "transformer_blocks.3.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
448
+ "transformer_blocks.3.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
449
+ "transformer_blocks.3.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
450
+ "transformer_blocks.3.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
451
+ "transformer_blocks.3.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
452
+ "transformer_blocks.30.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
453
+ "transformer_blocks.30.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
454
+ "transformer_blocks.30.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
455
+ "transformer_blocks.30.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
456
+ "transformer_blocks.30.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
457
+ "transformer_blocks.30.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
458
+ "transformer_blocks.30.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
459
+ "transformer_blocks.30.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
460
+ "transformer_blocks.30.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
461
+ "transformer_blocks.30.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
462
+ "transformer_blocks.30.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
463
+ "transformer_blocks.30.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
464
+ "transformer_blocks.30.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
465
+ "transformer_blocks.30.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
466
+ "transformer_blocks.30.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
467
+ "transformer_blocks.30.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
468
+ "transformer_blocks.30.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
469
+ "transformer_blocks.31.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
470
+ "transformer_blocks.31.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
471
+ "transformer_blocks.31.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
472
+ "transformer_blocks.31.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
473
+ "transformer_blocks.31.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
474
+ "transformer_blocks.31.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
475
+ "transformer_blocks.31.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
476
+ "transformer_blocks.31.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
477
+ "transformer_blocks.31.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
478
+ "transformer_blocks.31.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
479
+ "transformer_blocks.31.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
480
+ "transformer_blocks.31.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
481
+ "transformer_blocks.31.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
482
+ "transformer_blocks.31.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
483
+ "transformer_blocks.31.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
484
+ "transformer_blocks.31.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
485
+ "transformer_blocks.31.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
486
+ "transformer_blocks.32.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
487
+ "transformer_blocks.32.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
488
+ "transformer_blocks.32.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
489
+ "transformer_blocks.32.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
490
+ "transformer_blocks.32.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
491
+ "transformer_blocks.32.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
492
+ "transformer_blocks.32.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
493
+ "transformer_blocks.32.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
494
+ "transformer_blocks.32.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
495
+ "transformer_blocks.32.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
496
+ "transformer_blocks.32.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
497
+ "transformer_blocks.32.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
498
+ "transformer_blocks.32.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
499
+ "transformer_blocks.32.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
500
+ "transformer_blocks.32.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
501
+ "transformer_blocks.32.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
502
+ "transformer_blocks.32.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
503
+ "transformer_blocks.33.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
504
+ "transformer_blocks.33.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
505
+ "transformer_blocks.33.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
506
+ "transformer_blocks.33.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
507
+ "transformer_blocks.33.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
508
+ "transformer_blocks.33.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
509
+ "transformer_blocks.33.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
510
+ "transformer_blocks.33.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
511
+ "transformer_blocks.33.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
512
+ "transformer_blocks.33.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
513
+ "transformer_blocks.33.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
514
+ "transformer_blocks.33.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
515
+ "transformer_blocks.33.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
516
+ "transformer_blocks.33.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
517
+ "transformer_blocks.33.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
518
+ "transformer_blocks.33.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
519
+ "transformer_blocks.33.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
520
+ "transformer_blocks.34.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
521
+ "transformer_blocks.34.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
522
+ "transformer_blocks.34.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
523
+ "transformer_blocks.34.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
524
+ "transformer_blocks.34.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
525
+ "transformer_blocks.34.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
526
+ "transformer_blocks.34.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
527
+ "transformer_blocks.34.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
528
+ "transformer_blocks.34.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
529
+ "transformer_blocks.34.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
530
+ "transformer_blocks.34.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
531
+ "transformer_blocks.34.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
532
+ "transformer_blocks.34.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
533
+ "transformer_blocks.34.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
534
+ "transformer_blocks.34.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
535
+ "transformer_blocks.34.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
536
+ "transformer_blocks.34.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
537
+ "transformer_blocks.35.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
538
+ "transformer_blocks.35.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
539
+ "transformer_blocks.35.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
540
+ "transformer_blocks.35.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
541
+ "transformer_blocks.35.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
542
+ "transformer_blocks.35.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
543
+ "transformer_blocks.35.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
544
+ "transformer_blocks.35.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
545
+ "transformer_blocks.35.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
546
+ "transformer_blocks.35.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
547
+ "transformer_blocks.35.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
548
+ "transformer_blocks.35.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
549
+ "transformer_blocks.35.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
550
+ "transformer_blocks.35.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
551
+ "transformer_blocks.35.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
552
+ "transformer_blocks.35.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
553
+ "transformer_blocks.35.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
554
+ "transformer_blocks.36.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
555
+ "transformer_blocks.36.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
556
+ "transformer_blocks.36.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
557
+ "transformer_blocks.36.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
558
+ "transformer_blocks.36.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
559
+ "transformer_blocks.36.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
560
+ "transformer_blocks.36.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
561
+ "transformer_blocks.36.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
562
+ "transformer_blocks.36.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
563
+ "transformer_blocks.36.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
564
+ "transformer_blocks.36.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
565
+ "transformer_blocks.36.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
566
+ "transformer_blocks.36.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
567
+ "transformer_blocks.36.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
568
+ "transformer_blocks.36.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
569
+ "transformer_blocks.36.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
570
+ "transformer_blocks.36.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
571
+ "transformer_blocks.37.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
572
+ "transformer_blocks.37.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
573
+ "transformer_blocks.37.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
574
+ "transformer_blocks.37.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
575
+ "transformer_blocks.37.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
576
+ "transformer_blocks.37.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
577
+ "transformer_blocks.37.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
578
+ "transformer_blocks.37.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
579
+ "transformer_blocks.37.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
580
+ "transformer_blocks.37.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
581
+ "transformer_blocks.37.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
582
+ "transformer_blocks.37.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
583
+ "transformer_blocks.37.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
584
+ "transformer_blocks.37.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
585
+ "transformer_blocks.37.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
586
+ "transformer_blocks.37.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
587
+ "transformer_blocks.37.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
588
+ "transformer_blocks.38.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
589
+ "transformer_blocks.38.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
590
+ "transformer_blocks.38.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
591
+ "transformer_blocks.38.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
592
+ "transformer_blocks.38.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
593
+ "transformer_blocks.38.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
594
+ "transformer_blocks.38.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
595
+ "transformer_blocks.38.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
596
+ "transformer_blocks.38.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
597
+ "transformer_blocks.38.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
598
+ "transformer_blocks.38.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
599
+ "transformer_blocks.38.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
600
+ "transformer_blocks.38.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
601
+ "transformer_blocks.38.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
602
+ "transformer_blocks.38.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
603
+ "transformer_blocks.38.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
604
+ "transformer_blocks.38.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
605
+ "transformer_blocks.39.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
606
+ "transformer_blocks.39.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
607
+ "transformer_blocks.39.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
608
+ "transformer_blocks.39.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
609
+ "transformer_blocks.39.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
610
+ "transformer_blocks.39.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
611
+ "transformer_blocks.39.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
612
+ "transformer_blocks.39.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
613
+ "transformer_blocks.39.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
614
+ "transformer_blocks.39.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
615
+ "transformer_blocks.39.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
616
+ "transformer_blocks.39.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
617
+ "transformer_blocks.39.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
618
+ "transformer_blocks.39.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
619
+ "transformer_blocks.39.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
620
+ "transformer_blocks.39.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
621
+ "transformer_blocks.39.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
622
+ "transformer_blocks.4.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
623
+ "transformer_blocks.4.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
624
+ "transformer_blocks.4.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
625
+ "transformer_blocks.4.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
626
+ "transformer_blocks.4.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
627
+ "transformer_blocks.4.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
628
+ "transformer_blocks.4.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
629
+ "transformer_blocks.4.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
630
+ "transformer_blocks.4.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
631
+ "transformer_blocks.4.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
632
+ "transformer_blocks.4.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
633
+ "transformer_blocks.4.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
634
+ "transformer_blocks.4.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
635
+ "transformer_blocks.4.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
636
+ "transformer_blocks.4.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
637
+ "transformer_blocks.4.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
638
+ "transformer_blocks.4.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
639
+ "transformer_blocks.40.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
640
+ "transformer_blocks.40.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
641
+ "transformer_blocks.40.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
642
+ "transformer_blocks.40.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
643
+ "transformer_blocks.40.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
644
+ "transformer_blocks.40.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
645
+ "transformer_blocks.40.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
646
+ "transformer_blocks.40.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
647
+ "transformer_blocks.40.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
648
+ "transformer_blocks.40.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
649
+ "transformer_blocks.40.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
650
+ "transformer_blocks.40.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
651
+ "transformer_blocks.40.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
652
+ "transformer_blocks.40.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
653
+ "transformer_blocks.40.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
654
+ "transformer_blocks.40.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
655
+ "transformer_blocks.40.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
656
+ "transformer_blocks.41.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
657
+ "transformer_blocks.41.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
658
+ "transformer_blocks.41.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
659
+ "transformer_blocks.41.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
660
+ "transformer_blocks.41.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
661
+ "transformer_blocks.41.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
662
+ "transformer_blocks.41.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
663
+ "transformer_blocks.41.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
664
+ "transformer_blocks.41.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
665
+ "transformer_blocks.41.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
666
+ "transformer_blocks.41.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
667
+ "transformer_blocks.41.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
668
+ "transformer_blocks.41.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
669
+ "transformer_blocks.41.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
670
+ "transformer_blocks.41.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
671
+ "transformer_blocks.41.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
672
+ "transformer_blocks.41.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
673
+ "transformer_blocks.42.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
674
+ "transformer_blocks.42.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
675
+ "transformer_blocks.42.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
676
+ "transformer_blocks.42.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
677
+ "transformer_blocks.42.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
678
+ "transformer_blocks.42.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
679
+ "transformer_blocks.42.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
680
+ "transformer_blocks.42.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
681
+ "transformer_blocks.42.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
682
+ "transformer_blocks.42.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
683
+ "transformer_blocks.42.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
684
+ "transformer_blocks.42.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
685
+ "transformer_blocks.42.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
686
+ "transformer_blocks.42.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
687
+ "transformer_blocks.42.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
688
+ "transformer_blocks.42.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
689
+ "transformer_blocks.42.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
690
+ "transformer_blocks.43.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
691
+ "transformer_blocks.43.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
692
+ "transformer_blocks.43.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
693
+ "transformer_blocks.43.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
694
+ "transformer_blocks.43.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
695
+ "transformer_blocks.43.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
696
+ "transformer_blocks.43.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
697
+ "transformer_blocks.43.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
698
+ "transformer_blocks.43.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
699
+ "transformer_blocks.43.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
700
+ "transformer_blocks.43.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
701
+ "transformer_blocks.43.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
702
+ "transformer_blocks.43.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
703
+ "transformer_blocks.43.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
704
+ "transformer_blocks.43.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
705
+ "transformer_blocks.43.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
706
+ "transformer_blocks.43.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
707
+ "transformer_blocks.44.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
708
+ "transformer_blocks.44.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
709
+ "transformer_blocks.44.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
710
+ "transformer_blocks.44.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
711
+ "transformer_blocks.44.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
712
+ "transformer_blocks.44.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
713
+ "transformer_blocks.44.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
714
+ "transformer_blocks.44.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
715
+ "transformer_blocks.44.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
716
+ "transformer_blocks.44.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
717
+ "transformer_blocks.44.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
718
+ "transformer_blocks.44.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
719
+ "transformer_blocks.44.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
720
+ "transformer_blocks.44.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
721
+ "transformer_blocks.44.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
722
+ "transformer_blocks.44.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
723
+ "transformer_blocks.44.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
724
+ "transformer_blocks.45.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
725
+ "transformer_blocks.45.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
726
+ "transformer_blocks.45.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
727
+ "transformer_blocks.45.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
728
+ "transformer_blocks.45.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
729
+ "transformer_blocks.45.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
730
+ "transformer_blocks.45.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
731
+ "transformer_blocks.45.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
732
+ "transformer_blocks.45.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
733
+ "transformer_blocks.45.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
734
+ "transformer_blocks.45.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
735
+ "transformer_blocks.45.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
736
+ "transformer_blocks.45.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
737
+ "transformer_blocks.45.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
738
+ "transformer_blocks.45.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
739
+ "transformer_blocks.45.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
740
+ "transformer_blocks.45.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
741
+ "transformer_blocks.46.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
742
+ "transformer_blocks.46.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
743
+ "transformer_blocks.46.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
744
+ "transformer_blocks.46.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
745
+ "transformer_blocks.46.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
746
+ "transformer_blocks.46.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
747
+ "transformer_blocks.46.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
748
+ "transformer_blocks.46.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
749
+ "transformer_blocks.46.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
750
+ "transformer_blocks.46.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
751
+ "transformer_blocks.46.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
752
+ "transformer_blocks.46.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
753
+ "transformer_blocks.46.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
754
+ "transformer_blocks.46.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
755
+ "transformer_blocks.46.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
756
+ "transformer_blocks.46.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
757
+ "transformer_blocks.46.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
758
+ "transformer_blocks.47.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
759
+ "transformer_blocks.47.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
760
+ "transformer_blocks.47.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
761
+ "transformer_blocks.47.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
762
+ "transformer_blocks.47.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
763
+ "transformer_blocks.47.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
764
+ "transformer_blocks.47.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
765
+ "transformer_blocks.47.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
766
+ "transformer_blocks.47.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
767
+ "transformer_blocks.47.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
768
+ "transformer_blocks.47.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
769
+ "transformer_blocks.47.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
770
+ "transformer_blocks.47.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
771
+ "transformer_blocks.47.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
772
+ "transformer_blocks.47.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
773
+ "transformer_blocks.47.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
774
+ "transformer_blocks.47.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
775
+ "transformer_blocks.48.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
776
+ "transformer_blocks.48.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
777
+ "transformer_blocks.48.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
778
+ "transformer_blocks.48.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
779
+ "transformer_blocks.48.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
780
+ "transformer_blocks.48.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
781
+ "transformer_blocks.48.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
782
+ "transformer_blocks.48.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
783
+ "transformer_blocks.48.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
784
+ "transformer_blocks.48.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
785
+ "transformer_blocks.48.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
786
+ "transformer_blocks.48.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
787
+ "transformer_blocks.48.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
788
+ "transformer_blocks.48.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
789
+ "transformer_blocks.48.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
790
+ "transformer_blocks.48.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
791
+ "transformer_blocks.48.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
792
+ "transformer_blocks.49.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
793
+ "transformer_blocks.49.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
794
+ "transformer_blocks.49.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
795
+ "transformer_blocks.49.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
796
+ "transformer_blocks.49.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
797
+ "transformer_blocks.49.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
798
+ "transformer_blocks.49.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
799
+ "transformer_blocks.49.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
800
+ "transformer_blocks.49.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
801
+ "transformer_blocks.49.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
802
+ "transformer_blocks.49.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
803
+ "transformer_blocks.49.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
804
+ "transformer_blocks.49.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
805
+ "transformer_blocks.49.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
806
+ "transformer_blocks.49.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
807
+ "transformer_blocks.49.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
808
+ "transformer_blocks.49.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
809
+ "transformer_blocks.5.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
810
+ "transformer_blocks.5.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
811
+ "transformer_blocks.5.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
812
+ "transformer_blocks.5.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
813
+ "transformer_blocks.5.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
814
+ "transformer_blocks.5.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
815
+ "transformer_blocks.5.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
816
+ "transformer_blocks.5.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
817
+ "transformer_blocks.5.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
818
+ "transformer_blocks.5.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
819
+ "transformer_blocks.5.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
820
+ "transformer_blocks.5.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
821
+ "transformer_blocks.5.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
822
+ "transformer_blocks.5.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
823
+ "transformer_blocks.5.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
824
+ "transformer_blocks.5.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
825
+ "transformer_blocks.5.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
826
+ "transformer_blocks.6.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
827
+ "transformer_blocks.6.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
828
+ "transformer_blocks.6.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
829
+ "transformer_blocks.6.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
830
+ "transformer_blocks.6.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
831
+ "transformer_blocks.6.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
832
+ "transformer_blocks.6.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
833
+ "transformer_blocks.6.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
834
+ "transformer_blocks.6.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
835
+ "transformer_blocks.6.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
836
+ "transformer_blocks.6.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
837
+ "transformer_blocks.6.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
838
+ "transformer_blocks.6.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
839
+ "transformer_blocks.6.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
840
+ "transformer_blocks.6.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
841
+ "transformer_blocks.6.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
842
+ "transformer_blocks.6.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
843
+ "transformer_blocks.7.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
844
+ "transformer_blocks.7.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
845
+ "transformer_blocks.7.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
846
+ "transformer_blocks.7.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
847
+ "transformer_blocks.7.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
848
+ "transformer_blocks.7.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
849
+ "transformer_blocks.7.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
850
+ "transformer_blocks.7.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
851
+ "transformer_blocks.7.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
852
+ "transformer_blocks.7.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
853
+ "transformer_blocks.7.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
854
+ "transformer_blocks.7.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
855
+ "transformer_blocks.7.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
856
+ "transformer_blocks.7.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
857
+ "transformer_blocks.7.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
858
+ "transformer_blocks.7.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
859
+ "transformer_blocks.7.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
860
+ "transformer_blocks.8.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
861
+ "transformer_blocks.8.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
862
+ "transformer_blocks.8.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
863
+ "transformer_blocks.8.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
864
+ "transformer_blocks.8.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
865
+ "transformer_blocks.8.attn.to_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
866
+ "transformer_blocks.8.attn.to_out.0.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
867
+ "transformer_blocks.8.attn.to_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
868
+ "transformer_blocks.8.attn.to_v.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
869
+ "transformer_blocks.8.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
870
+ "transformer_blocks.8.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
871
+ "transformer_blocks.8.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
872
+ "transformer_blocks.8.ff.net.2.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
873
+ "transformer_blocks.8.ff.net.2.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
874
+ "transformer_blocks.8.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
875
+ "transformer_blocks.8.norm1.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
876
+ "transformer_blocks.8.norm2.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
877
+ "transformer_blocks.9.adaln_proj.linear.bias": "diffusion_pytorch_model-00014-of-00014.safetensors",
878
+ "transformer_blocks.9.adaln_proj.linear.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
879
+ "transformer_blocks.9.attn.norm_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
880
+ "transformer_blocks.9.attn.norm_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
881
+ "transformer_blocks.9.attn.to_gate_compress.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
882
+ "transformer_blocks.9.attn.to_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
883
+ "transformer_blocks.9.attn.to_out.0.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
884
+ "transformer_blocks.9.attn.to_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
885
+ "transformer_blocks.9.attn.to_v.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
886
+ "transformer_blocks.9.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
887
+ "transformer_blocks.9.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
888
+ "transformer_blocks.9.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
889
+ "transformer_blocks.9.ff.net.2.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
890
+ "transformer_blocks.9.ff.net.2.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
891
+ "transformer_blocks.9.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
892
+ "transformer_blocks.9.norm1.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
893
+ "transformer_blocks.9.norm2.weight": "diffusion_pytorch_model-00014-of-00014.safetensors"
894
+ }
895
+ }
transformer/modelopt-component-manifest.json ADDED
@@ -0,0 +1,1483 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "component": "denoiser",
3
+ "files": {
4
+ "config.json": {
5
+ "bytes": 546,
6
+ "sha256": "74c11bff524336576096993cbfcdcdc2ef4fa2fa4409df693bdcbc6c666282ae"
7
+ },
8
+ "diffusion_pytorch_model-00001-of-00014.safetensors": {
9
+ "bytes": 4666277856,
10
+ "sha256": "66dd07f1629c38e19c4c18384405cef84cc9b8dd424bedd1de5f953c05991e41"
11
+ },
12
+ "diffusion_pytorch_model-00002-of-00014.safetensors": {
13
+ "bytes": 3989259848,
14
+ "sha256": "2a11227cb6c67446498fc44a92bf45683425da4e06ca09282a2707a260e90584"
15
+ },
16
+ "diffusion_pytorch_model-00003-of-00014.safetensors": {
17
+ "bytes": 3989259864,
18
+ "sha256": "4aafaa4c41e4022d58f236b990672545e829c9629a678a0dc4e220a4d29a1446"
19
+ },
20
+ "diffusion_pytorch_model-00004-of-00014.safetensors": {
21
+ "bytes": 3546104664,
22
+ "sha256": "072ba683a4dbb184ca4c0d9a561563b1a7259957c342475f3536d7c7f5712c48"
23
+ },
24
+ "diffusion_pytorch_model-00005-of-00014.safetensors": {
25
+ "bytes": 4099832988,
26
+ "sha256": "1762c23119da1924ed7a2be99eba18b05f7ee25be320c791067bea99e8f281bc"
27
+ },
28
+ "diffusion_pytorch_model-00006-of-00014.safetensors": {
29
+ "bytes": 4056696260,
30
+ "sha256": "6faddc05d3478d965faea9948f65443a3e908f2528a7de25af795615c84ee640"
31
+ },
32
+ "diffusion_pytorch_model-00007-of-00014.safetensors": {
33
+ "bytes": 3989259832,
34
+ "sha256": "d8ceaad5fdfd8bb70ffff4c4c5d0cb164f05e609fc3a428b1e171d2ad519c6a6"
35
+ },
36
+ "diffusion_pytorch_model-00008-of-00014.safetensors": {
37
+ "bytes": 3989259864,
38
+ "sha256": "f29d771bad140fffc723d3c9fa4910cf3d450058387c83f74b974ee61b0dee5e"
39
+ },
40
+ "diffusion_pytorch_model-00009-of-00014.safetensors": {
41
+ "bytes": 3546104680,
42
+ "sha256": "49da116f9b79e3a1b50b3085cbaa62ed1511f498ec1e209544a1567183456dab"
43
+ },
44
+ "diffusion_pytorch_model-00010-of-00014.safetensors": {
45
+ "bytes": 4099832972,
46
+ "sha256": "550290b051f89ca10a40209fd3d79334e91110088a522cc9544776b43aa17da8"
47
+ },
48
+ "diffusion_pytorch_model-00011-of-00014.safetensors": {
49
+ "bytes": 4056696260,
50
+ "sha256": "a3626720879942a3afb460a00b98a375911d3e1d07b52a885b5ba4843f5def55"
51
+ },
52
+ "diffusion_pytorch_model-00012-of-00014.safetensors": {
53
+ "bytes": 3989259848,
54
+ "sha256": "cd2be36a2032ee027083be015675949970732d4d579ada810a34b854fe557731"
55
+ },
56
+ "diffusion_pytorch_model-00013-of-00014.safetensors": {
57
+ "bytes": 3989259808,
58
+ "sha256": "a63129e407c505b446b434cbb8375874156ab27a6031d440e48eac1eb32db981"
59
+ },
60
+ "diffusion_pytorch_model-00014-of-00014.safetensors": {
61
+ "bytes": 1474210592,
62
+ "sha256": "aa1081318d90d28644ee9250314298639bcf323e770e5e758d527886cc246bb3"
63
+ },
64
+ "diffusion_pytorch_model.safetensors.index.json": {
65
+ "bytes": 92939,
66
+ "sha256": "af2cfa36eeae8bc371c908b658526d9599a548663e6a87eb3495a1f32377aa98"
67
+ }
68
+ },
69
+ "modelopt_commit": "6a4b3f147e14a6fec690fedbced8df402344085d",
70
+ "numerical_format": {
71
+ "activation": "a4",
72
+ "block_scale": "fp8_e4m3",
73
+ "block_size": 16,
74
+ "output": "bf16",
75
+ "tensor_scale": "fp32",
76
+ "values": "e2m1",
77
+ "weight": "w4"
78
+ },
79
+ "source": "/workspace/models/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree/transformer",
80
+ "target_weights": 100,
81
+ "weights": {
82
+ "transformer_blocks.0.ff.net.0.proj.weight": {
83
+ "block_scale_max": 448.0,
84
+ "block_scale_mean": 16.472774505615234,
85
+ "block_scale_min": 0.375,
86
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
87
+ "shape": [
88
+ 28672,
89
+ 5376
90
+ ],
91
+ "source_dtype": "bfloat16",
92
+ "weight_global_amax": 8.375,
93
+ "weight_saturation_rate": 0.06355322897434235,
94
+ "weight_tensor_scale": 0.0031156993936747313
95
+ },
96
+ "transformer_blocks.0.ff.net.2.weight": {
97
+ "block_scale_max": 448.0,
98
+ "block_scale_mean": 33.925846099853516,
99
+ "block_scale_min": 5.0,
100
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
101
+ "shape": [
102
+ 5376,
103
+ 14336
104
+ ],
105
+ "source_dtype": "bfloat16",
106
+ "weight_global_amax": 4.8125,
107
+ "weight_saturation_rate": 0.06495451927185059,
108
+ "weight_tensor_scale": 0.0017903646221384406
109
+ },
110
+ "transformer_blocks.1.ff.net.0.proj.weight": {
111
+ "block_scale_max": 448.0,
112
+ "block_scale_mean": 28.016803741455078,
113
+ "block_scale_min": 0.6875,
114
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
115
+ "shape": [
116
+ 28672,
117
+ 5376
118
+ ],
119
+ "source_dtype": "bfloat16",
120
+ "weight_global_amax": 4.40625,
121
+ "weight_saturation_rate": 0.06361088156700134,
122
+ "weight_tensor_scale": 0.0016392299439758062
123
+ },
124
+ "transformer_blocks.1.ff.net.2.weight": {
125
+ "block_scale_max": 448.0,
126
+ "block_scale_mean": 17.470399856567383,
127
+ "block_scale_min": 2.25,
128
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
129
+ "shape": [
130
+ 5376,
131
+ 14336
132
+ ],
133
+ "source_dtype": "bfloat16",
134
+ "weight_global_amax": 8.4375,
135
+ "weight_saturation_rate": 0.06421976536512375,
136
+ "weight_tensor_scale": 0.003138951025903225
137
+ },
138
+ "transformer_blocks.10.ff.net.0.proj.weight": {
139
+ "block_scale_max": 448.0,
140
+ "block_scale_mean": 44.30687713623047,
141
+ "block_scale_min": 1.375,
142
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
143
+ "shape": [
144
+ 28672,
145
+ 5376
146
+ ],
147
+ "source_dtype": "bfloat16",
148
+ "weight_global_amax": 3.609375,
149
+ "weight_saturation_rate": 0.06342260539531708,
150
+ "weight_tensor_scale": 0.0013427734375
151
+ },
152
+ "transformer_blocks.10.ff.net.2.weight": {
153
+ "block_scale_max": 448.0,
154
+ "block_scale_mean": 70.12530517578125,
155
+ "block_scale_min": 8.0,
156
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
157
+ "shape": [
158
+ 5376,
159
+ 14336
160
+ ],
161
+ "source_dtype": "bfloat16",
162
+ "weight_global_amax": 2.40625,
163
+ "weight_saturation_rate": 0.06392619013786316,
164
+ "weight_tensor_scale": 0.0008951823110692203
165
+ },
166
+ "transformer_blocks.11.ff.net.0.proj.weight": {
167
+ "block_scale_max": 448.0,
168
+ "block_scale_mean": 26.485719680786133,
169
+ "block_scale_min": 0.75,
170
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
171
+ "shape": [
172
+ 28672,
173
+ 5376
174
+ ],
175
+ "source_dtype": "bfloat16",
176
+ "weight_global_amax": 5.9375,
177
+ "weight_saturation_rate": 0.0634349137544632,
178
+ "weight_tensor_scale": 0.002208891324698925
179
+ },
180
+ "transformer_blocks.11.ff.net.2.weight": {
181
+ "block_scale_max": 448.0,
182
+ "block_scale_mean": 36.138858795166016,
183
+ "block_scale_min": 3.0,
184
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
185
+ "shape": [
186
+ 5376,
187
+ 14336
188
+ ],
189
+ "source_dtype": "bfloat16",
190
+ "weight_global_amax": 4.5625,
191
+ "weight_saturation_rate": 0.06391075998544693,
192
+ "weight_tensor_scale": 0.001697358675301075
193
+ },
194
+ "transformer_blocks.12.ff.net.0.proj.weight": {
195
+ "block_scale_max": 448.0,
196
+ "block_scale_mean": 38.985008239746094,
197
+ "block_scale_min": 1.125,
198
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
199
+ "shape": [
200
+ 28672,
201
+ 5376
202
+ ],
203
+ "source_dtype": "bfloat16",
204
+ "weight_global_amax": 3.953125,
205
+ "weight_saturation_rate": 0.06354819983243942,
206
+ "weight_tensor_scale": 0.0014706565998494625
207
+ },
208
+ "transformer_blocks.12.ff.net.2.weight": {
209
+ "block_scale_max": 448.0,
210
+ "block_scale_mean": 41.339073181152344,
211
+ "block_scale_min": 3.25,
212
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
213
+ "shape": [
214
+ 5376,
215
+ 14336
216
+ ],
217
+ "source_dtype": "bfloat16",
218
+ "weight_global_amax": 3.921875,
219
+ "weight_saturation_rate": 0.06375246495008469,
220
+ "weight_tensor_scale": 0.0014590309001505375
221
+ },
222
+ "transformer_blocks.13.ff.net.0.proj.weight": {
223
+ "block_scale_max": 448.0,
224
+ "block_scale_mean": 12.657382011413574,
225
+ "block_scale_min": 0.375,
226
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
227
+ "shape": [
228
+ 28672,
229
+ 5376
230
+ ],
231
+ "source_dtype": "bfloat16",
232
+ "weight_global_amax": 12.125,
233
+ "weight_saturation_rate": 0.06352914869785309,
234
+ "weight_tensor_scale": 0.0045107887126505375
235
+ },
236
+ "transformer_blocks.13.ff.net.2.weight": {
237
+ "block_scale_max": 448.0,
238
+ "block_scale_mean": 10.395652770996094,
239
+ "block_scale_min": 0.625,
240
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
241
+ "shape": [
242
+ 5376,
243
+ 14336
244
+ ],
245
+ "source_dtype": "bfloat16",
246
+ "weight_global_amax": 15.375,
247
+ "weight_saturation_rate": 0.06361445039510727,
248
+ "weight_tensor_scale": 0.0057198661379516125
249
+ },
250
+ "transformer_blocks.14.ff.net.0.proj.weight": {
251
+ "block_scale_max": 448.0,
252
+ "block_scale_mean": 32.547725677490234,
253
+ "block_scale_min": 0.9375,
254
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
255
+ "shape": [
256
+ 28672,
257
+ 5376
258
+ ],
259
+ "source_dtype": "bfloat16",
260
+ "weight_global_amax": 4.75,
261
+ "weight_saturation_rate": 0.06362791359424591,
262
+ "weight_tensor_scale": 0.0017671131063252687
263
+ },
264
+ "transformer_blocks.14.ff.net.2.weight": {
265
+ "block_scale_max": 448.0,
266
+ "block_scale_mean": 40.63711929321289,
267
+ "block_scale_min": 2.5,
268
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
269
+ "shape": [
270
+ 5376,
271
+ 14336
272
+ ],
273
+ "source_dtype": "bfloat16",
274
+ "weight_global_amax": 3.921875,
275
+ "weight_saturation_rate": 0.06358253955841064,
276
+ "weight_tensor_scale": 0.0014590309001505375
277
+ },
278
+ "transformer_blocks.15.ff.net.0.proj.weight": {
279
+ "block_scale_max": 448.0,
280
+ "block_scale_mean": 26.8400821685791,
281
+ "block_scale_min": 0.8125,
282
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
283
+ "shape": [
284
+ 28672,
285
+ 5376
286
+ ],
287
+ "source_dtype": "bfloat16",
288
+ "weight_global_amax": 5.71875,
289
+ "weight_saturation_rate": 0.06362185627222061,
290
+ "weight_tensor_scale": 0.0021275111939758062
291
+ },
292
+ "transformer_blocks.15.ff.net.2.weight": {
293
+ "block_scale_max": 448.0,
294
+ "block_scale_mean": 30.485517501831055,
295
+ "block_scale_min": 1.375,
296
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
297
+ "shape": [
298
+ 5376,
299
+ 14336
300
+ ],
301
+ "source_dtype": "bfloat16",
302
+ "weight_global_amax": 5.0625,
303
+ "weight_saturation_rate": 0.06376423686742783,
304
+ "weight_tensor_scale": 0.0018833705689758062
305
+ },
306
+ "transformer_blocks.16.ff.net.0.proj.weight": {
307
+ "block_scale_max": 448.0,
308
+ "block_scale_mean": 29.4029541015625,
309
+ "block_scale_min": 0.9375,
310
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
311
+ "shape": [
312
+ 28672,
313
+ 5376
314
+ ],
315
+ "source_dtype": "bfloat16",
316
+ "weight_global_amax": 5.21875,
317
+ "weight_saturation_rate": 0.0635925754904747,
318
+ "weight_tensor_scale": 0.001941499300301075
319
+ },
320
+ "transformer_blocks.16.ff.net.2.weight": {
321
+ "block_scale_max": 448.0,
322
+ "block_scale_mean": 41.52595901489258,
323
+ "block_scale_min": 2.5,
324
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
325
+ "shape": [
326
+ 5376,
327
+ 14336
328
+ ],
329
+ "source_dtype": "bfloat16",
330
+ "weight_global_amax": 3.671875,
331
+ "weight_saturation_rate": 0.06345658004283905,
332
+ "weight_tensor_scale": 0.0013660249533131719
333
+ },
334
+ "transformer_blocks.17.ff.net.0.proj.weight": {
335
+ "block_scale_max": 448.0,
336
+ "block_scale_mean": 35.89394760131836,
337
+ "block_scale_min": 0.9375,
338
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
339
+ "shape": [
340
+ 28672,
341
+ 5376
342
+ ],
343
+ "source_dtype": "bfloat16",
344
+ "weight_global_amax": 4.34375,
345
+ "weight_saturation_rate": 0.063621386885643,
346
+ "weight_tensor_scale": 0.0016159784281626344
347
+ },
348
+ "transformer_blocks.17.ff.net.2.weight": {
349
+ "block_scale_max": 448.0,
350
+ "block_scale_mean": 34.49262237548828,
351
+ "block_scale_min": 1.875,
352
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
353
+ "shape": [
354
+ 5376,
355
+ 14336
356
+ ],
357
+ "source_dtype": "bfloat16",
358
+ "weight_global_amax": 4.46875,
359
+ "weight_saturation_rate": 0.06368372589349747,
360
+ "weight_tensor_scale": 0.001662481459788978
361
+ },
362
+ "transformer_blocks.18.ff.net.0.proj.weight": {
363
+ "block_scale_max": 448.0,
364
+ "block_scale_mean": 37.41992950439453,
365
+ "block_scale_min": 1.0,
366
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
367
+ "shape": [
368
+ 28672,
369
+ 5376
370
+ ],
371
+ "source_dtype": "bfloat16",
372
+ "weight_global_amax": 4.28125,
373
+ "weight_saturation_rate": 0.0636681541800499,
374
+ "weight_tensor_scale": 0.0015927269123494625
375
+ },
376
+ "transformer_blocks.18.ff.net.2.weight": {
377
+ "block_scale_max": 448.0,
378
+ "block_scale_mean": 17.0745906829834,
379
+ "block_scale_min": 1.125,
380
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
381
+ "shape": [
382
+ 5376,
383
+ 14336
384
+ ],
385
+ "source_dtype": "bfloat16",
386
+ "weight_global_amax": 9.3125,
387
+ "weight_saturation_rate": 0.06357219815254211,
388
+ "weight_tensor_scale": 0.0034644717816263437
389
+ },
390
+ "transformer_blocks.19.ff.net.0.proj.weight": {
391
+ "block_scale_max": 448.0,
392
+ "block_scale_mean": 53.710105895996094,
393
+ "block_scale_min": 1.625,
394
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
395
+ "shape": [
396
+ 28672,
397
+ 5376
398
+ ],
399
+ "source_dtype": "bfloat16",
400
+ "weight_global_amax": 3.03125,
401
+ "weight_saturation_rate": 0.06346426159143448,
402
+ "weight_tensor_scale": 0.0011276971781626344
403
+ },
404
+ "transformer_blocks.19.ff.net.2.weight": {
405
+ "block_scale_max": 448.0,
406
+ "block_scale_mean": 44.2147102355957,
407
+ "block_scale_min": 3.25,
408
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
409
+ "shape": [
410
+ 5376,
411
+ 14336
412
+ ],
413
+ "source_dtype": "bfloat16",
414
+ "weight_global_amax": 3.640625,
415
+ "weight_saturation_rate": 0.06315502524375916,
416
+ "weight_tensor_scale": 0.0013543992536142468
417
+ },
418
+ "transformer_blocks.2.ff.net.0.proj.weight": {
419
+ "block_scale_max": 448.0,
420
+ "block_scale_mean": 33.50981140136719,
421
+ "block_scale_min": 0.875,
422
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
423
+ "shape": [
424
+ 28672,
425
+ 5376
426
+ ],
427
+ "source_dtype": "bfloat16",
428
+ "weight_global_amax": 4.34375,
429
+ "weight_saturation_rate": 0.06351428478956223,
430
+ "weight_tensor_scale": 0.0016159784281626344
431
+ },
432
+ "transformer_blocks.2.ff.net.2.weight": {
433
+ "block_scale_max": 448.0,
434
+ "block_scale_mean": 23.832834243774414,
435
+ "block_scale_min": 4.0,
436
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
437
+ "shape": [
438
+ 5376,
439
+ 14336
440
+ ],
441
+ "source_dtype": "bfloat16",
442
+ "weight_global_amax": 7.21875,
443
+ "weight_saturation_rate": 0.06375253200531006,
444
+ "weight_tensor_scale": 0.002685546875
445
+ },
446
+ "transformer_blocks.20.ff.net.0.proj.weight": {
447
+ "block_scale_max": 448.0,
448
+ "block_scale_mean": 36.75452423095703,
449
+ "block_scale_min": 1.5,
450
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
451
+ "shape": [
452
+ 28672,
453
+ 5376
454
+ ],
455
+ "source_dtype": "bfloat16",
456
+ "weight_global_amax": 4.46875,
457
+ "weight_saturation_rate": 0.0635710060596466,
458
+ "weight_tensor_scale": 0.001662481459788978
459
+ },
460
+ "transformer_blocks.20.ff.net.2.weight": {
461
+ "block_scale_max": 448.0,
462
+ "block_scale_mean": 40.204925537109375,
463
+ "block_scale_min": 4.5,
464
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
465
+ "shape": [
466
+ 5376,
467
+ 14336
468
+ ],
469
+ "source_dtype": "bfloat16",
470
+ "weight_global_amax": 4.03125,
471
+ "weight_saturation_rate": 0.06329218298196793,
472
+ "weight_tensor_scale": 0.0014997209655120969
473
+ },
474
+ "transformer_blocks.21.ff.net.0.proj.weight": {
475
+ "block_scale_max": 448.0,
476
+ "block_scale_mean": 28.32771873474121,
477
+ "block_scale_min": 0.875,
478
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
479
+ "shape": [
480
+ 28672,
481
+ 5376
482
+ ],
483
+ "source_dtype": "bfloat16",
484
+ "weight_global_amax": 5.90625,
485
+ "weight_saturation_rate": 0.06339206546545029,
486
+ "weight_tensor_scale": 0.002197265625
487
+ },
488
+ "transformer_blocks.21.ff.net.2.weight": {
489
+ "block_scale_max": 448.0,
490
+ "block_scale_mean": 34.726619720458984,
491
+ "block_scale_min": 3.5,
492
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
493
+ "shape": [
494
+ 5376,
495
+ 14336
496
+ ],
497
+ "source_dtype": "bfloat16",
498
+ "weight_global_amax": 4.6875,
499
+ "weight_saturation_rate": 0.06354400515556335,
500
+ "weight_tensor_scale": 0.0017438615905120969
501
+ },
502
+ "transformer_blocks.22.ff.net.0.proj.weight": {
503
+ "block_scale_max": 448.0,
504
+ "block_scale_mean": 46.91810607910156,
505
+ "block_scale_min": 1.375,
506
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
507
+ "shape": [
508
+ 28672,
509
+ 5376
510
+ ],
511
+ "source_dtype": "bfloat16",
512
+ "weight_global_amax": 3.640625,
513
+ "weight_saturation_rate": 0.06337128579616547,
514
+ "weight_tensor_scale": 0.0013543992536142468
515
+ },
516
+ "transformer_blocks.22.ff.net.2.weight": {
517
+ "block_scale_max": 448.0,
518
+ "block_scale_mean": 54.79726028442383,
519
+ "block_scale_min": 5.5,
520
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
521
+ "shape": [
522
+ 5376,
523
+ 14336
524
+ ],
525
+ "source_dtype": "bfloat16",
526
+ "weight_global_amax": 3.015625,
527
+ "weight_saturation_rate": 0.06334979087114334,
528
+ "weight_tensor_scale": 0.0011218843283131719
529
+ },
530
+ "transformer_blocks.23.ff.net.0.proj.weight": {
531
+ "block_scale_max": 448.0,
532
+ "block_scale_mean": 32.758995056152344,
533
+ "block_scale_min": 2.25,
534
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
535
+ "shape": [
536
+ 28672,
537
+ 5376
538
+ ],
539
+ "source_dtype": "bfloat16",
540
+ "weight_global_amax": 5.3125,
541
+ "weight_saturation_rate": 0.06352967768907547,
542
+ "weight_tensor_scale": 0.0019763766322284937
543
+ },
544
+ "transformer_blocks.23.ff.net.2.weight": {
545
+ "block_scale_max": 448.0,
546
+ "block_scale_mean": 61.83660125732422,
547
+ "block_scale_min": 7.0,
548
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
549
+ "shape": [
550
+ 5376,
551
+ 14336
552
+ ],
553
+ "source_dtype": "bfloat16",
554
+ "weight_global_amax": 2.71875,
555
+ "weight_saturation_rate": 0.06354644894599915,
556
+ "weight_tensor_scale": 0.0010114397155120969
557
+ },
558
+ "transformer_blocks.24.ff.net.0.proj.weight": {
559
+ "block_scale_max": 448.0,
560
+ "block_scale_mean": 27.76451873779297,
561
+ "block_scale_min": 2.5,
562
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
563
+ "shape": [
564
+ 28672,
565
+ 5376
566
+ ],
567
+ "source_dtype": "bfloat16",
568
+ "weight_global_amax": 6.375,
569
+ "weight_saturation_rate": 0.06331139802932739,
570
+ "weight_tensor_scale": 0.0023716518189758062
571
+ },
572
+ "transformer_blocks.24.ff.net.2.weight": {
573
+ "block_scale_max": 448.0,
574
+ "block_scale_mean": 55.93115997314453,
575
+ "block_scale_min": 5.5,
576
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
577
+ "shape": [
578
+ 5376,
579
+ 14336
580
+ ],
581
+ "source_dtype": "bfloat16",
582
+ "weight_global_amax": 3.03125,
583
+ "weight_saturation_rate": 0.06340566277503967,
584
+ "weight_tensor_scale": 0.0011276971781626344
585
+ },
586
+ "transformer_blocks.25.ff.net.0.proj.weight": {
587
+ "block_scale_max": 448.0,
588
+ "block_scale_mean": 39.748226165771484,
589
+ "block_scale_min": 4.5,
590
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
591
+ "shape": [
592
+ 28672,
593
+ 5376
594
+ ],
595
+ "source_dtype": "bfloat16",
596
+ "weight_global_amax": 4.53125,
597
+ "weight_saturation_rate": 0.06359761208295822,
598
+ "weight_tensor_scale": 0.00168573297560215
599
+ },
600
+ "transformer_blocks.25.ff.net.2.weight": {
601
+ "block_scale_max": 448.0,
602
+ "block_scale_mean": 53.710121154785156,
603
+ "block_scale_min": 5.0,
604
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
605
+ "shape": [
606
+ 5376,
607
+ 14336
608
+ ],
609
+ "source_dtype": "bfloat16",
610
+ "weight_global_amax": 3.21875,
611
+ "weight_saturation_rate": 0.0632086992263794,
612
+ "weight_tensor_scale": 0.0011974516091868281
613
+ },
614
+ "transformer_blocks.26.ff.net.0.proj.weight": {
615
+ "block_scale_max": 448.0,
616
+ "block_scale_mean": 41.97421646118164,
617
+ "block_scale_min": 1.125,
618
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
619
+ "shape": [
620
+ 28672,
621
+ 5376
622
+ ],
623
+ "source_dtype": "bfloat16",
624
+ "weight_global_amax": 4.375,
625
+ "weight_saturation_rate": 0.06354834884405136,
626
+ "weight_tensor_scale": 0.0016276042442768812
627
+ },
628
+ "transformer_blocks.26.ff.net.2.weight": {
629
+ "block_scale_max": 448.0,
630
+ "block_scale_mean": 31.09628677368164,
631
+ "block_scale_min": 3.75,
632
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
633
+ "shape": [
634
+ 5376,
635
+ 14336
636
+ ],
637
+ "source_dtype": "bfloat16",
638
+ "weight_global_amax": 5.6875,
639
+ "weight_saturation_rate": 0.06352340430021286,
640
+ "weight_tensor_scale": 0.0021158854942768812
641
+ },
642
+ "transformer_blocks.27.ff.net.0.proj.weight": {
643
+ "block_scale_max": 448.0,
644
+ "block_scale_mean": 38.58533477783203,
645
+ "block_scale_min": 1.75,
646
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
647
+ "shape": [
648
+ 28672,
649
+ 5376
650
+ ],
651
+ "source_dtype": "bfloat16",
652
+ "weight_global_amax": 4.8125,
653
+ "weight_saturation_rate": 0.06368701159954071,
654
+ "weight_tensor_scale": 0.0017903646221384406
655
+ },
656
+ "transformer_blocks.27.ff.net.2.weight": {
657
+ "block_scale_max": 448.0,
658
+ "block_scale_mean": 17.185806274414062,
659
+ "block_scale_min": 2.25,
660
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
661
+ "shape": [
662
+ 5376,
663
+ 14336
664
+ ],
665
+ "source_dtype": "bfloat16",
666
+ "weight_global_amax": 10.5,
667
+ "weight_saturation_rate": 0.06366410106420517,
668
+ "weight_tensor_scale": 0.00390625
669
+ },
670
+ "transformer_blocks.28.ff.net.0.proj.weight": {
671
+ "block_scale_max": 448.0,
672
+ "block_scale_mean": 26.904735565185547,
673
+ "block_scale_min": 1.5,
674
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
675
+ "shape": [
676
+ 28672,
677
+ 5376
678
+ ],
679
+ "source_dtype": "bfloat16",
680
+ "weight_global_amax": 7.09375,
681
+ "weight_saturation_rate": 0.06313972920179367,
682
+ "weight_tensor_scale": 0.0026390438433736563
683
+ },
684
+ "transformer_blocks.28.ff.net.2.weight": {
685
+ "block_scale_max": 448.0,
686
+ "block_scale_mean": 25.52775764465332,
687
+ "block_scale_min": 3.5,
688
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
689
+ "shape": [
690
+ 5376,
691
+ 14336
692
+ ],
693
+ "source_dtype": "bfloat16",
694
+ "weight_global_amax": 7.3125,
695
+ "weight_saturation_rate": 0.06288973242044449,
696
+ "weight_tensor_scale": 0.0027204242069274187
697
+ },
698
+ "transformer_blocks.29.ff.net.0.proj.weight": {
699
+ "block_scale_max": 448.0,
700
+ "block_scale_mean": 27.099672317504883,
701
+ "block_scale_min": 4.5,
702
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
703
+ "shape": [
704
+ 28672,
705
+ 5376
706
+ ],
707
+ "source_dtype": "bfloat16",
708
+ "weight_global_amax": 7.0625,
709
+ "weight_saturation_rate": 0.06317251175642014,
710
+ "weight_tensor_scale": 0.0026274181436747313
711
+ },
712
+ "transformer_blocks.29.ff.net.2.weight": {
713
+ "block_scale_max": 448.0,
714
+ "block_scale_mean": 39.744483947753906,
715
+ "block_scale_min": 6.0,
716
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
717
+ "shape": [
718
+ 5376,
719
+ 14336
720
+ ],
721
+ "source_dtype": "bfloat16",
722
+ "weight_global_amax": 4.78125,
723
+ "weight_saturation_rate": 0.06351472437381744,
724
+ "weight_tensor_scale": 0.0017787389224395156
725
+ },
726
+ "transformer_blocks.3.ff.net.0.proj.weight": {
727
+ "block_scale_max": 448.0,
728
+ "block_scale_mean": 37.328556060791016,
729
+ "block_scale_min": 1.125,
730
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
731
+ "shape": [
732
+ 28672,
733
+ 5376
734
+ ],
735
+ "source_dtype": "bfloat16",
736
+ "weight_global_amax": 4.3125,
737
+ "weight_saturation_rate": 0.0635688379406929,
738
+ "weight_tensor_scale": 0.0016043527284637094
739
+ },
740
+ "transformer_blocks.3.ff.net.2.weight": {
741
+ "block_scale_max": 448.0,
742
+ "block_scale_mean": 61.82960510253906,
743
+ "block_scale_min": 11.0,
744
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
745
+ "shape": [
746
+ 5376,
747
+ 14336
748
+ ],
749
+ "source_dtype": "bfloat16",
750
+ "weight_global_amax": 2.859375,
751
+ "weight_saturation_rate": 0.06367281079292297,
752
+ "weight_tensor_scale": 0.0010637555969879031
753
+ },
754
+ "transformer_blocks.30.ff.net.0.proj.weight": {
755
+ "block_scale_max": 448.0,
756
+ "block_scale_mean": 30.473941802978516,
757
+ "block_scale_min": 5.0,
758
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
759
+ "shape": [
760
+ 28672,
761
+ 5376
762
+ ],
763
+ "source_dtype": "bfloat16",
764
+ "weight_global_amax": 6.3125,
765
+ "weight_saturation_rate": 0.06351669132709503,
766
+ "weight_tensor_scale": 0.002348400419577956
767
+ },
768
+ "transformer_blocks.30.ff.net.2.weight": {
769
+ "block_scale_max": 448.0,
770
+ "block_scale_mean": 15.345988273620605,
771
+ "block_scale_min": 2.25,
772
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
773
+ "shape": [
774
+ 5376,
775
+ 14336
776
+ ],
777
+ "source_dtype": "bfloat16",
778
+ "weight_global_amax": 12.3125,
779
+ "weight_saturation_rate": 0.06355677545070648,
780
+ "weight_tensor_scale": 0.004580543376505375
781
+ },
782
+ "transformer_blocks.31.ff.net.0.proj.weight": {
783
+ "block_scale_max": 448.0,
784
+ "block_scale_mean": 27.60163688659668,
785
+ "block_scale_min": 4.5,
786
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
787
+ "shape": [
788
+ 28672,
789
+ 5376
790
+ ],
791
+ "source_dtype": "bfloat16",
792
+ "weight_global_amax": 7.0,
793
+ "weight_saturation_rate": 0.06324271112680435,
794
+ "weight_tensor_scale": 0.0026041667442768812
795
+ },
796
+ "transformer_blocks.31.ff.net.2.weight": {
797
+ "block_scale_max": 448.0,
798
+ "block_scale_mean": 25.32241439819336,
799
+ "block_scale_min": 3.5,
800
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
801
+ "shape": [
802
+ 5376,
803
+ 14336
804
+ ],
805
+ "source_dtype": "bfloat16",
806
+ "weight_global_amax": 7.5,
807
+ "weight_saturation_rate": 0.06294678896665573,
808
+ "weight_tensor_scale": 0.0027901786379516125
809
+ },
810
+ "transformer_blocks.32.ff.net.0.proj.weight": {
811
+ "block_scale_max": 448.0,
812
+ "block_scale_mean": 15.447080612182617,
813
+ "block_scale_min": 2.75,
814
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
815
+ "shape": [
816
+ 28672,
817
+ 5376
818
+ ],
819
+ "source_dtype": "bfloat16",
820
+ "weight_global_amax": 12.5,
821
+ "weight_saturation_rate": 0.06354077160358429,
822
+ "weight_tensor_scale": 0.004650297574698925
823
+ },
824
+ "transformer_blocks.32.ff.net.2.weight": {
825
+ "block_scale_max": 448.0,
826
+ "block_scale_mean": 24.05265998840332,
827
+ "block_scale_min": 4.0,
828
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
829
+ "shape": [
830
+ 5376,
831
+ 14336
832
+ ],
833
+ "source_dtype": "bfloat16",
834
+ "weight_global_amax": 8.0,
835
+ "weight_saturation_rate": 0.06287482380867004,
836
+ "weight_tensor_scale": 0.0029761905316263437
837
+ },
838
+ "transformer_blocks.33.ff.net.0.proj.weight": {
839
+ "block_scale_max": 448.0,
840
+ "block_scale_mean": 23.43458366394043,
841
+ "block_scale_min": 4.5,
842
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
843
+ "shape": [
844
+ 28672,
845
+ 5376
846
+ ],
847
+ "source_dtype": "bfloat16",
848
+ "weight_global_amax": 8.3125,
849
+ "weight_saturation_rate": 0.06324451416730881,
850
+ "weight_tensor_scale": 0.0030924479942768812
851
+ },
852
+ "transformer_blocks.33.ff.net.2.weight": {
853
+ "block_scale_max": 448.0,
854
+ "block_scale_mean": 17.67997932434082,
855
+ "block_scale_min": 3.25,
856
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
857
+ "shape": [
858
+ 5376,
859
+ 14336
860
+ ],
861
+ "source_dtype": "bfloat16",
862
+ "weight_global_amax": 10.875,
863
+ "weight_saturation_rate": 0.06367780268192291,
864
+ "weight_tensor_scale": 0.0040457588620483875
865
+ },
866
+ "transformer_blocks.34.ff.net.0.proj.weight": {
867
+ "block_scale_max": 448.0,
868
+ "block_scale_mean": 23.52635383605957,
869
+ "block_scale_min": 3.75,
870
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
871
+ "shape": [
872
+ 28672,
873
+ 5376
874
+ ],
875
+ "source_dtype": "bfloat16",
876
+ "weight_global_amax": 8.3125,
877
+ "weight_saturation_rate": 0.06323336064815521,
878
+ "weight_tensor_scale": 0.0030924479942768812
879
+ },
880
+ "transformer_blocks.34.ff.net.2.weight": {
881
+ "block_scale_max": 448.0,
882
+ "block_scale_mean": 30.291606903076172,
883
+ "block_scale_min": 5.5,
884
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
885
+ "shape": [
886
+ 5376,
887
+ 14336
888
+ ],
889
+ "source_dtype": "bfloat16",
890
+ "weight_global_amax": 6.375,
891
+ "weight_saturation_rate": 0.06337101757526398,
892
+ "weight_tensor_scale": 0.0023716518189758062
893
+ },
894
+ "transformer_blocks.35.ff.net.0.proj.weight": {
895
+ "block_scale_max": 448.0,
896
+ "block_scale_mean": 25.029054641723633,
897
+ "block_scale_min": 4.0,
898
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
899
+ "shape": [
900
+ 28672,
901
+ 5376
902
+ ],
903
+ "source_dtype": "bfloat16",
904
+ "weight_global_amax": 7.875,
905
+ "weight_saturation_rate": 0.06321961432695389,
906
+ "weight_tensor_scale": 0.0029296875
907
+ },
908
+ "transformer_blocks.35.ff.net.2.weight": {
909
+ "block_scale_max": 448.0,
910
+ "block_scale_mean": 29.031099319458008,
911
+ "block_scale_min": 5.0,
912
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
913
+ "shape": [
914
+ 5376,
915
+ 14336
916
+ ],
917
+ "source_dtype": "bfloat16",
918
+ "weight_global_amax": 6.75,
919
+ "weight_saturation_rate": 0.06319305300712585,
920
+ "weight_tensor_scale": 0.0025111606810241938
921
+ },
922
+ "transformer_blocks.36.ff.net.0.proj.weight": {
923
+ "block_scale_max": 448.0,
924
+ "block_scale_mean": 16.119068145751953,
925
+ "block_scale_min": 2.25,
926
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
927
+ "shape": [
928
+ 28672,
929
+ 5376
930
+ ],
931
+ "source_dtype": "bfloat16",
932
+ "weight_global_amax": 12.1875,
933
+ "weight_saturation_rate": 0.06348860263824463,
934
+ "weight_tensor_scale": 0.0045340401120483875
935
+ },
936
+ "transformer_blocks.36.ff.net.2.weight": {
937
+ "block_scale_max": 448.0,
938
+ "block_scale_mean": 13.287528991699219,
939
+ "block_scale_min": 2.25,
940
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
941
+ "shape": [
942
+ 5376,
943
+ 14336
944
+ ],
945
+ "source_dtype": "bfloat16",
946
+ "weight_global_amax": 15.0,
947
+ "weight_saturation_rate": 0.06300818175077438,
948
+ "weight_tensor_scale": 0.005580357275903225
949
+ },
950
+ "transformer_blocks.37.ff.net.0.proj.weight": {
951
+ "block_scale_max": 448.0,
952
+ "block_scale_mean": 22.18779945373535,
953
+ "block_scale_min": 2.75,
954
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
955
+ "shape": [
956
+ 28672,
957
+ 5376
958
+ ],
959
+ "source_dtype": "bfloat16",
960
+ "weight_global_amax": 8.875,
961
+ "weight_saturation_rate": 0.06334257870912552,
962
+ "weight_tensor_scale": 0.0033017112873494625
963
+ },
964
+ "transformer_blocks.37.ff.net.2.weight": {
965
+ "block_scale_max": 448.0,
966
+ "block_scale_mean": 20.6065673828125,
967
+ "block_scale_min": 3.5,
968
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
969
+ "shape": [
970
+ 5376,
971
+ 14336
972
+ ],
973
+ "source_dtype": "bfloat16",
974
+ "weight_global_amax": 9.875,
975
+ "weight_saturation_rate": 0.06330486387014389,
976
+ "weight_tensor_scale": 0.003673735074698925
977
+ },
978
+ "transformer_blocks.38.ff.net.0.proj.weight": {
979
+ "block_scale_max": 448.0,
980
+ "block_scale_mean": 25.0240478515625,
981
+ "block_scale_min": 3.5,
982
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
983
+ "shape": [
984
+ 28672,
985
+ 5376
986
+ ],
987
+ "source_dtype": "bfloat16",
988
+ "weight_global_amax": 7.84375,
989
+ "weight_saturation_rate": 0.06324655562639236,
990
+ "weight_tensor_scale": 0.002918061800301075
991
+ },
992
+ "transformer_blocks.38.ff.net.2.weight": {
993
+ "block_scale_max": 448.0,
994
+ "block_scale_mean": 20.838619232177734,
995
+ "block_scale_min": 3.5,
996
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
997
+ "shape": [
998
+ 5376,
999
+ 14336
1000
+ ],
1001
+ "source_dtype": "bfloat16",
1002
+ "weight_global_amax": 9.6875,
1003
+ "weight_saturation_rate": 0.06329601258039474,
1004
+ "weight_tensor_scale": 0.0036039806436747313
1005
+ },
1006
+ "transformer_blocks.39.ff.net.0.proj.weight": {
1007
+ "block_scale_max": 448.0,
1008
+ "block_scale_mean": 16.79216194152832,
1009
+ "block_scale_min": 2.5,
1010
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1011
+ "shape": [
1012
+ 28672,
1013
+ 5376
1014
+ ],
1015
+ "source_dtype": "bfloat16",
1016
+ "weight_global_amax": 11.75,
1017
+ "weight_saturation_rate": 0.06354103237390518,
1018
+ "weight_tensor_scale": 0.00437127985060215
1019
+ },
1020
+ "transformer_blocks.39.ff.net.2.weight": {
1021
+ "block_scale_max": 448.0,
1022
+ "block_scale_mean": 12.181177139282227,
1023
+ "block_scale_min": 1.875,
1024
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1025
+ "shape": [
1026
+ 5376,
1027
+ 14336
1028
+ ],
1029
+ "source_dtype": "bfloat16",
1030
+ "weight_global_amax": 16.75,
1031
+ "weight_saturation_rate": 0.06287278980016708,
1032
+ "weight_tensor_scale": 0.0062313987873494625
1033
+ },
1034
+ "transformer_blocks.4.ff.net.0.proj.weight": {
1035
+ "block_scale_max": 448.0,
1036
+ "block_scale_mean": 52.58255386352539,
1037
+ "block_scale_min": 1.5,
1038
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1039
+ "shape": [
1040
+ 28672,
1041
+ 5376
1042
+ ],
1043
+ "source_dtype": "bfloat16",
1044
+ "weight_global_amax": 3.140625,
1045
+ "weight_saturation_rate": 0.06332672387361526,
1046
+ "weight_tensor_scale": 0.0011683872435241938
1047
+ },
1048
+ "transformer_blocks.4.ff.net.2.weight": {
1049
+ "block_scale_max": 448.0,
1050
+ "block_scale_mean": 66.93839263916016,
1051
+ "block_scale_min": 10.0,
1052
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1053
+ "shape": [
1054
+ 5376,
1055
+ 14336
1056
+ ],
1057
+ "source_dtype": "bfloat16",
1058
+ "weight_global_amax": 2.640625,
1059
+ "weight_saturation_rate": 0.06381126493215561,
1060
+ "weight_tensor_scale": 0.0009823753498494625
1061
+ },
1062
+ "transformer_blocks.40.ff.net.0.proj.weight": {
1063
+ "block_scale_max": 448.0,
1064
+ "block_scale_mean": 18.87799644470215,
1065
+ "block_scale_min": 2.75,
1066
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1067
+ "shape": [
1068
+ 28672,
1069
+ 5376
1070
+ ],
1071
+ "source_dtype": "bfloat16",
1072
+ "weight_global_amax": 10.4375,
1073
+ "weight_saturation_rate": 0.06349590420722961,
1074
+ "weight_tensor_scale": 0.00388299860060215
1075
+ },
1076
+ "transformer_blocks.40.ff.net.2.weight": {
1077
+ "block_scale_max": 448.0,
1078
+ "block_scale_mean": 21.494430541992188,
1079
+ "block_scale_min": 3.75,
1080
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1081
+ "shape": [
1082
+ 5376,
1083
+ 14336
1084
+ ],
1085
+ "source_dtype": "bfloat16",
1086
+ "weight_global_amax": 9.4375,
1087
+ "weight_saturation_rate": 0.06319945305585861,
1088
+ "weight_tensor_scale": 0.0035109748132526875
1089
+ },
1090
+ "transformer_blocks.41.ff.net.0.proj.weight": {
1091
+ "block_scale_max": 448.0,
1092
+ "block_scale_mean": 13.759907722473145,
1093
+ "block_scale_min": 2.0,
1094
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1095
+ "shape": [
1096
+ 28672,
1097
+ 5376
1098
+ ],
1099
+ "source_dtype": "bfloat16",
1100
+ "weight_global_amax": 14.3125,
1101
+ "weight_saturation_rate": 0.0633372962474823,
1102
+ "weight_tensor_scale": 0.0053245909512043
1103
+ },
1104
+ "transformer_blocks.41.ff.net.2.weight": {
1105
+ "block_scale_max": 448.0,
1106
+ "block_scale_mean": 18.748844146728516,
1107
+ "block_scale_min": 2.0,
1108
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1109
+ "shape": [
1110
+ 5376,
1111
+ 14336
1112
+ ],
1113
+ "source_dtype": "bfloat16",
1114
+ "weight_global_amax": 10.8125,
1115
+ "weight_saturation_rate": 0.06360166519880295,
1116
+ "weight_tensor_scale": 0.0040225074626505375
1117
+ },
1118
+ "transformer_blocks.42.ff.net.0.proj.weight": {
1119
+ "block_scale_max": 448.0,
1120
+ "block_scale_mean": 14.95506763458252,
1121
+ "block_scale_min": 0.875,
1122
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1123
+ "shape": [
1124
+ 28672,
1125
+ 5376
1126
+ ],
1127
+ "source_dtype": "bfloat16",
1128
+ "weight_global_amax": 12.9375,
1129
+ "weight_saturation_rate": 0.06348538398742676,
1130
+ "weight_tensor_scale": 0.00481305830180645
1131
+ },
1132
+ "transformer_blocks.42.ff.net.2.weight": {
1133
+ "block_scale_max": 448.0,
1134
+ "block_scale_mean": 20.942319869995117,
1135
+ "block_scale_min": 3.0,
1136
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1137
+ "shape": [
1138
+ 5376,
1139
+ 14336
1140
+ ],
1141
+ "source_dtype": "bfloat16",
1142
+ "weight_global_amax": 9.8125,
1143
+ "weight_saturation_rate": 0.06326501071453094,
1144
+ "weight_tensor_scale": 0.003650483675301075
1145
+ },
1146
+ "transformer_blocks.43.ff.net.0.proj.weight": {
1147
+ "block_scale_max": 448.0,
1148
+ "block_scale_mean": 9.634346008300781,
1149
+ "block_scale_min": 0.625,
1150
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1151
+ "shape": [
1152
+ 28672,
1153
+ 5376
1154
+ ],
1155
+ "source_dtype": "bfloat16",
1156
+ "weight_global_amax": 20.0,
1157
+ "weight_saturation_rate": 0.06337258219718933,
1158
+ "weight_tensor_scale": 0.0074404762126505375
1159
+ },
1160
+ "transformer_blocks.43.ff.net.2.weight": {
1161
+ "block_scale_max": 448.0,
1162
+ "block_scale_mean": 11.070359230041504,
1163
+ "block_scale_min": 1.375,
1164
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1165
+ "shape": [
1166
+ 5376,
1167
+ 14336
1168
+ ],
1169
+ "source_dtype": "bfloat16",
1170
+ "weight_global_amax": 19.0,
1171
+ "weight_saturation_rate": 0.06310183554887772,
1172
+ "weight_tensor_scale": 0.007068452425301075
1173
+ },
1174
+ "transformer_blocks.44.ff.net.0.proj.weight": {
1175
+ "block_scale_max": 448.0,
1176
+ "block_scale_mean": 24.597654342651367,
1177
+ "block_scale_min": 1.25,
1178
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1179
+ "shape": [
1180
+ 28672,
1181
+ 5376
1182
+ ],
1183
+ "source_dtype": "bfloat16",
1184
+ "weight_global_amax": 7.75,
1185
+ "weight_saturation_rate": 0.06331823021173477,
1186
+ "weight_tensor_scale": 0.0028831844683736563
1187
+ },
1188
+ "transformer_blocks.44.ff.net.2.weight": {
1189
+ "block_scale_max": 448.0,
1190
+ "block_scale_mean": 14.781774520874023,
1191
+ "block_scale_min": 1.75,
1192
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1193
+ "shape": [
1194
+ 5376,
1195
+ 14336
1196
+ ],
1197
+ "source_dtype": "bfloat16",
1198
+ "weight_global_amax": 14.3125,
1199
+ "weight_saturation_rate": 0.06344424933195114,
1200
+ "weight_tensor_scale": 0.0053245909512043
1201
+ },
1202
+ "transformer_blocks.45.ff.net.0.proj.weight": {
1203
+ "block_scale_max": 448.0,
1204
+ "block_scale_mean": 23.468605041503906,
1205
+ "block_scale_min": 1.625,
1206
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1207
+ "shape": [
1208
+ 28672,
1209
+ 5376
1210
+ ],
1211
+ "source_dtype": "bfloat16",
1212
+ "weight_global_amax": 8.0625,
1213
+ "weight_saturation_rate": 0.06321755051612854,
1214
+ "weight_tensor_scale": 0.0029994419310241938
1215
+ },
1216
+ "transformer_blocks.45.ff.net.2.weight": {
1217
+ "block_scale_max": 448.0,
1218
+ "block_scale_mean": 12.22935962677002,
1219
+ "block_scale_min": 1.625,
1220
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1221
+ "shape": [
1222
+ 5376,
1223
+ 14336
1224
+ ],
1225
+ "source_dtype": "bfloat16",
1226
+ "weight_global_amax": 17.375,
1227
+ "weight_saturation_rate": 0.06304015219211578,
1228
+ "weight_tensor_scale": 0.0064639137126505375
1229
+ },
1230
+ "transformer_blocks.46.ff.net.0.proj.weight": {
1231
+ "block_scale_max": 448.0,
1232
+ "block_scale_mean": 18.22333335876465,
1233
+ "block_scale_min": 1.0,
1234
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1235
+ "shape": [
1236
+ 28672,
1237
+ 5376
1238
+ ],
1239
+ "source_dtype": "bfloat16",
1240
+ "weight_global_amax": 10.25,
1241
+ "weight_saturation_rate": 0.06341880559921265,
1242
+ "weight_tensor_scale": 0.003813244169577956
1243
+ },
1244
+ "transformer_blocks.46.ff.net.2.weight": {
1245
+ "block_scale_max": 448.0,
1246
+ "block_scale_mean": 15.134147644042969,
1247
+ "block_scale_min": 1.875,
1248
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1249
+ "shape": [
1250
+ 5376,
1251
+ 14336
1252
+ ],
1253
+ "source_dtype": "bfloat16",
1254
+ "weight_global_amax": 13.75,
1255
+ "weight_saturation_rate": 0.0635608360171318,
1256
+ "weight_tensor_scale": 0.005115327425301075
1257
+ },
1258
+ "transformer_blocks.47.ff.net.0.proj.weight": {
1259
+ "block_scale_max": 448.0,
1260
+ "block_scale_mean": 12.564708709716797,
1261
+ "block_scale_min": 0.8125,
1262
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1263
+ "shape": [
1264
+ 28672,
1265
+ 5376
1266
+ ],
1267
+ "source_dtype": "bfloat16",
1268
+ "weight_global_amax": 14.375,
1269
+ "weight_saturation_rate": 0.06328296661376953,
1270
+ "weight_tensor_scale": 0.00534784235060215
1271
+ },
1272
+ "transformer_blocks.47.ff.net.2.weight": {
1273
+ "block_scale_max": 448.0,
1274
+ "block_scale_mean": 10.440210342407227,
1275
+ "block_scale_min": 1.0,
1276
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1277
+ "shape": [
1278
+ 5376,
1279
+ 14336
1280
+ ],
1281
+ "source_dtype": "bfloat16",
1282
+ "weight_global_amax": 19.5,
1283
+ "weight_saturation_rate": 0.06382088363170624,
1284
+ "weight_tensor_scale": 0.00725446455180645
1285
+ },
1286
+ "transformer_blocks.48.ff.net.0.proj.weight": {
1287
+ "block_scale_max": 448.0,
1288
+ "block_scale_mean": 16.887142181396484,
1289
+ "block_scale_min": 0.9375,
1290
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1291
+ "shape": [
1292
+ 28672,
1293
+ 5376
1294
+ ],
1295
+ "source_dtype": "bfloat16",
1296
+ "weight_global_amax": 10.25,
1297
+ "weight_saturation_rate": 0.06341958791017532,
1298
+ "weight_tensor_scale": 0.003813244169577956
1299
+ },
1300
+ "transformer_blocks.48.ff.net.2.weight": {
1301
+ "block_scale_max": 448.0,
1302
+ "block_scale_mean": 13.37950611114502,
1303
+ "block_scale_min": 0.8125,
1304
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1305
+ "shape": [
1306
+ 5376,
1307
+ 14336
1308
+ ],
1309
+ "source_dtype": "bfloat16",
1310
+ "weight_global_amax": 14.125,
1311
+ "weight_saturation_rate": 0.06343883275985718,
1312
+ "weight_tensor_scale": 0.0052548362873494625
1313
+ },
1314
+ "transformer_blocks.49.ff.net.0.proj.weight": {
1315
+ "block_scale_max": 448.0,
1316
+ "block_scale_mean": 11.566964149475098,
1317
+ "block_scale_min": 0.875,
1318
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1319
+ "shape": [
1320
+ 28672,
1321
+ 5376
1322
+ ],
1323
+ "source_dtype": "bfloat16",
1324
+ "weight_global_amax": 13.1875,
1325
+ "weight_saturation_rate": 0.06327934563159943,
1326
+ "weight_tensor_scale": 0.00490606389939785
1327
+ },
1328
+ "transformer_blocks.49.ff.net.2.weight": {
1329
+ "block_scale_max": 448.0,
1330
+ "block_scale_mean": 7.344207286834717,
1331
+ "block_scale_min": 0.5,
1332
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1333
+ "shape": [
1334
+ 5376,
1335
+ 14336
1336
+ ],
1337
+ "source_dtype": "bfloat16",
1338
+ "weight_global_amax": 7.8125,
1339
+ "weight_saturation_rate": 0.06335245072841644,
1340
+ "weight_tensor_scale": 0.00290643610060215
1341
+ },
1342
+ "transformer_blocks.5.ff.net.0.proj.weight": {
1343
+ "block_scale_max": 448.0,
1344
+ "block_scale_mean": 40.42047882080078,
1345
+ "block_scale_min": 1.25,
1346
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1347
+ "shape": [
1348
+ 28672,
1349
+ 5376
1350
+ ],
1351
+ "source_dtype": "bfloat16",
1352
+ "weight_global_amax": 4.15625,
1353
+ "weight_saturation_rate": 0.063423752784729,
1354
+ "weight_tensor_scale": 0.0015462239971384406
1355
+ },
1356
+ "transformer_blocks.5.ff.net.2.weight": {
1357
+ "block_scale_max": 448.0,
1358
+ "block_scale_mean": 50.378971099853516,
1359
+ "block_scale_min": 7.0,
1360
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1361
+ "shape": [
1362
+ 5376,
1363
+ 14336
1364
+ ],
1365
+ "source_dtype": "bfloat16",
1366
+ "weight_global_amax": 3.515625,
1367
+ "weight_saturation_rate": 0.06323359906673431,
1368
+ "weight_tensor_scale": 0.0013078962219879031
1369
+ },
1370
+ "transformer_blocks.6.ff.net.0.proj.weight": {
1371
+ "block_scale_max": 448.0,
1372
+ "block_scale_mean": 44.86921310424805,
1373
+ "block_scale_min": 1.5,
1374
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1375
+ "shape": [
1376
+ 28672,
1377
+ 5376
1378
+ ],
1379
+ "source_dtype": "bfloat16",
1380
+ "weight_global_amax": 3.734375,
1381
+ "weight_saturation_rate": 0.06323440372943878,
1382
+ "weight_tensor_scale": 0.0013892764691263437
1383
+ },
1384
+ "transformer_blocks.6.ff.net.2.weight": {
1385
+ "block_scale_max": 448.0,
1386
+ "block_scale_mean": 34.11458969116211,
1387
+ "block_scale_min": 3.75,
1388
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1389
+ "shape": [
1390
+ 5376,
1391
+ 14336
1392
+ ],
1393
+ "source_dtype": "bfloat16",
1394
+ "weight_global_amax": 5.15625,
1395
+ "weight_saturation_rate": 0.06395266950130463,
1396
+ "weight_tensor_scale": 0.0019182477844879031
1397
+ },
1398
+ "transformer_blocks.7.ff.net.0.proj.weight": {
1399
+ "block_scale_max": 448.0,
1400
+ "block_scale_mean": 36.13467025756836,
1401
+ "block_scale_min": 1.0,
1402
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1403
+ "shape": [
1404
+ 28672,
1405
+ 5376
1406
+ ],
1407
+ "source_dtype": "bfloat16",
1408
+ "weight_global_amax": 4.625,
1409
+ "weight_saturation_rate": 0.06365388631820679,
1410
+ "weight_tensor_scale": 0.0017206101911142468
1411
+ },
1412
+ "transformer_blocks.7.ff.net.2.weight": {
1413
+ "block_scale_max": 448.0,
1414
+ "block_scale_mean": 36.49232864379883,
1415
+ "block_scale_min": 6.0,
1416
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1417
+ "shape": [
1418
+ 5376,
1419
+ 14336
1420
+ ],
1421
+ "source_dtype": "bfloat16",
1422
+ "weight_global_amax": 4.8125,
1423
+ "weight_saturation_rate": 0.06392229348421097,
1424
+ "weight_tensor_scale": 0.0017903646221384406
1425
+ },
1426
+ "transformer_blocks.8.ff.net.0.proj.weight": {
1427
+ "block_scale_max": 448.0,
1428
+ "block_scale_mean": 59.098426818847656,
1429
+ "block_scale_min": 1.375,
1430
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1431
+ "shape": [
1432
+ 28672,
1433
+ 5376
1434
+ ],
1435
+ "source_dtype": "bfloat16",
1436
+ "weight_global_amax": 2.796875,
1437
+ "weight_saturation_rate": 0.06343978643417358,
1438
+ "weight_tensor_scale": 0.0010405040811747313
1439
+ },
1440
+ "transformer_blocks.8.ff.net.2.weight": {
1441
+ "block_scale_max": 448.0,
1442
+ "block_scale_mean": 73.22038269042969,
1443
+ "block_scale_min": 9.0,
1444
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1445
+ "shape": [
1446
+ 5376,
1447
+ 14336
1448
+ ],
1449
+ "source_dtype": "bfloat16",
1450
+ "weight_global_amax": 2.359375,
1451
+ "weight_saturation_rate": 0.06389093399047852,
1452
+ "weight_tensor_scale": 0.0008777437033131719
1453
+ },
1454
+ "transformer_blocks.9.ff.net.0.proj.weight": {
1455
+ "block_scale_max": 448.0,
1456
+ "block_scale_mean": 34.58193588256836,
1457
+ "block_scale_min": 0.875,
1458
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1459
+ "shape": [
1460
+ 28672,
1461
+ 5376
1462
+ ],
1463
+ "source_dtype": "bfloat16",
1464
+ "weight_global_amax": 4.65625,
1465
+ "weight_saturation_rate": 0.06360305845737457,
1466
+ "weight_tensor_scale": 0.0017322358908131719
1467
+ },
1468
+ "transformer_blocks.9.ff.net.2.weight": {
1469
+ "block_scale_max": 448.0,
1470
+ "block_scale_mean": 50.91960144042969,
1471
+ "block_scale_min": 6.0,
1472
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1473
+ "shape": [
1474
+ 5376,
1475
+ 14336
1476
+ ],
1477
+ "source_dtype": "bfloat16",
1478
+ "weight_global_amax": 3.3125,
1479
+ "weight_saturation_rate": 0.06345276534557343,
1480
+ "weight_tensor_scale": 0.0012323289411142468
1481
+ }
1482
+ }
1483
+ }
vae/config.json ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLMiniMaxH3",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "in_channels": 3,
5
+ "out_channels": 3,
6
+ "latent_channels": 24,
7
+ "block_out_channels": [
8
+ 128,
9
+ 256,
10
+ 256,
11
+ 512,
12
+ 512,
13
+ 1024
14
+ ],
15
+ "layers_per_block": 2,
16
+ "spatial_downsample_factors": [
17
+ 2,
18
+ 2,
19
+ 2,
20
+ 2,
21
+ 1,
22
+ 1
23
+ ],
24
+ "temporal_downsample_factors": [
25
+ 1,
26
+ 2,
27
+ 2,
28
+ 1,
29
+ 1,
30
+ 1
31
+ ],
32
+ "norm_num_groups": 32,
33
+ "norm_eps": 1e-06,
34
+ "spatial_padding_mode": "reflect",
35
+ "decoder_num_layers": 36,
36
+ "decoder_num_attention_heads": 32,
37
+ "decoder_attention_head_dim": 64,
38
+ "decoder_num_register_tokens": 4,
39
+ "decoder_ffn_mult": 4,
40
+ "decoder_rope_theta": 100.0,
41
+ "decoder_rope_dim_ratio": 0.75,
42
+ "decoder_norm_eps": 1e-05,
43
+ "clip_length": 17,
44
+ "token_drop": 3,
45
+ "latents_mean": [
46
+ 0.858090341091156,
47
+ -0.9606591463088989,
48
+ 1.0661640167236328,
49
+ -0.5090325474739075,
50
+ -0.2727581858634949,
51
+ -1.3675414323806763,
52
+ -0.2553254961967468,
53
+ -0.26907554268836975,
54
+ -0.5376840829849243,
55
+ -0.0464097298681736,
56
+ 0.6657370328903198,
57
+ 0.19690127670764923,
58
+ -0.5460608005523682,
59
+ -0.4035342037677765,
60
+ -0.23683024942874908,
61
+ 0.25928452610969543,
62
+ -0.30133944749832153,
63
+ 0.211341992020607,
64
+ -1.1206848621368408,
65
+ 0.3581933379173279,
66
+ -0.04225143790245056,
67
+ 0.2604829967021942,
68
+ 0.22864092886447906,
69
+ 0.7056031823158264
70
+ ],
71
+ "latents_std": [
72
+ 1.2223774194717407,
73
+ 1.2767263650894165,
74
+ 1.6831774711608887,
75
+ 1.7549455165863037,
76
+ 1.5636216402053833,
77
+ 2.194143533706665,
78
+ 0.9653137922286987,
79
+ 1.0569885969161987,
80
+ 0.841948926448822,
81
+ 0.7729952931404114,
82
+ 1.8955937623977661,
83
+ 0.946841835975647,
84
+ 0.7996809482574463,
85
+ 0.44988900423049927,
86
+ 0.7197399735450745,
87
+ 0.6936293244361877,
88
+ 2.961095094680786,
89
+ 2.7694199085235596,
90
+ 3.0496184825897217,
91
+ 2.1088054180145264,
92
+ 3.276226282119751,
93
+ 3.1627357006073,
94
+ 2.2816812992095947,
95
+ 2.6127843856811523
96
+ ]
97
+ }
vae/diffusion_pytorch_model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
vae/modelopt-component-manifest.json ADDED
The diff for this file is too large to render. See raw diff