diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/LICENSE b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/LICENSE new file mode 100644 index 0000000000000000000000000000000000000000..f938136e3adacfd92be087f6e113b5d6d97f678f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/LICENSE @@ -0,0 +1,202 @@ + + Apache License + Version 2.0, January 2004 + http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + (except as stated in this section) patent license to make, have made, + use, offer to sell, sell, import, and otherwise transfer the Work, + where such license applies only to those patent claims licensable + by such Contributor that are necessarily infringed by their + Contribution(s) alone or by combination of their Contribution(s) + with the Work to which such Contribution(s) was submitted. If You + institute patent litigation against any entity (including a + cross-claim or counterclaim in a lawsuit) alleging that the Work + or a Contribution incorporated within the Work constitutes direct + or contributory patent infringement, then any patent licenses + granted to You under this License for that Work shall terminate + as of the date such litigation is filed. + + 4. Redistribution. You may reproduce and distribute copies of the + Work or Derivative Works thereof in any medium, with or without + modifications, and in Source or Object form, provided that You + meet the following conditions: + + (a) You must give any other recipients of the Work or + Derivative Works a copy of this License; and + + (b) You must cause any modified files to carry prominent notices + stating that You changed the files; and + + (c) You must retain, in the Source form of any Derivative Works + that You distribute, all copyright, patent, trademark, and + attribution notices from the Source form of the Work, + excluding those notices that do not pertain to any part of + the Derivative Works; and + + (d) If the Work includes a "NOTICE" text file as part of its + distribution, then any Derivative Works that You distribute must + include a readable copy of the attribution notices contained + within such NOTICE file, excluding those notices that do not + pertain to any part of the Derivative Works, in at least one + of the following places: within a NOTICE text file distributed + as part of the Derivative Works; within the Source form or + documentation, if provided along with the Derivative Works; or, + within a display generated by the Derivative Works, if and + wherever such third-party notices normally appear. The contents + of the NOTICE file are for informational purposes only and + do not modify the License. You may add Your own attribution + notices within Derivative Works that You distribute, alongside + or as an addendum to the NOTICE text from the Work, provided + that such additional attribution notices cannot be construed + as modifying the License. + + You may add Your own copyright statement to Your modifications and + may provide additional or different license terms and conditions + for use, reproduction, or distribution of Your modifications, or + for any such Derivative Works as a whole, provided Your use, + reproduction, and distribution of the Work otherwise complies with + the conditions stated in this License. + + 5. Submission of Contributions. Unless You explicitly state otherwise, + any Contribution intentionally submitted for inclusion in the Work + by You to the Licensor shall be under the terms and conditions of + this License, without any additional terms or conditions. + Notwithstanding the above, nothing herein shall supersede or modify + the terms of any separate license agreement you may have executed + with Licensor regarding such Contributions. + + 6. Trademarks. This License does not grant permission to use the trade + names, trademarks, service marks, or product names of the Licensor, + except as required for reasonable and customary use in describing the + origin of the Work and reproducing the content of the NOTICE file. + + 7. Disclaimer of Warranty. Unless required by applicable law or + agreed to in writing, Licensor provides the Work (and each + Contributor provides its Contributions) on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or + implied, including, without limitation, any warranties or conditions + of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A + PARTICULAR PURPOSE. You are solely responsible for determining the + appropriateness of using or redistributing the Work and assume any + risks associated with Your exercise of permissions under this License. + + 8. Limitation of Liability. In no event and under no legal theory, + whether in tort (including negligence), contract, or otherwise, + unless required by applicable law (such as deliberate and grossly + negligent acts) or agreed to in writing, shall any Contributor be + liable to You for damages, including any direct, indirect, special, + incidental, or consequential damages of any character arising as a + result of this License or out of the use or inability to use the + Work (including but not limited to damages for loss of goodwill, + work stoppage, computer failure or malfunction, or any and all + other commercial damages or losses), even if such Contributor + has been advised of the possibility of such damages. + + 9. Accepting Warranty or Additional Liability. While redistributing + the Work or Derivative Works thereof, You may choose to offer, + and charge a fee for, acceptance of support, warranty, indemnity, + or other liability obligations and/or rights consistent with this + License. However, in accepting such obligations, You may act only + on Your own behalf and on Your sole responsibility, not on behalf + of any other Contributor, and only if You agree to indemnify, + defend, and hold each Contributor harmless for any liability + incurred by, or claims asserted against, such Contributor by reason + of your accepting any such warranty or additional liability. + + END OF TERMS AND CONDITIONS + + APPENDIX: How to apply the Apache License to your work. + + To apply the Apache License to your work, attach the following + boilerplate notice, with the fields enclosed by brackets "[]" + replaced with your own identifying information. (Don't include + the brackets!) The text should be enclosed in the appropriate + comment syntax for the file format. We also recommend that a + file or class name and description of purpose be included on the + same "printed page" as the copyright notice for easier + identification within third-party archives. + + Copyright 2026 Alibaba Cloud + + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. \ No newline at end of file diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/config.json b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/config.json new file mode 100644 index 0000000000000000000000000000000000000000..d30a15be1bbfd610f58ad80f1fbeb6778f58a80f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/source/config.json @@ -0,0 +1,96 @@ +{ + "architectures": [ + "Qwen3_5ForConditionalGeneration" + ], + "image_token_id": 248056, + "model_type": "qwen3_5", + "text_config": { + "attention_bias": false, + "attention_dropout": 0.0, + "attn_output_gate": true, + "dtype": "bfloat16", + "eos_token_id": 248044, + "full_attention_interval": 4, + "head_dim": 256, + "hidden_act": "silu", + "hidden_size": 2048, + "initializer_range": 0.02, + "intermediate_size": 6144, + "layer_types": [ + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention" + ], + "linear_conv_kernel_dim": 4, + "linear_key_head_dim": 128, + "linear_num_key_heads": 16, + "linear_num_value_heads": 16, + "linear_value_head_dim": 128, + "max_position_embeddings": 262144, + "mlp_only_layers": [], + "model_type": "qwen3_5_text", + "mtp_num_hidden_layers": 1, + "mtp_use_dedicated_embeddings": false, + "num_attention_heads": 8, + "num_hidden_layers": 24, + "num_key_value_heads": 2, + "rms_norm_eps": 1e-06, + "tie_word_embeddings": true, + "use_cache": true, + "vocab_size": 248320, + "mamba_ssm_dtype": "float32", + "rope_parameters": { + "mrope_interleaved": true, + "mrope_section": [ + 11, + 11, + 10 + ], + "rope_type": "default", + "rope_theta": 10000000, + "partial_rotary_factor": 0.25 + } + }, + "tie_word_embeddings": true, + "transformers_version": "4.57.0.dev0", + "video_token_id": 248057, + "vision_config": { + "deepstack_visual_indexes": [], + "depth": 24, + "hidden_act": "gelu_pytorch_tanh", + "hidden_size": 1024, + "in_channels": 3, + "initializer_range": 0.02, + "intermediate_size": 4096, + "model_type": "qwen3_5", + "num_heads": 16, + "num_position_embeddings": 2304, + "out_hidden_size": 2048, + "patch_size": 16, + "spatial_merge_size": 2, + "temporal_patch_size": 2 + }, + "vision_end_token_id": 248054, + "vision_start_token_id": 248053 +} \ No newline at end of file diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00000.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00000.bin new file mode 100644 index 0000000000000000000000000000000000000000..06198b6eb262e8722be59fd7351e315de552a255 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00000.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ff01e44eac7d7a30d3779fe7970f1ec882ae3a807ded59b8c25b203b57bd746 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00001.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00001.bin new file mode 100644 index 0000000000000000000000000000000000000000..d5e039d506963a394a09a7bf76eec3d070807af6 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00001.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f698d7140ff322989ac4a6aa5c05976740689c7129be1f179362c94bef2730f +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00002.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00002.bin new file mode 100644 index 0000000000000000000000000000000000000000..2d176a30733a3d0854fdae3810c57ca08723839b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00002.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1a05e5a106c236dedfca3a681806500e8d9f518767ec432ffa7a53a0061e94f8 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00003.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00003.bin new file mode 100644 index 0000000000000000000000000000000000000000..8c1b896698187229b358e96b5239d98d747d26bb --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00003.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da533794b3c088224ed91b19ce038c0b07acbfa7b01eeb5b6b1e0d8bc39e5bc8 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00004.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00004.bin new file mode 100644 index 0000000000000000000000000000000000000000..7fb830564f6043b13c7d2ede5663729f599f5117 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00004.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b95eb7e977231963dd5335fab05dc5d111c3c5c716bc0bac3e0f48af84b5cf18 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00005.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00005.bin new file mode 100644 index 0000000000000000000000000000000000000000..b7daccd2555758784196a6908e9642d0af3c8247 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00005.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17c20eaa5be55412038d213e9820d01a4f1f822678a1fbe5d7df20b5012b546e +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00006.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00006.bin new file mode 100644 index 0000000000000000000000000000000000000000..611a0d57ba672f2f98d48fb3ff39b58046aa9979 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00006.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65031b11b25789c6ccbcddf46f2784210191bc64a6eca510ba6eb479f4dab7c9 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00007.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00007.bin new file mode 100644 index 0000000000000000000000000000000000000000..559752756ac3ba1299bfd33b460132ca18b308e2 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00007.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65e01ad7b5d868aa12a669a3ac8ab2b7c5434fd3e484da3331a80608d42f3ff2 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00008.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00008.bin new file mode 100644 index 0000000000000000000000000000000000000000..b8afca3e6704fd0646aed84ad4e7d1ecb4d85331 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00008.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1edbabeb49f1b143f5c09814a3185c0557fbeaf313d214876198ddc11ac0b6a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00009.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00009.bin new file mode 100644 index 0000000000000000000000000000000000000000..bfdab301eae75b65a86ae6ff29aa6b213c867336 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/384x256/weights/00009.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1b08a9bfa57499b2e10b304eb995627131aa4eeeec059dbf3cf936362a578519 +size 62671936 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/graph.json b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/graph.json new file mode 100644 index 0000000000000000000000000000000000000000..c5f129da207492bcece23ca941136236e4673363 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/graph.json @@ -0,0 +1,51123 @@ +{ + "inputs": [ + "pixels" + ], + "outputs": [ + "add_96", + "linear_97" + ], + "tensors": { + "p_visual_patch_embed_proj_weight": { + "shape": [ + 1024, + 3, + 2, + 16, + 16 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 0, + "byteLength": 6291456 + } + ] + }, + "p_visual_patch_embed_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 6291456, + "byteLength": 4096 + } + ] + }, + "p_visual_pos_embed_weight": { + "shape": [ + 2304, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4718592, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 6295552, + "byteLength": 4718592 + } + ] + }, + "p_visual_blocks_0_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 11014144, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_0_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 11018240, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_0_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 11022336, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_0_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 17313792, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_0_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 17326080, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_0_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 19423232, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_0_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 19427328, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_0_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 19431424, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_0_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 19435520, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_0_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 27824128, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_0_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 27840512, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_0_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 36229120, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 36233216, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 36237312, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 36241408, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_1_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 42532864, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_1_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 42545152, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_1_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 44642304, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 44646400, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 44650496, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_1_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 44654592, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_1_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 53043200, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_1_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 53059584, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_1_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 61448192, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 61452288, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00000.bin", + "offset": 61456384, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00000.bin", + "offset": 61460480, + "byteLength": 5648384 + }, + { + "path": "weights/00001.bin", + "offset": 0, + "byteLength": 643072 + } + ] + }, + "p_visual_blocks_2_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 643072, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_2_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 655360, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_2_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 2752512, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 2756608, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 2760704, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_2_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 2764800, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_2_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 11153408, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_2_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 11169792, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_2_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 19558400, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 19562496, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 19566592, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 19570688, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_3_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 25862144, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_3_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 25874432, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_3_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 27971584, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 27975680, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 27979776, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_3_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 27983872, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_3_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 36372480, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_3_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 36388864, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_3_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 44777472, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 44781568, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 44785664, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 44789760, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_4_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 51081216, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_4_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 51093504, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_4_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 53190656, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 53194752, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 53198848, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_4_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 53202944, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_4_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00001.bin", + "offset": 61591552, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_4_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00001.bin", + "offset": 61607936, + "byteLength": 5500928 + }, + { + "path": "weights/00002.bin", + "offset": 0, + "byteLength": 2887680 + } + ] + }, + "p_visual_blocks_4_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 2887680, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 2891776, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 2895872, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 2899968, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_5_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 9191424, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_5_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 9203712, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_5_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 11300864, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 11304960, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 11309056, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_5_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 11313152, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_5_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 19701760, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_5_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 19718144, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_5_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 28106752, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 28110848, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 28114944, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 28119040, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_6_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 34410496, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_6_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 34422784, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_6_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 36519936, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 36524032, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 36528128, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_6_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 36532224, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_6_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 44920832, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_6_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 44937216, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_6_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 53325824, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 53329920, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 53334016, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 53338112, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_7_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 59629568, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_7_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 59641856, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_7_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 61739008, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 61743104, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00002.bin", + "offset": 61747200, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_7_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00002.bin", + "offset": 61751296, + "byteLength": 5357568 + }, + { + "path": "weights/00003.bin", + "offset": 0, + "byteLength": 3031040 + } + ] + }, + "p_visual_blocks_7_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 3031040, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_7_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 3047424, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_7_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 11436032, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 11440128, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 11444224, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 11448320, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_8_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 17739776, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_8_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 17752064, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_8_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 19849216, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 19853312, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 19857408, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_8_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 19861504, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_8_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 28250112, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_8_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 28266496, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_8_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 36655104, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 36659200, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 36663296, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 36667392, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_9_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 42958848, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_9_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 42971136, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_9_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 45068288, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 45072384, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 45076480, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_9_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 45080576, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_9_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 53469184, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_9_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 53485568, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_9_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 61874176, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 61878272, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00003.bin", + "offset": 61882368, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00003.bin", + "offset": 61886464, + "byteLength": 5222400 + }, + { + "path": "weights/00004.bin", + "offset": 0, + "byteLength": 1069056 + } + ] + }, + "p_visual_blocks_10_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 1069056, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_10_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 1081344, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_10_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 3178496, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 3182592, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 3186688, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_10_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 3190784, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_10_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 11579392, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_10_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 11595776, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_10_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 19984384, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 19988480, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 19992576, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 19996672, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_11_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 26288128, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_11_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 26300416, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_11_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 28397568, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 28401664, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 28405760, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_11_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 28409856, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_11_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 36798464, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_11_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 36814848, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_11_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 45203456, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 45207552, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 45211648, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 45215744, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_12_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 51507200, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_12_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 51519488, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_12_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 53616640, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 53620736, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 53624832, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_12_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 53628928, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_12_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00004.bin", + "offset": 62017536, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_12_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00004.bin", + "offset": 62033920, + "byteLength": 5074944 + }, + { + "path": "weights/00005.bin", + "offset": 0, + "byteLength": 3313664 + } + ] + }, + "p_visual_blocks_12_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 3313664, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 3317760, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 3321856, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 3325952, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_13_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 9617408, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_13_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 9629696, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_13_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 11726848, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 11730944, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 11735040, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_13_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 11739136, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_13_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 20127744, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_13_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 20144128, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_13_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 28532736, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 28536832, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 28540928, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 28545024, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_14_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 34836480, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_14_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 34848768, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_14_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 36945920, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 36950016, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 36954112, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_14_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 36958208, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_14_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 45346816, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_14_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 45363200, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_14_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 53751808, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 53755904, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 53760000, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 53764096, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_15_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 60055552, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_15_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 60067840, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_15_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 62164992, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 62169088, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00005.bin", + "offset": 62173184, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_15_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00005.bin", + "offset": 62177280, + "byteLength": 4931584 + }, + { + "path": "weights/00006.bin", + "offset": 0, + "byteLength": 3457024 + } + ] + }, + "p_visual_blocks_15_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 3457024, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_15_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 3473408, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_15_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 11862016, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 11866112, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 11870208, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 11874304, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_16_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 18165760, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_16_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 18178048, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_16_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 20275200, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 20279296, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 20283392, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_16_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 20287488, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_16_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 28676096, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_16_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 28692480, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_16_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 37081088, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 37085184, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 37089280, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 37093376, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_17_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 43384832, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_17_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 43397120, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_17_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 45494272, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 45498368, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 45502464, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_17_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 45506560, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_17_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 53895168, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_17_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 53911552, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_17_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 62300160, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 62304256, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00006.bin", + "offset": 62308352, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00006.bin", + "offset": 62312448, + "byteLength": 4796416 + }, + { + "path": "weights/00007.bin", + "offset": 0, + "byteLength": 1495040 + } + ] + }, + "p_visual_blocks_18_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 1495040, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_18_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 1507328, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_18_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 3604480, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 3608576, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 3612672, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_18_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 3616768, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_18_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 12005376, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_18_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 12021760, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_18_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 20410368, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 20414464, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 20418560, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 20422656, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_19_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 26714112, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_19_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 26726400, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_19_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 28823552, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 28827648, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 28831744, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_19_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 28835840, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_19_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 37224448, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_19_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 37240832, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_19_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 45629440, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 45633536, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 45637632, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 45641728, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_20_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 51933184, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_20_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 51945472, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_20_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 54042624, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 54046720, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 54050816, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_20_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 54054912, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_20_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00007.bin", + "offset": 62443520, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_20_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00007.bin", + "offset": 62459904, + "byteLength": 4648960 + }, + { + "path": "weights/00008.bin", + "offset": 0, + "byteLength": 3739648 + } + ] + }, + "p_visual_blocks_20_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 3739648, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 3743744, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 3747840, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 3751936, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_21_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 10043392, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_21_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 10055680, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_21_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 12152832, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 12156928, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 12161024, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_21_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 12165120, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_21_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 20553728, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_21_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 20570112, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_21_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 28958720, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 28962816, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 28966912, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 28971008, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_22_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 35262464, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_22_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 35274752, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_22_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 37371904, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 37376000, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 37380096, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_22_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 37384192, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_22_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 45772800, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_22_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 45789184, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_22_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 54177792, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_norm1_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 54181888, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_norm1_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 54185984, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_attn_qkv_weight": { + "shape": [ + 3072, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 6291456, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 54190080, + "byteLength": 6291456 + } + ] + }, + "p_visual_blocks_23_attn_qkv_bias": { + "shape": [ + 3072 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 12288, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 60481536, + "byteLength": 12288 + } + ] + }, + "p_visual_blocks_23_attn_proj_weight": { + "shape": [ + 1024, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 2097152, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 60493824, + "byteLength": 2097152 + } + ] + }, + "p_visual_blocks_23_attn_proj_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 62590976, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_norm2_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 62595072, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_norm2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00008.bin", + "offset": 62599168, + "byteLength": 4096 + } + ] + }, + "p_visual_blocks_23_mlp_linear_fc1_weight": { + "shape": [ + 4096, + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00008.bin", + "offset": 62603264, + "byteLength": 4505600 + }, + { + "path": "weights/00009.bin", + "offset": 0, + "byteLength": 3883008 + } + ] + }, + "p_visual_blocks_23_mlp_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 3883008, + "byteLength": 16384 + } + ] + }, + "p_visual_blocks_23_mlp_linear_fc2_weight": { + "shape": [ + 1024, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8388608, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00009.bin", + "offset": 3899392, + "byteLength": 8388608 + } + ] + }, + "p_visual_blocks_23_mlp_linear_fc2_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 12288000, + "byteLength": 4096 + } + ] + }, + "p_visual_merger_norm_weight": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 12292096, + "byteLength": 4096 + } + ] + }, + "p_visual_merger_norm_bias": { + "shape": [ + 1024 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 4096, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 12296192, + "byteLength": 4096 + } + ] + }, + "p_visual_merger_linear_fc1_weight": { + "shape": [ + 4096, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 33554432, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00009.bin", + "offset": 12300288, + "byteLength": 33554432 + } + ] + }, + "p_visual_merger_linear_fc1_bias": { + "shape": [ + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16384, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 45854720, + "byteLength": 16384 + } + ] + }, + "p_visual_merger_linear_fc2_weight": { + "shape": [ + 2048, + 4096 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 16777216, + "storageDtype": "bfloat16", + "parts": [ + { + "path": "weights/00009.bin", + "offset": 45871104, + "byteLength": 16777216 + } + ] + }, + "p_visual_merger_linear_fc2_bias": { + "shape": [ + 2048 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 8192, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 62648320, + "byteLength": 8192 + } + ] + }, + "b_indices": { + "shape": [ + 988, + 4 + ], + "dtype": "int32", + "role": "constant", + "byteLength": 15808, + "indexBounds": [ + 0, + 2304 + ], + "parts": [ + { + "path": "weights/00009.bin", + "offset": 62656512, + "byteLength": 15808 + } + ] + }, + "b_interpolation_weights": { + "shape": [ + 988, + 4 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 15808, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 62672320, + "byteLength": 15808 + } + ] + }, + "b_positions": { + "shape": [ + 988, + 2 + ], + "dtype": "int32", + "role": "constant", + "byteLength": 7904, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 62688128, + "byteLength": 7904 + } + ] + }, + "b_visual_rotary_pos_emb_inv_freq": { + "shape": [ + 16 + ], + "dtype": "float32", + "role": "constant", + "byteLength": 64, + "parts": [ + { + "path": "weights/00009.bin", + "offset": 62696032, + "byteLength": 64 + } + ] + }, + "pixels": { + "shape": [ + 988, + 1536 + ], + "dtype": "float32", + "role": "input", + "byteLength": 6070272 + }, + "view": { + "shape": [ + 988, + 3, + 2, + 16, + 16 + ], + "dtype": "float32", + "role": "value", + "byteLength": 6070272 + }, + "conv3d": { + "shape": [ + 988, + 1024, + 1, + 1, + 1 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_1": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "embedding": { + "shape": [ + 988, + 4, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "unsqueeze": { + "shape": [ + 988, + 4, + 1 + ], + "dtype": "float32", + "role": "value", + "byteLength": 15808 + }, + "mul": { + "shape": [ + 988, + 4, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "sum_1": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_1": { + "shape": [ + 988, + 2, + 1 + ], + "dtype": "int32", + "role": "value", + "byteLength": 7904 + }, + "mul_1": { + "shape": [ + 988, + 2, + 16 + ], + "dtype": "float32", + "role": "value", + "byteLength": 126464 + }, + "view_2": { + "shape": [ + 988, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 126464 + }, + "view_3": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_4": { + "shape": [ + 988, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 126464 + }, + "cat": { + "shape": [ + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "cos": { + "shape": [ + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "sin": { + "shape": [ + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "layer_norm": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_5": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_1": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_2": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_2": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_3": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_2": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_1": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_2": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_1": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_3": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_1": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_4": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_3": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_4": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_1": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_2": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_5": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_2": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_4": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_1": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_5": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_2": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_6": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_5": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_6": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_7": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_3": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_6": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_1": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_4": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_3": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_6": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_1": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_3": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_1": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_2": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_3": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_4": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_2": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_4": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_7": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_1": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_3": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_4": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_5": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_7": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_8": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_7": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_8": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_9": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_2": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_4": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_8": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_5": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_9": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_10": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_11": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_3": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_5": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_10": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_6": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_5": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_9": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_6": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_10": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_7": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_11": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_12": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_13": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_14": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_8": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_2": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_11": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_1": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_3": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_9": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_1": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_6": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_8": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_5": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_7": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_3": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_6": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_1": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_7": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_8": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_4": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_8": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_9": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_2": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_6": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_7": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_8": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_12": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_13": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_12": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_15": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_16": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_4": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_7": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_13": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_9": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_14": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_17": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_18": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_5": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_8": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_15": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_10": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_10": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_14": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_11": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_15": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_12": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_16": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_19": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_20": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_21": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_13": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_4": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_16": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_2": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_5": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_14": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_2": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_9": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_10": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_9": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_11": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_5": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_10": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_2": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_11": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_12": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_6": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_12": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_11": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_3": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_9": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_10": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_11": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_17": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_18": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_17": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_22": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_23": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_6": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_10": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_18": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_13": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_19": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_24": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_25": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_7": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_11": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_20": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_14": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_15": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_19": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_16": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_20": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_17": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_21": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_26": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_27": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_28": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_18": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_6": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_21": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_3": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_7": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_19": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_3": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_12": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_12": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_13": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_15": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_7": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_14": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_3": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_15": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_16": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_8": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_16": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_13": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_4": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_12": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_13": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_14": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_22": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_23": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_22": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_29": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_30": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_8": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_13": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_23": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_17": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_24": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_31": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_32": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_9": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_14": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_25": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_18": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_20": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_24": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_21": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_25": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_22": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_26": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_33": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_34": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_35": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_23": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_8": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_26": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_4": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_9": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_24": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_4": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_15": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_14": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_17": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_19": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_9": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_18": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_4": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_19": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_20": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_10": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_20": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_15": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_5": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_15": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_16": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_17": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_27": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_28": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_27": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_36": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_37": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_10": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_16": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_28": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_21": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_29": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_38": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_39": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_11": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_17": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_30": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_22": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_25": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_29": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_26": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_30": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_27": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_31": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_40": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_41": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_42": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_28": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_10": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_31": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_5": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_11": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_29": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_5": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_18": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_16": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_21": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_23": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_11": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_22": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_5": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_23": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_24": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_12": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_24": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_17": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_6": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_18": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_19": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_20": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_32": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_33": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_32": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_43": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_44": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_12": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_19": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_33": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_25": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_34": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_45": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_46": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_13": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_20": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_35": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_26": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_30": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_34": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_31": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_35": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_32": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_36": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_47": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_48": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_49": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_33": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_12": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_36": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_6": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_13": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_34": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_6": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_21": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_18": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_25": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_27": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_13": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_26": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_6": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_27": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_28": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_14": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_28": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_19": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_7": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_21": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_22": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_23": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_37": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_38": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_37": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_50": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_51": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_14": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_22": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_38": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_29": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_39": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_52": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_53": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_15": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_23": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_40": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_30": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_35": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_39": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_36": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_40": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_37": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_41": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_54": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_55": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_56": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_38": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_14": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_41": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_7": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_15": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_39": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_7": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_24": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_20": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_29": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_31": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_15": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_30": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_7": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_31": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_32": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_16": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_32": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_21": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_8": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_24": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_25": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_26": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_42": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_43": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_42": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_57": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_58": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_16": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_25": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_43": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_33": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_44": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_59": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_60": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_17": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_26": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_45": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_34": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_40": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_44": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_41": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_45": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_42": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_46": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_61": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_62": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_63": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_43": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_16": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_46": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_8": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_17": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_44": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_8": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_27": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_22": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_33": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_35": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_17": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_34": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_8": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_35": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_36": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_18": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_36": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_23": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_9": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_27": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_28": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_29": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_47": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_48": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_47": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_64": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_65": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_18": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_28": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_48": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_37": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_49": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_66": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_67": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_19": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_29": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_50": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_38": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_45": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_49": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_46": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_50": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_47": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_51": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_68": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_69": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_70": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_48": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_18": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_51": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_9": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_19": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_49": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_9": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_30": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_24": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_37": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_39": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_19": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_38": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_9": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_39": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_40": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_20": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_40": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_25": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_10": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_30": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_31": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_32": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_52": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_53": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_52": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_71": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_72": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_20": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_31": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_53": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_41": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_54": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_73": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_74": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_21": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_32": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_55": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_42": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_50": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_54": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_51": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_55": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_52": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_56": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_75": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_76": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_77": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_53": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_20": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_56": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_10": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_21": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_54": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_10": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_33": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_26": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_41": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_43": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_21": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_42": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_10": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_43": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_44": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_22": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_44": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_27": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_11": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_33": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_34": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_35": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_57": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_58": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_57": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_78": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_79": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_22": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_34": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_58": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_45": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_59": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_80": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_81": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_23": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_35": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_60": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_46": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_55": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_59": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_56": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_60": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_57": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_61": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_82": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_83": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_84": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_58": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_22": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_61": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_11": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_23": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_59": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_11": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_36": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_28": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_45": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_47": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_23": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_46": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_11": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_47": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_48": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_24": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_48": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_29": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_12": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_36": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_37": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_38": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_62": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_63": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_62": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_85": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_86": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_24": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_37": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_63": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_49": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_64": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_87": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_88": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_25": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_38": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_65": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_50": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_60": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_64": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_61": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_65": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_62": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_66": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_89": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_90": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_91": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_63": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_24": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_66": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_12": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_25": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_64": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_12": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_39": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_30": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_49": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_51": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_25": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_50": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_12": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_51": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_52": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_26": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_52": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_31": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_13": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_39": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_40": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_41": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_67": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_68": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_67": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_92": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_93": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_26": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_40": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_68": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_53": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_69": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_94": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_95": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_27": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_41": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_70": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_54": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_65": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_69": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_66": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_70": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_67": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_71": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_96": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_97": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_98": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_68": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_26": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_71": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_13": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_27": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_69": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_13": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_42": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_32": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_53": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_55": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_27": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_54": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_13": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_55": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_56": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_28": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_56": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_33": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_14": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_42": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_43": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_44": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_72": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_73": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_72": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_99": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_100": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_28": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_43": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_73": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_57": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_74": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_101": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_102": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_29": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_44": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_75": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_58": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_70": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_74": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_71": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_75": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_72": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_76": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_103": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_104": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_105": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_73": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_28": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_76": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_14": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_29": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_74": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_14": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_45": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_34": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_57": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_59": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_29": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_58": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_14": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_59": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_60": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_30": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_60": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_35": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_15": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_45": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_46": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_47": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_77": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_78": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_77": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_106": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_107": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_30": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_46": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_78": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_61": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_79": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_108": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_109": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_31": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_47": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_80": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_62": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_75": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_79": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_76": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_80": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_77": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_81": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_110": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_111": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_112": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_78": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_30": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_81": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_15": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_31": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_79": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_15": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_48": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_36": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_61": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_63": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_31": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_62": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_15": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_63": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_64": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_32": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_64": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_37": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_16": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_48": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_49": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_50": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_82": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_83": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_82": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_113": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_114": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_32": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_49": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_83": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_65": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_84": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_115": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_116": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_33": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_50": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_85": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_66": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_80": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_84": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_81": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_85": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_82": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_86": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_117": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_118": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_119": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_83": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_32": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_86": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_16": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_33": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_84": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_16": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_51": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_38": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_65": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_67": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_33": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_66": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_16": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_67": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_68": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_34": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_68": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_39": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_17": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_51": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_52": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_53": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_87": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_88": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_87": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_120": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_121": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_34": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_52": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_88": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_69": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_89": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_122": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_123": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_35": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_53": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_90": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_70": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_85": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_89": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_86": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_90": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_87": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_91": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_124": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_125": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_126": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_88": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_34": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_91": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_17": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_35": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_89": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_17": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_54": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_40": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_69": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_71": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_35": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_70": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_17": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_71": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_72": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_36": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_72": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_41": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_18": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_54": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_55": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_56": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_92": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_93": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_92": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_127": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_128": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_36": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_55": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_93": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_73": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_94": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_129": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_130": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_37": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_56": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_95": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_74": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_90": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_94": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_91": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_95": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_92": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_96": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_131": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_132": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_133": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_93": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_36": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_96": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_18": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_37": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_94": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_18": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_57": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_42": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_73": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_75": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_37": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_74": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_18": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_75": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_76": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_38": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_76": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_43": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_19": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_57": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_58": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_59": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_97": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_98": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_97": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_134": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_135": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_38": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_58": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_98": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_77": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_99": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_136": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_137": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_39": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_59": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_100": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_78": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_95": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_99": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_96": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_100": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_97": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_101": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_138": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_139": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_140": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_98": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_38": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_101": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_19": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_39": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_99": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_19": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_60": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_44": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_77": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_79": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_39": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_78": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_19": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_79": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_80": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_40": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_80": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_45": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_20": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_60": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_61": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_62": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_102": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_103": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_102": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_141": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_142": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_40": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_61": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_103": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_81": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_104": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_143": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_144": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_41": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_62": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_105": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_82": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_100": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_104": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_101": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_105": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_102": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_106": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_145": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_146": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_147": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_103": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_40": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_106": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_20": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_41": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_104": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_20": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_63": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_46": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_81": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_83": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_41": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_82": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_20": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_83": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_84": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_42": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_84": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_47": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_21": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_63": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_64": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_65": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_107": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_108": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_107": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_148": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_149": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_42": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_64": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_108": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_85": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_109": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_150": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_151": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_43": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_65": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_110": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_86": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_105": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_109": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_106": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_110": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_107": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_111": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_152": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_153": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_154": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_108": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_42": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_111": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_21": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_43": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_109": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_21": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_66": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_48": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_85": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_87": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_43": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_86": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_21": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_87": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_88": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_44": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_88": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_49": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_22": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_66": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_67": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_68": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_112": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_113": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_112": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_155": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_156": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_44": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_67": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_113": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_89": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_114": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_157": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_158": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_45": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_68": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_115": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_90": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_110": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_114": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_111": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_115": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_112": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_116": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_159": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_160": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_161": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_113": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_44": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_116": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_22": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_45": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_114": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_22": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_69": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_50": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_89": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_91": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_45": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_90": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_22": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_91": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_92": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_46": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_92": { + "shape": [ + 988, + 3072 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "view_51": { + "shape": [ + 988, + 3, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "permute_23": { + "shape": [ + 3, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 12140544 + }, + "select_69": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_70": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "select_71": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_117": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "unsqueeze_118": { + "shape": [ + 988, + 1, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 252928 + }, + "mul_117": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_162": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_163": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_46": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_70": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_118": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_93": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_119": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_164": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "slice_165": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "neg_47": { + "shape": [ + 988, + 16, + 32 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + }, + "cat_71": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "mul_120": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_94": { + "shape": [ + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_115": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_119": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_116": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_120": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_117": { + "shape": [ + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "unsqueeze_121": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_166": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_167": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "slice_168": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_118": { + "shape": [ + 1, + 16, + 64, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "matmul_46": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "mul_121": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "softmax_23": { + "shape": [ + 1, + 16, + 988, + 988 + ], + "dtype": "float32", + "role": "value", + "byteLength": 62473216 + }, + "matmul_47": { + "shape": [ + 1, + 16, + 988, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "transpose_119": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "clone_23": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "cat_72": { + "shape": [ + 1, + 988, + 16, + 64 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_52": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_93": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_95": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_47": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_94": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "gelu_23": { + "shape": [ + 988, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 16187392 + }, + "linear_95": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "add_96": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "layer_norm_48": { + "shape": [ + 988, + 1024 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "view_53": { + "shape": [ + 247, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_96": { + "shape": [ + 247, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "gelu_24": { + "shape": [ + 247, + 4096 + ], + "dtype": "float32", + "role": "value", + "byteLength": 4046848 + }, + "linear_97": { + "shape": [ + 247, + 2048 + ], + "dtype": "float32", + "role": "value", + "byteLength": 2023424 + } + }, + "nodes": [ + { + "id": "view", + "op": "aten.view.default", + "args": [ + { + "tensor": "pixels" + }, + [ + -1, + 3, + 2, + 16, + 16 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1096, in forward\n hidden_states = self.patch_embed(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 859, in forward\n hidden_states = hidden_states.view(\n ^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "conv3d", + "op": "aten.conv3d.default", + "args": [ + { + "tensor": "view" + }, + { + "tensor": "p_visual_patch_embed_proj_weight" + }, + { + "tensor": "p_visual_patch_embed_proj_bias" + }, + [ + 2, + 16, + 16 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1096, in forward\n hidden_states = self.patch_embed(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 862, in forward\n hidden_states = self.proj(hidden_states.to(dtype=target_dtype)).view(-1, self.embed_dim)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_1", + "op": "aten.view.default", + "args": [ + { + "tensor": "conv3d" + }, + [ + -1, + 1024 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1096, in forward\n hidden_states = self.patch_embed(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 862, in forward\n hidden_states = self.proj(hidden_states.to(dtype=target_dtype)).view(-1, self.embed_dim)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "embedding", + "op": "aten.embedding.default", + "args": [ + { + "tensor": "p_visual_pos_embed_weight" + }, + { + "tensor": "b_indices" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1097, in forward\n pos_embeds = (self.pos_embed(interp_indices) * interp_weights[:, :, None]).sum(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "b_interpolation_weights" + }, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1097, in forward\n pos_embeds = (self.pos_embed(interp_indices) * interp_weights[:, :, None]).sum(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "embedding" + }, + { + "tensor": "unsqueeze" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1097, in forward\n pos_embeds = (self.pos_embed(interp_indices) * interp_weights[:, :, None]).sum(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "sum_1", + "op": "aten.sum.dim_IntList", + "args": [ + { + "tensor": "mul" + }, + [ + 1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1097, in forward\n pos_embeds = (self.pos_embed(interp_indices) * interp_weights[:, :, None]).sum(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "view_1" + }, + { + "tensor": "sum_1" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1098, in forward\n hidden_states = hidden_states + pos_embeds.to(hidden_states.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_1", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "b_positions" + }, + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1099, in forward\n rotary_pos_emb = self.rotary_pos_emb(position_ids)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 81, in forward\n return (position_ids.unsqueeze(-1) * self.inv_freq).flatten(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_1", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "unsqueeze_1" + }, + { + "tensor": "b_visual_rotary_pos_emb_inv_freq" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1099, in forward\n rotary_pos_emb = self.rotary_pos_emb(position_ids)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 81, in forward\n return (position_ids.unsqueeze(-1) * self.inv_freq).flatten(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_2", + "op": "aten.view.default", + "args": [ + { + "tensor": "mul_1" + }, + [ + 988, + 32 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1099, in forward\n rotary_pos_emb = self.rotary_pos_emb(position_ids)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 81, in forward\n return (position_ids.unsqueeze(-1) * self.inv_freq).flatten(1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_3", + "op": "aten.view.default", + "args": [ + { + "tensor": "add" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1102, in forward\n hidden_states = hidden_states.reshape(seq_len, -1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_4", + "op": "aten.view.default", + "args": [ + { + "tensor": "view_2" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1103, in forward\n rotary_pos_emb = rotary_pos_emb.reshape(seq_len, -1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "view_4" + }, + { + "tensor": "view_4" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1104, in forward\n emb = torch.cat((rotary_pos_emb, rotary_pos_emb), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cos", + "op": "aten.cos.default", + "args": [ + { + "tensor": "cat" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1105, in forward\n position_embeddings = (emb.cos(), emb.sin())\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "sin", + "op": "aten.sin.default", + "args": [ + { + "tensor": "cat" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1105, in forward\n position_embeddings = (emb.cos(), emb.sin())\n ^^^^^^^^^^" + }, + { + "id": "layer_norm", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "view_3" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_0_norm1_weight" + }, + { + "tensor": "p_visual_blocks_0_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm" + }, + { + "tensor": "p_visual_blocks_0_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_0_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_5", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_5" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_1", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_2", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_2", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_3", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_2", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select" + }, + { + "tensor": "unsqueeze_2" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_1", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_2", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_2" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_1", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg" + }, + { + "tensor": "slice_1" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_3", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_1" + }, + { + "tensor": "unsqueeze_3" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_1", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_2" + }, + { + "tensor": "mul_3" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_4", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_1" + }, + { + "tensor": "unsqueeze_2" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_3", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_1" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_4", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_1" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_1", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_4" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_2", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_1" + }, + { + "tensor": "slice_3" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_5", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_2" + }, + { + "tensor": "unsqueeze_3" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_2", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_4" + }, + { + "tensor": "mul_5" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_1" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_4", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_1", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_2" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_5", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_1" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_2", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_2" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_6", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_2" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_5", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_4" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_6", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_5" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_7", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_6" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_3", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_6" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_5" + }, + { + "tensor": "transpose_3" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_6", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_6" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_1", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax" + }, + { + "tensor": "slice_7" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_4", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_1" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_4" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_3", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_6", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_3" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_1", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_6" + }, + { + "tensor": "p_visual_blocks_0_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_0_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_3", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "view_3" + }, + { + "tensor": "linear_1" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_1", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_3" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_0_norm2_weight" + }, + { + "tensor": "p_visual_blocks_0_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_2", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_1" + }, + { + "tensor": "p_visual_blocks_0_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_0_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_2" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_3", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu" + }, + { + "tensor": "p_visual_blocks_0_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_0_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_4", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_3" + }, + { + "tensor": "linear_3" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_2", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_4" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_1_norm1_weight" + }, + { + "tensor": "p_visual_blocks_1_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_4", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_2" + }, + { + "tensor": "p_visual_blocks_1_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_1_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_7", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_4" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_1", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_7" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_3", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_1" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_4", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_1" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_5", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_1" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_7", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_8", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_7", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_3" + }, + { + "tensor": "unsqueeze_7" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_8", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_3" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_9", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_3" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_2", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_9" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_4", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_2" + }, + { + "tensor": "slice_8" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_8", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_4" + }, + { + "tensor": "unsqueeze_8" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_5", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_7" + }, + { + "tensor": "mul_8" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_9", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_4" + }, + { + "tensor": "unsqueeze_7" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_10", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_4" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_11", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_4" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_3", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_11" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_5", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_3" + }, + { + "tensor": "slice_10" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_10", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_5" + }, + { + "tensor": "unsqueeze_8" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_6", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_9" + }, + { + "tensor": "mul_10" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_5", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_5" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_9", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_5" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_6", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_6" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_10", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_6" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_7", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_5" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_11", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_7" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_12", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_9" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_13", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_10" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_14", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_11" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_8", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_13" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_2", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_12" + }, + { + "tensor": "transpose_8" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_11", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_2" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_1", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_11" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_3", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_1" + }, + { + "tensor": "slice_14" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_9", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_3" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_1", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_9" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_6", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_1" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_8", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_6" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_5", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_8" + }, + { + "tensor": "p_visual_blocks_1_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_1_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_7", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_4" + }, + { + "tensor": "linear_5" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_3", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_7" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_1_norm2_weight" + }, + { + "tensor": "p_visual_blocks_1_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_6", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_3" + }, + { + "tensor": "p_visual_blocks_1_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_1_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_1", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_6" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_7", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_1" + }, + { + "tensor": "p_visual_blocks_1_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_1_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_8", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_7" + }, + { + "tensor": "linear_7" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_4", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_8" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_2_norm1_weight" + }, + { + "tensor": "p_visual_blocks_2_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_8", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_4" + }, + { + "tensor": "p_visual_blocks_2_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_2_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_9", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_8" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_2", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_9" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_6", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_2" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_7", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_2" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_8", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_2" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_12", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_13", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_12", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_6" + }, + { + "tensor": "unsqueeze_12" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_15", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_6" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_16", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_6" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_4", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_16" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_7", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_4" + }, + { + "tensor": "slice_15" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_13", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_7" + }, + { + "tensor": "unsqueeze_13" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_9", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_12" + }, + { + "tensor": "mul_13" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_14", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_7" + }, + { + "tensor": "unsqueeze_12" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_17", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_7" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_18", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_7" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_5", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_18" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_8", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_5" + }, + { + "tensor": "slice_17" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_15", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_8" + }, + { + "tensor": "unsqueeze_13" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_10", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_14" + }, + { + "tensor": "mul_15" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_10", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_9" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_14", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_10" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_11", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_10" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_15", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_11" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_12", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_8" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_16", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_12" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_19", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_14" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_20", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_15" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_21", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_16" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_13", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_20" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_4", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_19" + }, + { + "tensor": "transpose_13" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_16", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_4" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_2", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_16" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_5", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_2" + }, + { + "tensor": "slice_21" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_14", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_5" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_2", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_14" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_9", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_2" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_10", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_9" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_9", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_10" + }, + { + "tensor": "p_visual_blocks_2_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_2_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_11", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_8" + }, + { + "tensor": "linear_9" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_5", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_11" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_2_norm2_weight" + }, + { + "tensor": "p_visual_blocks_2_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_10", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_5" + }, + { + "tensor": "p_visual_blocks_2_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_2_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_2", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_10" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_11", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_2" + }, + { + "tensor": "p_visual_blocks_2_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_2_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_12", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_11" + }, + { + "tensor": "linear_11" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_6", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_12" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_3_norm1_weight" + }, + { + "tensor": "p_visual_blocks_3_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_12", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_6" + }, + { + "tensor": "p_visual_blocks_3_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_3_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_11", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_12" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_3", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_11" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_9", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_3" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_10", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_3" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_11", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_3" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_17", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_18", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_17", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_9" + }, + { + "tensor": "unsqueeze_17" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_22", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_9" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_23", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_9" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_6", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_10", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_6" + }, + { + "tensor": "slice_22" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_18", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_10" + }, + { + "tensor": "unsqueeze_18" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_13", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_17" + }, + { + "tensor": "mul_18" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_19", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_10" + }, + { + "tensor": "unsqueeze_17" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_24", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_10" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_25", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_10" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_7", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_25" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_11", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_7" + }, + { + "tensor": "slice_24" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_20", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_11" + }, + { + "tensor": "unsqueeze_18" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_14", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_19" + }, + { + "tensor": "mul_20" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_15", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_13" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_19", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_15" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_16", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_14" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_20", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_16" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_17", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_11" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_21", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_17" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_26", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_19" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_27", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_20" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_28", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_21" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_18", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_27" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_6", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_26" + }, + { + "tensor": "transpose_18" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_21", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_6" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_3", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_21" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_7", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_3" + }, + { + "tensor": "slice_28" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_19", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_7" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_3", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_19" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_12", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_3" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_12", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_12" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_13", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_12" + }, + { + "tensor": "p_visual_blocks_3_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_3_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_15", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_12" + }, + { + "tensor": "linear_13" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_7", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_15" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_3_norm2_weight" + }, + { + "tensor": "p_visual_blocks_3_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_14", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_7" + }, + { + "tensor": "p_visual_blocks_3_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_3_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_3", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_14" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_15", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_3" + }, + { + "tensor": "p_visual_blocks_3_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_3_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_16", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_15" + }, + { + "tensor": "linear_15" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_8", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_16" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_4_norm1_weight" + }, + { + "tensor": "p_visual_blocks_4_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_16", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_8" + }, + { + "tensor": "p_visual_blocks_4_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_4_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_13", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_16" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_4", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_13" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_12", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_4" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_13", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_4" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_14", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_4" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_22", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_23", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_22", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_12" + }, + { + "tensor": "unsqueeze_22" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_29", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_12" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_30", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_12" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_8", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_30" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_13", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_8" + }, + { + "tensor": "slice_29" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_23", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_13" + }, + { + "tensor": "unsqueeze_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_17", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_22" + }, + { + "tensor": "mul_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_24", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_13" + }, + { + "tensor": "unsqueeze_22" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_31", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_13" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_32", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_13" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_9", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_14", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_9" + }, + { + "tensor": "slice_31" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_25", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_14" + }, + { + "tensor": "unsqueeze_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_18", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_24" + }, + { + "tensor": "mul_25" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_20", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_17" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_24", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_20" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_21", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_18" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_25", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_21" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_22", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_14" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_26", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_22" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_33", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_24" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_34", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_25" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_35", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_26" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_23", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_34" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_8", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_33" + }, + { + "tensor": "transpose_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_26", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_8" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_4", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_26" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_9", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_4" + }, + { + "tensor": "slice_35" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_24", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_9" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_4", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_24" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_15", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_4" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_14", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_15" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_17", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_14" + }, + { + "tensor": "p_visual_blocks_4_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_4_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_19", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_16" + }, + { + "tensor": "linear_17" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_9", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_19" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_4_norm2_weight" + }, + { + "tensor": "p_visual_blocks_4_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_18", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_9" + }, + { + "tensor": "p_visual_blocks_4_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_4_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_4", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_18" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_19", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_4" + }, + { + "tensor": "p_visual_blocks_4_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_4_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_20", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_19" + }, + { + "tensor": "linear_19" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_10", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_20" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_5_norm1_weight" + }, + { + "tensor": "p_visual_blocks_5_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_20", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_10" + }, + { + "tensor": "p_visual_blocks_5_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_5_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_15", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_20" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_5", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_15" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_15", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_5" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_16", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_5" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_17", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_5" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_27", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_28", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_27", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_15" + }, + { + "tensor": "unsqueeze_27" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_36", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_15" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_37", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_15" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_10", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_37" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_16", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_10" + }, + { + "tensor": "slice_36" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_28", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_16" + }, + { + "tensor": "unsqueeze_28" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_21", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_27" + }, + { + "tensor": "mul_28" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_29", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_16" + }, + { + "tensor": "unsqueeze_27" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_38", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_16" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_39", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_16" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_11", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_39" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_17", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_11" + }, + { + "tensor": "slice_38" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_30", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_17" + }, + { + "tensor": "unsqueeze_28" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_22", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_29" + }, + { + "tensor": "mul_30" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_25", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_21" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_29", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_25" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_26", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_22" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_30", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_26" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_27", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_17" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_31", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_27" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_40", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_29" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_41", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_30" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_42", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_31" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_28", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_41" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_10", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_40" + }, + { + "tensor": "transpose_28" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_31", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_10" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_5", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_31" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_11", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_5" + }, + { + "tensor": "slice_42" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_29", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_11" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_5", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_29" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_18", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_5" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_16", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_18" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_21", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_16" + }, + { + "tensor": "p_visual_blocks_5_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_5_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_23", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_20" + }, + { + "tensor": "linear_21" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_11", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_23" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_5_norm2_weight" + }, + { + "tensor": "p_visual_blocks_5_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_22", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_11" + }, + { + "tensor": "p_visual_blocks_5_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_5_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_5", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_22" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_23", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_5" + }, + { + "tensor": "p_visual_blocks_5_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_5_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_24", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_23" + }, + { + "tensor": "linear_23" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_12", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_24" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_6_norm1_weight" + }, + { + "tensor": "p_visual_blocks_6_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_24", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_12" + }, + { + "tensor": "p_visual_blocks_6_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_6_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_17", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_24" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_6", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_17" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_18", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_6" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_19", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_6" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_20", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_6" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_32", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_33", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_32", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_18" + }, + { + "tensor": "unsqueeze_32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_43", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_18" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_44", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_18" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_12", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_44" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_19", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_12" + }, + { + "tensor": "slice_43" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_33", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_19" + }, + { + "tensor": "unsqueeze_33" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_25", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_32" + }, + { + "tensor": "mul_33" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_34", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_19" + }, + { + "tensor": "unsqueeze_32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_45", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_19" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_46", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_19" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_13", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_46" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_20", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_13" + }, + { + "tensor": "slice_45" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_35", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_20" + }, + { + "tensor": "unsqueeze_33" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_26", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_34" + }, + { + "tensor": "mul_35" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_30", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_25" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_34", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_30" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_31", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_26" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_35", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_31" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_32", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_20" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_36", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_32" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_47", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_34" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_48", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_35" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_49", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_36" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_33", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_48" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_12", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_47" + }, + { + "tensor": "transpose_33" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_36", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_12" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_6", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_36" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_13", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_6" + }, + { + "tensor": "slice_49" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_34", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_13" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_6", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_34" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_21", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_6" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_18", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_21" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_25", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_18" + }, + { + "tensor": "p_visual_blocks_6_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_6_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_27", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_24" + }, + { + "tensor": "linear_25" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_13", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_27" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_6_norm2_weight" + }, + { + "tensor": "p_visual_blocks_6_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_26", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_13" + }, + { + "tensor": "p_visual_blocks_6_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_6_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_6", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_26" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_27", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_6" + }, + { + "tensor": "p_visual_blocks_6_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_6_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_28", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_27" + }, + { + "tensor": "linear_27" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_14", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_28" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_7_norm1_weight" + }, + { + "tensor": "p_visual_blocks_7_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_28", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_14" + }, + { + "tensor": "p_visual_blocks_7_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_7_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_19", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_28" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_7", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_19" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_21", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_7" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_22", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_7" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_23", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_7" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_37", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_38", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_37", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_21" + }, + { + "tensor": "unsqueeze_37" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_50", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_21" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_51", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_21" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_14", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_51" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_22", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_14" + }, + { + "tensor": "slice_50" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_38", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_22" + }, + { + "tensor": "unsqueeze_38" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_29", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_37" + }, + { + "tensor": "mul_38" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_39", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_22" + }, + { + "tensor": "unsqueeze_37" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_52", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_22" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_53", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_22" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_15", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_23", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_15" + }, + { + "tensor": "slice_52" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_40", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_23" + }, + { + "tensor": "unsqueeze_38" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_30", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_39" + }, + { + "tensor": "mul_40" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_35", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_29" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_39", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_35" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_36", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_30" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_40", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_36" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_37", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_23" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_41", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_37" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_54", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_39" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_55", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_40" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_56", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_41" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_38", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_55" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_14", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_54" + }, + { + "tensor": "transpose_38" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_41", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_14" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_7", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_41" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_15", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_7" + }, + { + "tensor": "slice_56" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_39", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_15" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_7", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_39" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_24", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_7" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_20", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_24" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_29", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_20" + }, + { + "tensor": "p_visual_blocks_7_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_7_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_31", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_28" + }, + { + "tensor": "linear_29" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_15", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_31" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_7_norm2_weight" + }, + { + "tensor": "p_visual_blocks_7_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_30", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_15" + }, + { + "tensor": "p_visual_blocks_7_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_7_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_7", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_30" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_31", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_7" + }, + { + "tensor": "p_visual_blocks_7_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_7_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_32", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_31" + }, + { + "tensor": "linear_31" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_16", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_32" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_8_norm1_weight" + }, + { + "tensor": "p_visual_blocks_8_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_32", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_16" + }, + { + "tensor": "p_visual_blocks_8_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_8_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_21", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_32" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_8", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_21" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_24", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_8" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_25", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_8" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_26", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_8" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_42", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_43", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_42", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_24" + }, + { + "tensor": "unsqueeze_42" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_57", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_24" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_58", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_24" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_16", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_58" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_25", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_16" + }, + { + "tensor": "slice_57" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_43", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_25" + }, + { + "tensor": "unsqueeze_43" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_33", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_42" + }, + { + "tensor": "mul_43" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_44", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_25" + }, + { + "tensor": "unsqueeze_42" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_59", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_25" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_60", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_25" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_17", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_60" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_26", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_17" + }, + { + "tensor": "slice_59" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_45", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_26" + }, + { + "tensor": "unsqueeze_43" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_34", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_44" + }, + { + "tensor": "mul_45" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_40", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_33" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_44", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_40" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_41", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_34" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_45", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_41" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_42", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_26" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_46", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_42" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_61", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_44" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_62", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_45" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_63", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_46" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_43", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_62" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_16", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_61" + }, + { + "tensor": "transpose_43" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_46", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_16" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_8", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_46" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_17", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_8" + }, + { + "tensor": "slice_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_44", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_17" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_8", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_44" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_27", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_8" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_22", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_27" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_33", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_22" + }, + { + "tensor": "p_visual_blocks_8_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_8_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_35", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_32" + }, + { + "tensor": "linear_33" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_17", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_35" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_8_norm2_weight" + }, + { + "tensor": "p_visual_blocks_8_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_34", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_17" + }, + { + "tensor": "p_visual_blocks_8_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_8_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_8", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_34" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_35", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_8" + }, + { + "tensor": "p_visual_blocks_8_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_8_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_36", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_35" + }, + { + "tensor": "linear_35" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_18", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_36" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_9_norm1_weight" + }, + { + "tensor": "p_visual_blocks_9_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_36", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_18" + }, + { + "tensor": "p_visual_blocks_9_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_9_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_23", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_36" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_9", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_23" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_27", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_9" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_28", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_9" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_29", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_9" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_47", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_48", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_47", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_27" + }, + { + "tensor": "unsqueeze_47" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_64", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_27" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_65", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_27" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_18", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_65" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_28", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_18" + }, + { + "tensor": "slice_64" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_48", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_28" + }, + { + "tensor": "unsqueeze_48" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_37", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_47" + }, + { + "tensor": "mul_48" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_49", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_28" + }, + { + "tensor": "unsqueeze_47" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_66", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_28" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_67", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_28" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_19", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_67" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_29", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_19" + }, + { + "tensor": "slice_66" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_50", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_29" + }, + { + "tensor": "unsqueeze_48" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_38", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_49" + }, + { + "tensor": "mul_50" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_45", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_37" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_49", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_45" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_46", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_38" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_50", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_46" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_47", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_29" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_51", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_47" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_68", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_49" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_69", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_50" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_70", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_51" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_48", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_69" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_18", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_68" + }, + { + "tensor": "transpose_48" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_51", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_18" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_9", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_51" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_19", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_9" + }, + { + "tensor": "slice_70" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_49", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_19" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_9", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_49" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_30", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_9" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_24", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_30" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_37", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_24" + }, + { + "tensor": "p_visual_blocks_9_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_9_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_39", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_36" + }, + { + "tensor": "linear_37" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_19", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_39" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_9_norm2_weight" + }, + { + "tensor": "p_visual_blocks_9_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_38", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_19" + }, + { + "tensor": "p_visual_blocks_9_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_9_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_9", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_38" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_39", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_9" + }, + { + "tensor": "p_visual_blocks_9_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_9_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_40", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_39" + }, + { + "tensor": "linear_39" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_20", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_40" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_10_norm1_weight" + }, + { + "tensor": "p_visual_blocks_10_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_40", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_20" + }, + { + "tensor": "p_visual_blocks_10_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_10_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_25", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_40" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_10", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_25" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_30", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_10" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_31", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_10" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_32", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_10" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_52", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_53", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_52", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_30" + }, + { + "tensor": "unsqueeze_52" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_71", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_30" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_72", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_30" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_20", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_72" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_31", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_20" + }, + { + "tensor": "slice_71" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_53", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_31" + }, + { + "tensor": "unsqueeze_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_41", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_52" + }, + { + "tensor": "mul_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_54", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_31" + }, + { + "tensor": "unsqueeze_52" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_73", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_31" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_74", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_31" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_21", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_74" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_32", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_21" + }, + { + "tensor": "slice_73" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_55", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_32" + }, + { + "tensor": "unsqueeze_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_42", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_54" + }, + { + "tensor": "mul_55" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_50", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_41" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_54", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_50" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_51", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_42" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_55", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_51" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_52", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_32" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_56", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_52" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_75", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_54" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_76", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_55" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_77", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_56" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_53", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_76" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_20", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_75" + }, + { + "tensor": "transpose_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_56", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_20" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_10", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_56" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_21", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_10" + }, + { + "tensor": "slice_77" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_54", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_21" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_10", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_54" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_33", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_10" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_26", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_33" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_41", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_26" + }, + { + "tensor": "p_visual_blocks_10_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_10_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_43", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_40" + }, + { + "tensor": "linear_41" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_21", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_43" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_10_norm2_weight" + }, + { + "tensor": "p_visual_blocks_10_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_42", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_21" + }, + { + "tensor": "p_visual_blocks_10_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_10_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_10", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_42" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_43", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_10" + }, + { + "tensor": "p_visual_blocks_10_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_10_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_44", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_43" + }, + { + "tensor": "linear_43" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_22", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_44" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_11_norm1_weight" + }, + { + "tensor": "p_visual_blocks_11_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_44", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_22" + }, + { + "tensor": "p_visual_blocks_11_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_11_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_27", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_44" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_11", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_27" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_33", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_11" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_34", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_11" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_35", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_11" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_57", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_58", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_57", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_33" + }, + { + "tensor": "unsqueeze_57" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_78", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_33" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_79", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_33" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_22", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_79" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_34", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_22" + }, + { + "tensor": "slice_78" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_58", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_34" + }, + { + "tensor": "unsqueeze_58" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_45", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_57" + }, + { + "tensor": "mul_58" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_59", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_34" + }, + { + "tensor": "unsqueeze_57" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_80", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_34" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_81", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_34" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_23", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_81" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_35", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_23" + }, + { + "tensor": "slice_80" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_60", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_35" + }, + { + "tensor": "unsqueeze_58" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_46", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_59" + }, + { + "tensor": "mul_60" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_55", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_45" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_59", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_55" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_56", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_46" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_60", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_56" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_57", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_35" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_61", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_57" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_82", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_59" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_83", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_60" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_84", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_61" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_58", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_83" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_22", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_82" + }, + { + "tensor": "transpose_58" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_61", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_22" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_11", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_61" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_23", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_11" + }, + { + "tensor": "slice_84" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_59", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_23" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_11", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_59" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_36", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_11" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_28", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_36" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_45", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_28" + }, + { + "tensor": "p_visual_blocks_11_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_11_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_47", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_44" + }, + { + "tensor": "linear_45" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_23", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_47" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_11_norm2_weight" + }, + { + "tensor": "p_visual_blocks_11_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_46", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_23" + }, + { + "tensor": "p_visual_blocks_11_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_11_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_11", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_46" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_47", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_11" + }, + { + "tensor": "p_visual_blocks_11_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_11_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_48", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_47" + }, + { + "tensor": "linear_47" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_24", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_48" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_12_norm1_weight" + }, + { + "tensor": "p_visual_blocks_12_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_48", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_24" + }, + { + "tensor": "p_visual_blocks_12_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_12_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_29", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_48" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_12", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_29" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_36", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_12" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_37", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_12" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_38", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_12" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_62", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_63", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_62", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_36" + }, + { + "tensor": "unsqueeze_62" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_85", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_36" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_86", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_36" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_24", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_86" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_37", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_24" + }, + { + "tensor": "slice_85" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_63", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_37" + }, + { + "tensor": "unsqueeze_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_49", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_62" + }, + { + "tensor": "mul_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_64", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_37" + }, + { + "tensor": "unsqueeze_62" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_87", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_37" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_88", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_37" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_25", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_88" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_38", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_25" + }, + { + "tensor": "slice_87" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_65", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_38" + }, + { + "tensor": "unsqueeze_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_50", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_64" + }, + { + "tensor": "mul_65" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_60", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_49" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_64", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_60" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_61", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_50" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_65", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_61" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_62", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_38" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_66", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_62" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_89", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_64" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_90", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_65" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_91", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_66" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_63", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_90" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_24", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_89" + }, + { + "tensor": "transpose_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_66", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_24" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_12", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_66" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_25", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_12" + }, + { + "tensor": "slice_91" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_64", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_25" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_12", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_64" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_39", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_12" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_30", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_39" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_49", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_30" + }, + { + "tensor": "p_visual_blocks_12_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_12_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_51", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_48" + }, + { + "tensor": "linear_49" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_25", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_51" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_12_norm2_weight" + }, + { + "tensor": "p_visual_blocks_12_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_50", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_25" + }, + { + "tensor": "p_visual_blocks_12_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_12_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_12", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_50" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_51", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_12" + }, + { + "tensor": "p_visual_blocks_12_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_12_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_52", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_51" + }, + { + "tensor": "linear_51" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_26", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_52" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_13_norm1_weight" + }, + { + "tensor": "p_visual_blocks_13_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_52", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_26" + }, + { + "tensor": "p_visual_blocks_13_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_13_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_31", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_52" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_13", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_31" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_39", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_13" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_40", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_13" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_41", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_13" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_67", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_68", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_67", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_39" + }, + { + "tensor": "unsqueeze_67" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_92", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_39" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_93", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_39" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_26", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_40", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_26" + }, + { + "tensor": "slice_92" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_68", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_40" + }, + { + "tensor": "unsqueeze_68" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_53", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_67" + }, + { + "tensor": "mul_68" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_69", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_40" + }, + { + "tensor": "unsqueeze_67" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_94", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_40" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_95", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_40" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_27", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_95" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_41", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_27" + }, + { + "tensor": "slice_94" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_70", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_41" + }, + { + "tensor": "unsqueeze_68" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_54", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_69" + }, + { + "tensor": "mul_70" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_65", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_53" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_69", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_65" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_66", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_54" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_70", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_66" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_67", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_41" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_71", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_67" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_96", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_69" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_97", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_70" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_98", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_71" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_68", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_97" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_26", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_96" + }, + { + "tensor": "transpose_68" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_71", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_26" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_13", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_71" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_27", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_13" + }, + { + "tensor": "slice_98" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_69", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_27" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_13", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_69" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_42", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_13" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_32", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_42" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_53", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_32" + }, + { + "tensor": "p_visual_blocks_13_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_13_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_55", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_52" + }, + { + "tensor": "linear_53" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_27", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_55" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_13_norm2_weight" + }, + { + "tensor": "p_visual_blocks_13_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_54", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_27" + }, + { + "tensor": "p_visual_blocks_13_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_13_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_13", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_54" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_55", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_13" + }, + { + "tensor": "p_visual_blocks_13_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_13_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_56", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_55" + }, + { + "tensor": "linear_55" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_28", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_56" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_14_norm1_weight" + }, + { + "tensor": "p_visual_blocks_14_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_56", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_28" + }, + { + "tensor": "p_visual_blocks_14_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_14_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_33", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_56" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_14", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_33" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_42", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_14" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_43", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_14" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_44", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_14" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_72", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_73", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_72", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_42" + }, + { + "tensor": "unsqueeze_72" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_99", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_42" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_100", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_42" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_28", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_100" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_43", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_28" + }, + { + "tensor": "slice_99" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_73", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_43" + }, + { + "tensor": "unsqueeze_73" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_57", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_72" + }, + { + "tensor": "mul_73" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_74", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_43" + }, + { + "tensor": "unsqueeze_72" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_101", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_43" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_102", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_43" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_29", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_102" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_44", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_29" + }, + { + "tensor": "slice_101" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_75", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_44" + }, + { + "tensor": "unsqueeze_73" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_58", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_74" + }, + { + "tensor": "mul_75" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_70", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_57" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_74", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_70" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_71", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_58" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_75", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_71" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_72", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_44" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_76", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_72" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_103", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_74" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_104", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_75" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_105", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_76" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_73", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_104" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_28", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_103" + }, + { + "tensor": "transpose_73" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_76", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_28" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_14", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_76" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_29", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_14" + }, + { + "tensor": "slice_105" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_74", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_29" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_14", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_74" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_45", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_14" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_34", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_45" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_57", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_34" + }, + { + "tensor": "p_visual_blocks_14_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_14_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_59", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_56" + }, + { + "tensor": "linear_57" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_29", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_59" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_14_norm2_weight" + }, + { + "tensor": "p_visual_blocks_14_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_58", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_29" + }, + { + "tensor": "p_visual_blocks_14_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_14_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_14", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_58" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_59", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_14" + }, + { + "tensor": "p_visual_blocks_14_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_14_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_60", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_59" + }, + { + "tensor": "linear_59" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_30", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_60" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_15_norm1_weight" + }, + { + "tensor": "p_visual_blocks_15_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_60", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_30" + }, + { + "tensor": "p_visual_blocks_15_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_15_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_35", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_60" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_15", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_35" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_45", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_15" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_46", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_15" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_47", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_15" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_77", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_78", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_77", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_45" + }, + { + "tensor": "unsqueeze_77" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_106", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_45" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_107", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_45" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_30", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_107" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_46", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_30" + }, + { + "tensor": "slice_106" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_78", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_46" + }, + { + "tensor": "unsqueeze_78" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_61", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_77" + }, + { + "tensor": "mul_78" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_79", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_46" + }, + { + "tensor": "unsqueeze_77" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_108", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_46" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_109", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_46" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_31", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_109" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_47", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_31" + }, + { + "tensor": "slice_108" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_80", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_47" + }, + { + "tensor": "unsqueeze_78" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_62", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_79" + }, + { + "tensor": "mul_80" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_75", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_61" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_79", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_75" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_76", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_62" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_80", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_76" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_77", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_47" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_81", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_77" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_110", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_79" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_111", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_80" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_112", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_81" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_78", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_111" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_30", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_110" + }, + { + "tensor": "transpose_78" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_81", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_30" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_15", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_81" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_31", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_15" + }, + { + "tensor": "slice_112" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_79", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_31" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_15", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_79" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_48", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_15" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_36", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_48" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_61", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_36" + }, + { + "tensor": "p_visual_blocks_15_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_15_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_63", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_60" + }, + { + "tensor": "linear_61" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_31", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_63" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_15_norm2_weight" + }, + { + "tensor": "p_visual_blocks_15_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_62", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_31" + }, + { + "tensor": "p_visual_blocks_15_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_15_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_15", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_62" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_63", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_15" + }, + { + "tensor": "p_visual_blocks_15_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_15_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_64", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_63" + }, + { + "tensor": "linear_63" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_32", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_64" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_16_norm1_weight" + }, + { + "tensor": "p_visual_blocks_16_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_64", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_32" + }, + { + "tensor": "p_visual_blocks_16_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_16_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_37", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_64" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_16", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_37" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_48", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_16" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_49", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_16" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_50", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_16" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_82", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_83", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_82", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_48" + }, + { + "tensor": "unsqueeze_82" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_113", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_48" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_114", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_48" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_32", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_114" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_49", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_32" + }, + { + "tensor": "slice_113" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_83", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_49" + }, + { + "tensor": "unsqueeze_83" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_65", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_82" + }, + { + "tensor": "mul_83" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_84", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_49" + }, + { + "tensor": "unsqueeze_82" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_115", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_49" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_116", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_49" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_33", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_116" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_50", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_33" + }, + { + "tensor": "slice_115" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_85", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_50" + }, + { + "tensor": "unsqueeze_83" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_66", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_84" + }, + { + "tensor": "mul_85" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_80", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_65" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_84", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_80" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_81", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_66" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_85", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_81" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_82", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_50" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_86", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_82" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_117", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_84" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_118", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_85" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_119", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_86" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_83", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_118" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_32", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_117" + }, + { + "tensor": "transpose_83" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_86", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_32" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_16", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_86" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_33", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_16" + }, + { + "tensor": "slice_119" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_84", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_33" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_16", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_84" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_51", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_16" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_38", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_51" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_65", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_38" + }, + { + "tensor": "p_visual_blocks_16_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_16_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_67", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_64" + }, + { + "tensor": "linear_65" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_33", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_67" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_16_norm2_weight" + }, + { + "tensor": "p_visual_blocks_16_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_66", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_33" + }, + { + "tensor": "p_visual_blocks_16_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_16_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_16", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_66" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_67", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_16" + }, + { + "tensor": "p_visual_blocks_16_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_16_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_68", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_67" + }, + { + "tensor": "linear_67" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_34", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_68" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_17_norm1_weight" + }, + { + "tensor": "p_visual_blocks_17_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_68", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_34" + }, + { + "tensor": "p_visual_blocks_17_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_17_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_39", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_68" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_17", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_39" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_51", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_17" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_52", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_17" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_53", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_17" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_87", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_88", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_87", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_51" + }, + { + "tensor": "unsqueeze_87" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_120", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_51" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_121", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_51" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_34", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_121" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_52", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_34" + }, + { + "tensor": "slice_120" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_88", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_52" + }, + { + "tensor": "unsqueeze_88" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_69", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_87" + }, + { + "tensor": "mul_88" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_89", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_52" + }, + { + "tensor": "unsqueeze_87" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_122", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_52" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_123", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_52" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_35", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_123" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_53", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_35" + }, + { + "tensor": "slice_122" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_90", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_53" + }, + { + "tensor": "unsqueeze_88" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_70", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_89" + }, + { + "tensor": "mul_90" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_85", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_69" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_89", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_85" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_86", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_70" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_90", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_86" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_87", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_53" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_91", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_87" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_124", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_89" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_125", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_90" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_126", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_91" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_88", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_125" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_34", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_124" + }, + { + "tensor": "transpose_88" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_91", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_34" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_17", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_91" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_35", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_17" + }, + { + "tensor": "slice_126" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_89", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_35" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_17", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_89" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_54", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_17" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_40", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_54" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_69", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_40" + }, + { + "tensor": "p_visual_blocks_17_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_17_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_71", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_68" + }, + { + "tensor": "linear_69" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_35", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_71" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_17_norm2_weight" + }, + { + "tensor": "p_visual_blocks_17_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_70", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_35" + }, + { + "tensor": "p_visual_blocks_17_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_17_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_17", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_70" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_71", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_17" + }, + { + "tensor": "p_visual_blocks_17_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_17_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_72", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_71" + }, + { + "tensor": "linear_71" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_36", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_72" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_18_norm1_weight" + }, + { + "tensor": "p_visual_blocks_18_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_72", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_36" + }, + { + "tensor": "p_visual_blocks_18_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_18_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_41", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_72" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_18", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_41" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_54", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_18" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_55", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_18" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_56", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_18" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_92", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_93", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_92", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_54" + }, + { + "tensor": "unsqueeze_92" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_127", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_54" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_128", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_54" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_36", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_128" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_55", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_36" + }, + { + "tensor": "slice_127" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_93", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_55" + }, + { + "tensor": "unsqueeze_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_73", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_92" + }, + { + "tensor": "mul_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_94", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_55" + }, + { + "tensor": "unsqueeze_92" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_129", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_55" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_130", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_55" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_37", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_130" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_56", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_37" + }, + { + "tensor": "slice_129" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_95", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_56" + }, + { + "tensor": "unsqueeze_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_74", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_94" + }, + { + "tensor": "mul_95" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_90", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_73" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_94", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_90" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_91", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_74" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_95", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_91" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_92", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_56" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_96", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_92" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_131", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_94" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_132", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_95" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_133", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_96" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_93", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_132" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_36", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_131" + }, + { + "tensor": "transpose_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_96", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_36" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_18", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_96" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_37", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_18" + }, + { + "tensor": "slice_133" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_94", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_37" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_18", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_94" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_57", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_18" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_42", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_57" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_73", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_42" + }, + { + "tensor": "p_visual_blocks_18_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_18_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_75", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_72" + }, + { + "tensor": "linear_73" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_37", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_75" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_18_norm2_weight" + }, + { + "tensor": "p_visual_blocks_18_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_74", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_37" + }, + { + "tensor": "p_visual_blocks_18_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_18_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_18", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_74" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_75", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_18" + }, + { + "tensor": "p_visual_blocks_18_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_18_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_76", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_75" + }, + { + "tensor": "linear_75" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_38", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_76" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_19_norm1_weight" + }, + { + "tensor": "p_visual_blocks_19_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_76", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_38" + }, + { + "tensor": "p_visual_blocks_19_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_19_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_43", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_76" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_19", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_43" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_57", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_19" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_58", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_19" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_59", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_19" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_97", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_98", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_97", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_57" + }, + { + "tensor": "unsqueeze_97" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_134", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_57" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_135", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_57" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_38", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_135" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_58", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_38" + }, + { + "tensor": "slice_134" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_98", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_58" + }, + { + "tensor": "unsqueeze_98" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_77", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_97" + }, + { + "tensor": "mul_98" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_99", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_58" + }, + { + "tensor": "unsqueeze_97" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_136", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_58" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_137", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_58" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_39", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_137" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_59", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_39" + }, + { + "tensor": "slice_136" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_100", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_59" + }, + { + "tensor": "unsqueeze_98" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_78", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_99" + }, + { + "tensor": "mul_100" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_95", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_77" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_99", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_95" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_96", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_78" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_100", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_96" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_97", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_59" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_101", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_97" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_138", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_99" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_139", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_100" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_140", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_101" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_98", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_139" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_38", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_138" + }, + { + "tensor": "transpose_98" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_101", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_38" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_19", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_101" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_39", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_19" + }, + { + "tensor": "slice_140" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_99", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_39" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_19", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_99" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_60", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_19" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_44", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_60" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_77", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_44" + }, + { + "tensor": "p_visual_blocks_19_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_19_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_79", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_76" + }, + { + "tensor": "linear_77" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_39", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_79" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_19_norm2_weight" + }, + { + "tensor": "p_visual_blocks_19_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_78", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_39" + }, + { + "tensor": "p_visual_blocks_19_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_19_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_19", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_78" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_79", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_19" + }, + { + "tensor": "p_visual_blocks_19_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_19_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_80", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_79" + }, + { + "tensor": "linear_79" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_40", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_80" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_20_norm1_weight" + }, + { + "tensor": "p_visual_blocks_20_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_80", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_40" + }, + { + "tensor": "p_visual_blocks_20_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_20_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_45", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_80" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_20", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_45" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_60", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_20" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_61", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_20" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_62", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_20" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_102", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_103", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_102", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_60" + }, + { + "tensor": "unsqueeze_102" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_141", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_60" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_142", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_60" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_40", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_142" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_61", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_40" + }, + { + "tensor": "slice_141" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_103", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_61" + }, + { + "tensor": "unsqueeze_103" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_81", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_102" + }, + { + "tensor": "mul_103" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_104", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_61" + }, + { + "tensor": "unsqueeze_102" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_143", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_61" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_144", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_61" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_41", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_144" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_62", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_41" + }, + { + "tensor": "slice_143" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_105", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_62" + }, + { + "tensor": "unsqueeze_103" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_82", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_104" + }, + { + "tensor": "mul_105" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_100", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_81" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_104", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_100" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_101", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_82" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_105", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_101" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_102", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_62" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_106", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_102" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_145", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_104" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_146", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_105" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_147", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_106" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_103", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_146" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_40", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_145" + }, + { + "tensor": "transpose_103" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_106", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_40" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_20", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_106" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_41", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_20" + }, + { + "tensor": "slice_147" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_104", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_41" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_20", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_104" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_63", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_20" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_46", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_63" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_81", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_46" + }, + { + "tensor": "p_visual_blocks_20_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_20_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_83", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_80" + }, + { + "tensor": "linear_81" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_41", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_83" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_20_norm2_weight" + }, + { + "tensor": "p_visual_blocks_20_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_82", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_41" + }, + { + "tensor": "p_visual_blocks_20_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_20_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_20", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_82" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_83", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_20" + }, + { + "tensor": "p_visual_blocks_20_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_20_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_84", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_83" + }, + { + "tensor": "linear_83" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_42", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_84" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_21_norm1_weight" + }, + { + "tensor": "p_visual_blocks_21_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_84", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_42" + }, + { + "tensor": "p_visual_blocks_21_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_21_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_47", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_84" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_21", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_47" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_63", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_21" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_64", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_21" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_65", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_21" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_107", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_108", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_107", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_63" + }, + { + "tensor": "unsqueeze_107" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_148", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_63" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_149", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_63" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_42", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_149" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_64", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_42" + }, + { + "tensor": "slice_148" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_108", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_64" + }, + { + "tensor": "unsqueeze_108" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_85", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_107" + }, + { + "tensor": "mul_108" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_109", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_64" + }, + { + "tensor": "unsqueeze_107" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_150", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_64" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_151", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_64" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_43", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_151" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_65", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_43" + }, + { + "tensor": "slice_150" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_110", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_65" + }, + { + "tensor": "unsqueeze_108" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_86", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_109" + }, + { + "tensor": "mul_110" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_105", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_85" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_109", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_105" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_106", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_86" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_110", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_106" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_107", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_65" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_111", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_107" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_152", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_109" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_153", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_110" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_154", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_111" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_108", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_153" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_42", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_152" + }, + { + "tensor": "transpose_108" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_111", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_42" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_21", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_111" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_43", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_21" + }, + { + "tensor": "slice_154" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_109", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_43" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_21", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_109" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_66", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_21" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_48", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_66" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_85", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_48" + }, + { + "tensor": "p_visual_blocks_21_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_21_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_87", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_84" + }, + { + "tensor": "linear_85" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_43", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_87" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_21_norm2_weight" + }, + { + "tensor": "p_visual_blocks_21_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_86", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_43" + }, + { + "tensor": "p_visual_blocks_21_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_21_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_21", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_86" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_87", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_21" + }, + { + "tensor": "p_visual_blocks_21_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_21_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_88", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_87" + }, + { + "tensor": "linear_87" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_44", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_88" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_22_norm1_weight" + }, + { + "tensor": "p_visual_blocks_22_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_88", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_44" + }, + { + "tensor": "p_visual_blocks_22_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_22_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_49", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_88" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_22", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_49" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_66", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_22" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_67", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_22" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_68", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_22" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_112", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_113", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_112", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_66" + }, + { + "tensor": "unsqueeze_112" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_155", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_66" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_156", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_66" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_44", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_156" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_67", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_44" + }, + { + "tensor": "slice_155" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_113", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_67" + }, + { + "tensor": "unsqueeze_113" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_89", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_112" + }, + { + "tensor": "mul_113" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_114", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_67" + }, + { + "tensor": "unsqueeze_112" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_157", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_67" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_158", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_67" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_45", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_158" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_68", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_45" + }, + { + "tensor": "slice_157" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_115", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_68" + }, + { + "tensor": "unsqueeze_113" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_90", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_114" + }, + { + "tensor": "mul_115" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_110", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_89" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_114", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_110" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_111", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_90" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_115", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_111" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_112", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_68" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_116", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_112" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_159", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_114" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_160", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_115" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_161", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_116" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_113", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_160" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_44", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_159" + }, + { + "tensor": "transpose_113" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_116", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_44" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_22", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_116" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_45", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_22" + }, + { + "tensor": "slice_161" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_114", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_45" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_22", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_114" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_69", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_22" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_50", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_69" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_89", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_50" + }, + { + "tensor": "p_visual_blocks_22_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_22_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_91", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_88" + }, + { + "tensor": "linear_89" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_45", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_91" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_22_norm2_weight" + }, + { + "tensor": "p_visual_blocks_22_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_90", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_45" + }, + { + "tensor": "p_visual_blocks_22_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_22_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_22", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_90" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_91", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_22" + }, + { + "tensor": "p_visual_blocks_22_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_22_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_92", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_91" + }, + { + "tensor": "linear_91" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_46", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_92" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_23_norm1_weight" + }, + { + "tensor": "p_visual_blocks_23_norm1_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1000, in forward\n self.norm1(hidden_states)," + }, + { + "id": "linear_92", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_46" + }, + { + "tensor": "p_visual_blocks_23_attn_qkv_weight" + }, + { + "tensor": "p_visual_blocks_23_attn_qkv_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "view_51", + "op": "aten.view.default", + "args": [ + { + "tensor": "linear_92" + }, + [ + 988, + 3, + 16, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "permute_23", + "op": "aten.permute.default", + "args": [ + { + "tensor": "view_51" + }, + [ + 1, + 0, + 2, + 3 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_69", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_23" + }, + 0, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_70", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_23" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "select_71", + "op": "aten.select.int", + "args": [ + { + "tensor": "permute_23" + }, + 0, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 920, in forward\n self.qkv(hidden_states).reshape(seq_length, 3, self.num_heads, -1).permute(1, 0, 2, 3).unbind(0)" + }, + { + "id": "unsqueeze_117", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "cos" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_118", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "sin" + }, + -2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 888, in apply_rotary_pos_emb_vision\n cos, sin = cos.unsqueeze(-2).float(), sin.unsqueeze(-2).float()\n ^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_117", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_69" + }, + { + "tensor": "unsqueeze_117" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_162", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_69" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_163", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_69" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_46", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_163" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_70", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_46" + }, + { + "tensor": "slice_162" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_118", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_70" + }, + { + "tensor": "unsqueeze_118" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_93", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_117" + }, + { + "tensor": "mul_118" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 889, in apply_rotary_pos_emb_vision\n q_embed = (q * cos) + (rotate_half(q) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_119", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "select_70" + }, + { + "tensor": "unsqueeze_117" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_164", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_70" + }, + 2, + 0, + 32 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 551, in rotate_half\n x1 = x[..., : x.shape[-1] // 2]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_165", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "select_70" + }, + 2, + 32, + 9223372036854775807 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 552, in rotate_half\n x2 = x[..., x.shape[-1] // 2 :]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "neg_47", + "op": "aten.neg.default", + "args": [ + { + "tensor": "slice_165" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_71", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "neg_47" + }, + { + "tensor": "slice_164" + } + ], + -1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 553, in rotate_half\n return torch.cat((-x2, x1), dim=-1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_120", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "cat_71" + }, + { + "tensor": "unsqueeze_118" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_94", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "mul_119" + }, + { + "tensor": "mul_120" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 923, in forward\n query_states, key_states = apply_rotary_pos_emb_vision(query_states, key_states, cos, sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 890, in apply_rotary_pos_emb_vision\n k_embed = (k * cos) + (rotate_half(k) * sin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_115", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_93" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_119", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_115" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 925, in forward\n query_states = query_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_116", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "add_94" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_120", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_116" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 926, in forward\n key_states = key_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_117", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "select_71" + }, + 0, + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "unsqueeze_121", + "op": "aten.unsqueeze.default", + "args": [ + { + "tensor": "transpose_117" + }, + 0 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 927, in forward\n value_states = value_states.transpose(0, 1).unsqueeze(0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "slice_166", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_119" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_167", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_120" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "slice_168", + "op": "aten.slice.Tensor", + "args": [ + { + "tensor": "unsqueeze_121" + }, + 2, + 0, + 988 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 954, in forward\n splits = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 955, in \n torch.split(tensor, lengths.tolist(), dim=2) for tensor in (query_states, key_states, value_states)" + }, + { + "id": "transpose_118", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "slice_167" + }, + 2, + 3 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_46", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "slice_166" + }, + { + "tensor": "transpose_118" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "mul_121", + "op": "aten.mul.Tensor", + "args": [ + { + "tensor": "matmul_46" + }, + 0.125 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 620, in eager_attention_forward\n attn_weights = torch.matmul(query, key_states.transpose(2, 3)) * scaling\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "softmax_23", + "op": "aten.softmax.int", + "args": [ + { + "tensor": "mul_121" + }, + -1, + { + "dtype": "float32" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 624, in eager_attention_forward\n attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query.dtype)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "matmul_47", + "op": "aten.matmul.default", + "args": [ + { + "tensor": "softmax_23" + }, + { + "tensor": "slice_168" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 626, in eager_attention_forward\n attn_output = torch.matmul(attn_weights, value_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "transpose_119", + "op": "aten.transpose.int", + "args": [ + { + "tensor": "matmul_47" + }, + 1, + 2 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "clone_23", + "op": "aten.clone.default", + "args": [ + { + "tensor": "transpose_119" + } + ], + "kwargs": { + "memory_format": { + "memoryFormat": "contiguous_format" + } + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 958, in forward\n attn_outputs = [\n ^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 959, in \n attention_interface(\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 627, in eager_attention_forward\n attn_output = attn_output.transpose(1, 2).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "cat_72", + "op": "aten.cat.default", + "args": [ + [ + { + "tensor": "clone_23" + } + ], + 1 + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 972, in forward\n attn_output = torch.cat(attn_outputs, dim=1)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_52", + "op": "aten.view.default", + "args": [ + { + "tensor": "cat_72" + }, + [ + 988, + -1 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 974, in forward\n attn_output = attn_output.reshape(seq_length, -1).contiguous()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_93", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_52" + }, + { + "tensor": "p_visual_blocks_23_attn_proj_weight" + }, + { + "tensor": "p_visual_blocks_23_attn_proj_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 975, in forward\n attn_output = self.proj(attn_output)\n ^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_95", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_92" + }, + { + "tensor": "linear_93" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 999, in forward\n hidden_states = hidden_states + self.attn(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_47", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_95" + }, + [ + 1024 + ], + { + "tensor": "p_visual_blocks_23_norm2_weight" + }, + { + "tensor": "p_visual_blocks_23_norm2_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_94", + "op": "aten.linear.default", + "args": [ + { + "tensor": "layer_norm_47" + }, + { + "tensor": "p_visual_blocks_23_mlp_linear_fc1_weight" + }, + { + "tensor": "p_visual_blocks_23_mlp_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_23", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_94" + } + ], + "kwargs": { + "approximate": "tanh" + }, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/activations.py\", line 51, in forward\n return self.act(input)\n ^^^^^^^^^^^^^^^" + }, + { + "id": "linear_95", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_23" + }, + { + "tensor": "p_visual_blocks_23_mlp_linear_fc2_weight" + }, + { + "tensor": "p_visual_blocks_23_mlp_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 843, in forward\n return self.linear_fc2(self.act_fn(self.linear_fc1(hidden_state)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "add_96", + "op": "aten.add.Tensor", + "args": [ + { + "tensor": "add_95" + }, + { + "tensor": "linear_95" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1108, in forward\n hidden_states = blk(\n ^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/modeling_layers.py\", line 114, in __call__\n return super().__call__(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1005, in forward\n hidden_states = hidden_states + self.mlp(self.norm2(hidden_states))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "layer_norm_48", + "op": "aten.layer_norm.default", + "args": [ + { + "tensor": "add_96" + }, + [ + 1024 + ], + { + "tensor": "p_visual_merger_norm_weight" + }, + { + "tensor": "p_visual_merger_norm_bias" + }, + 1e-06, + false + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1116, in forward\n merged_hidden_states = self.merger(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 877, in forward\n x = self.norm(x.view(-1, self.hidden_size) if self.use_postshuffle_norm else x).view(-1, self.hidden_size)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "view_53", + "op": "aten.view.default", + "args": [ + { + "tensor": "layer_norm_48" + }, + [ + -1, + 4096 + ] + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1116, in forward\n merged_hidden_states = self.merger(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 877, in forward\n x = self.norm(x.view(-1, self.hidden_size) if self.use_postshuffle_norm else x).view(-1, self.hidden_size)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_96", + "op": "aten.linear.default", + "args": [ + { + "tensor": "view_53" + }, + { + "tensor": "p_visual_merger_linear_fc1_weight" + }, + { + "tensor": "p_visual_merger_linear_fc1_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1116, in forward\n merged_hidden_states = self.merger(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 878, in forward\n x = self.linear_fc2(self.act_fn(self.linear_fc1(x)))\n ^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "gelu_24", + "op": "aten.gelu.default", + "args": [ + { + "tensor": "linear_96" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1116, in forward\n merged_hidden_states = self.merger(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 878, in forward\n x = self.linear_fc2(self.act_fn(self.linear_fc1(x)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + }, + { + "id": "linear_97", + "op": "aten.linear.default", + "args": [ + { + "tensor": "gelu_24" + }, + { + "tensor": "p_visual_merger_linear_fc2_weight" + }, + { + "tensor": "p_visual_merger_linear_fc2_bias" + } + ], + "kwargs": {}, + "source": "File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/torch/_dynamo/functional_export.py\", line 243, in forward\n res = self._export_root(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/python/webtorch/adapters/qwen35.py\", line 217, in forward\n output = self.visual(pixels, self.grid, interp_indices=self.indices,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/generic.py\", line 1068, in wrapper\n output = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/utils/output_capturing.py\", line 262, in wrapper\n outputs = func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 1116, in forward\n merged_hidden_states = self.merger(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/Users/reserve/Workspace/webtorch/.venv/lib/python3.11/site-packages/transformers/models/qwen3_5/modeling_qwen3_5.py\", line 878, in forward\n x = self.linear_fc2(self.act_fn(self.linear_fc1(x)))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^" + } + ], + "quantization": [], + "states": [], + "dispatches": [ + { + "node": "view", + "inputs": [ + "pixels" + ], + "output": "view", + "workgroups": [ + 23712, + 1, + 1 + ], + "kernel": "kernels/fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3.wgsl" + }, + { + "node": "conv3d", + "inputs": [ + "p_visual_patch_embed_proj_bias", + "view", + "p_visual_patch_embed_proj_weight" + ], + "output": "conv3d", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892.wgsl" + }, + { + "node": "view_1", + "inputs": [ + "conv3d" + ], + "output": "view_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "embedding", + "inputs": [ + "b_indices", + "p_visual_pos_embed_weight" + ], + "output": "embedding", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2.wgsl" + }, + { + "node": "unsqueeze", + "inputs": [ + "b_interpolation_weights" + ], + "output": "unsqueeze", + "workgroups": [ + 62, + 1, + 1 + ], + "kernel": "kernels/88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591.wgsl" + }, + { + "node": "mul", + "inputs": [ + "embedding", + "unsqueeze" + ], + "output": "mul", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f.wgsl" + }, + { + "node": "sum_1", + "inputs": [ + "mul" + ], + "output": "sum_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af.wgsl" + }, + { + "node": "add", + "inputs": [ + "view_1", + "sum_1" + ], + "output": "add", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "unsqueeze_1", + "inputs": [ + "b_positions" + ], + "output": "unsqueeze_1", + "workgroups": [ + 31, + 1, + 1 + ], + "kernel": "kernels/237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9.wgsl" + }, + { + "node": "mul_1", + "inputs": [ + "unsqueeze_1", + "b_visual_rotary_pos_emb_inv_freq" + ], + "output": "mul_1", + "workgroups": [ + 494, + 1, + 1 + ], + "kernel": "kernels/ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a.wgsl" + }, + { + "node": "view_2", + "inputs": [ + "mul_1" + ], + "output": "view_2", + "workgroups": [ + 494, + 1, + 1 + ], + "kernel": "kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl" + }, + { + "node": "view_3", + "inputs": [ + "add" + ], + "output": "view_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "view_4", + "inputs": [ + "view_2" + ], + "output": "view_4", + "workgroups": [ + 494, + 1, + 1 + ], + "kernel": "kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl" + }, + { + "node": "cat", + "inputs": [ + "view_4" + ], + "output": "cat", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3.wgsl" + }, + { + "node": "cos", + "inputs": [ + "cat" + ], + "output": "cos", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6.wgsl" + }, + { + "node": "sin", + "inputs": [ + "cat" + ], + "output": "sin", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70.wgsl" + }, + { + "node": "layer_norm", + "inputs": [ + "view_3", + "p_visual_blocks_0_norm1_weight", + "p_visual_blocks_0_norm1_bias" + ], + "output": "layer_norm", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear", + "inputs": [ + "layer_norm", + "p_visual_blocks_0_attn_qkv_weight", + "p_visual_blocks_0_attn_qkv_bias" + ], + "output": "linear", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_5", + "inputs": [ + "linear" + ], + "output": "view_5", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute", + "inputs": [ + "view_5" + ], + "output": "permute", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select", + "inputs": [ + "permute" + ], + "output": "select", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_1", + "inputs": [ + "permute" + ], + "output": "select_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_2", + "inputs": [ + "permute" + ], + "output": "select_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_2", + "inputs": [ + "cos" + ], + "output": "unsqueeze_2", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_3", + "inputs": [ + "sin" + ], + "output": "unsqueeze_3", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_2", + "inputs": [ + "select", + "unsqueeze_2" + ], + "output": "mul_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_1", + "inputs": [ + "select" + ], + "output": "slice_1", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_2", + "inputs": [ + "select" + ], + "output": "slice_2", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg", + "inputs": [ + "slice_2" + ], + "output": "neg", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_1", + "inputs": [ + "neg", + "slice_1" + ], + "output": "cat_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_3", + "inputs": [ + "cat_1", + "unsqueeze_3" + ], + "output": "mul_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_1", + "inputs": [ + "mul_2", + "mul_3" + ], + "output": "add_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_4", + "inputs": [ + "select_1", + "unsqueeze_2" + ], + "output": "mul_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_3", + "inputs": [ + "select_1" + ], + "output": "slice_3", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_4", + "inputs": [ + "select_1" + ], + "output": "slice_4", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_1", + "inputs": [ + "slice_4" + ], + "output": "neg_1", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_2", + "inputs": [ + "neg_1", + "slice_3" + ], + "output": "cat_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_5", + "inputs": [ + "cat_2", + "unsqueeze_3" + ], + "output": "mul_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_2", + "inputs": [ + "mul_4", + "mul_5" + ], + "output": "add_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose", + "inputs": [ + "add_1" + ], + "output": "transpose", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_4", + "inputs": [ + "transpose" + ], + "output": "unsqueeze_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_1", + "inputs": [ + "add_2" + ], + "output": "transpose_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_5", + "inputs": [ + "transpose_1" + ], + "output": "unsqueeze_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_2", + "inputs": [ + "select_2" + ], + "output": "transpose_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_6", + "inputs": [ + "transpose_2" + ], + "output": "unsqueeze_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_5", + "inputs": [ + "unsqueeze_4" + ], + "output": "slice_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_6", + "inputs": [ + "unsqueeze_5" + ], + "output": "slice_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_7", + "inputs": [ + "unsqueeze_6" + ], + "output": "slice_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_3", + "inputs": [ + "slice_6" + ], + "output": "transpose_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul", + "inputs": [ + "slice_5", + "transpose_3" + ], + "output": "matmul", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_6", + "inputs": [ + "matmul" + ], + "output": "mul_6", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax", + "inputs": [ + "mul_6" + ], + "output": "softmax", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_1", + "inputs": [ + "softmax", + "slice_7" + ], + "output": "matmul_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_4", + "inputs": [ + "matmul_1" + ], + "output": "transpose_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone", + "inputs": [ + "transpose_4" + ], + "output": "clone", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_3", + "inputs": [ + "clone" + ], + "output": "cat_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_6", + "inputs": [ + "cat_3" + ], + "output": "view_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_1", + "inputs": [ + "view_6", + "p_visual_blocks_0_attn_proj_weight", + "p_visual_blocks_0_attn_proj_bias" + ], + "output": "linear_1", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_3", + "inputs": [ + "view_3", + "linear_1" + ], + "output": "add_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_1", + "inputs": [ + "add_3", + "p_visual_blocks_0_norm2_weight", + "p_visual_blocks_0_norm2_bias" + ], + "output": "layer_norm_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_2", + "inputs": [ + "layer_norm_1", + "p_visual_blocks_0_mlp_linear_fc1_weight", + "p_visual_blocks_0_mlp_linear_fc1_bias" + ], + "output": "linear_2", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu", + "inputs": [ + "linear_2" + ], + "output": "gelu", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_3", + "inputs": [ + "gelu", + "p_visual_blocks_0_mlp_linear_fc2_weight", + "p_visual_blocks_0_mlp_linear_fc2_bias" + ], + "output": "linear_3", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_4", + "inputs": [ + "add_3", + "linear_3" + ], + "output": "add_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_2", + "inputs": [ + "add_4", + "p_visual_blocks_1_norm1_weight", + "p_visual_blocks_1_norm1_bias" + ], + "output": "layer_norm_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_4", + "inputs": [ + "layer_norm_2", + "p_visual_blocks_1_attn_qkv_weight", + "p_visual_blocks_1_attn_qkv_bias" + ], + "output": "linear_4", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_7", + "inputs": [ + "linear_4" + ], + "output": "view_7", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_1", + "inputs": [ + "view_7" + ], + "output": "permute_1", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_3", + "inputs": [ + "permute_1" + ], + "output": "select_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_4", + "inputs": [ + "permute_1" + ], + "output": "select_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_5", + "inputs": [ + "permute_1" + ], + "output": "select_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_7", + "inputs": [ + "cos" + ], + "output": "unsqueeze_7", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_8", + "inputs": [ + "sin" + ], + "output": "unsqueeze_8", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_7", + "inputs": [ + "select_3", + "unsqueeze_7" + ], + "output": "mul_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_8", + "inputs": [ + "select_3" + ], + "output": "slice_8", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_9", + "inputs": [ + "select_3" + ], + "output": "slice_9", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_2", + "inputs": [ + "slice_9" + ], + "output": "neg_2", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_4", + "inputs": [ + "neg_2", + "slice_8" + ], + "output": "cat_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_8", + "inputs": [ + "cat_4", + "unsqueeze_8" + ], + "output": "mul_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_5", + "inputs": [ + "mul_7", + "mul_8" + ], + "output": "add_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_9", + "inputs": [ + "select_4", + "unsqueeze_7" + ], + "output": "mul_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_10", + "inputs": [ + "select_4" + ], + "output": "slice_10", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_11", + "inputs": [ + "select_4" + ], + "output": "slice_11", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_3", + "inputs": [ + "slice_11" + ], + "output": "neg_3", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_5", + "inputs": [ + "neg_3", + "slice_10" + ], + "output": "cat_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_10", + "inputs": [ + "cat_5", + "unsqueeze_8" + ], + "output": "mul_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_6", + "inputs": [ + "mul_9", + "mul_10" + ], + "output": "add_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_5", + "inputs": [ + "add_5" + ], + "output": "transpose_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_9", + "inputs": [ + "transpose_5" + ], + "output": "unsqueeze_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_6", + "inputs": [ + "add_6" + ], + "output": "transpose_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_10", + "inputs": [ + "transpose_6" + ], + "output": "unsqueeze_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_7", + "inputs": [ + "select_5" + ], + "output": "transpose_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_11", + "inputs": [ + "transpose_7" + ], + "output": "unsqueeze_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_12", + "inputs": [ + "unsqueeze_9" + ], + "output": "slice_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_13", + "inputs": [ + "unsqueeze_10" + ], + "output": "slice_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_14", + "inputs": [ + "unsqueeze_11" + ], + "output": "slice_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_8", + "inputs": [ + "slice_13" + ], + "output": "transpose_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_2", + "inputs": [ + "slice_12", + "transpose_8" + ], + "output": "matmul_2", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_11", + "inputs": [ + "matmul_2" + ], + "output": "mul_11", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_1", + "inputs": [ + "mul_11" + ], + "output": "softmax_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_3", + "inputs": [ + "softmax_1", + "slice_14" + ], + "output": "matmul_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_9", + "inputs": [ + "matmul_3" + ], + "output": "transpose_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_1", + "inputs": [ + "transpose_9" + ], + "output": "clone_1", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_6", + "inputs": [ + "clone_1" + ], + "output": "cat_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_8", + "inputs": [ + "cat_6" + ], + "output": "view_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_5", + "inputs": [ + "view_8", + "p_visual_blocks_1_attn_proj_weight", + "p_visual_blocks_1_attn_proj_bias" + ], + "output": "linear_5", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_7", + "inputs": [ + "add_4", + "linear_5" + ], + "output": "add_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_3", + "inputs": [ + "add_7", + "p_visual_blocks_1_norm2_weight", + "p_visual_blocks_1_norm2_bias" + ], + "output": "layer_norm_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_6", + "inputs": [ + "layer_norm_3", + "p_visual_blocks_1_mlp_linear_fc1_weight", + "p_visual_blocks_1_mlp_linear_fc1_bias" + ], + "output": "linear_6", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_1", + "inputs": [ + "linear_6" + ], + "output": "gelu_1", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_7", + "inputs": [ + "gelu_1", + "p_visual_blocks_1_mlp_linear_fc2_weight", + "p_visual_blocks_1_mlp_linear_fc2_bias" + ], + "output": "linear_7", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_8", + "inputs": [ + "add_7", + "linear_7" + ], + "output": "add_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_4", + "inputs": [ + "add_8", + "p_visual_blocks_2_norm1_weight", + "p_visual_blocks_2_norm1_bias" + ], + "output": "layer_norm_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_8", + "inputs": [ + "layer_norm_4", + "p_visual_blocks_2_attn_qkv_weight", + "p_visual_blocks_2_attn_qkv_bias" + ], + "output": "linear_8", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_9", + "inputs": [ + "linear_8" + ], + "output": "view_9", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_2", + "inputs": [ + "view_9" + ], + "output": "permute_2", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_6", + "inputs": [ + "permute_2" + ], + "output": "select_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_7", + "inputs": [ + "permute_2" + ], + "output": "select_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_8", + "inputs": [ + "permute_2" + ], + "output": "select_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_12", + "inputs": [ + "cos" + ], + "output": "unsqueeze_12", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_13", + "inputs": [ + "sin" + ], + "output": "unsqueeze_13", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_12", + "inputs": [ + "select_6", + "unsqueeze_12" + ], + "output": "mul_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_15", + "inputs": [ + "select_6" + ], + "output": "slice_15", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_16", + "inputs": [ + "select_6" + ], + "output": "slice_16", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_4", + "inputs": [ + "slice_16" + ], + "output": "neg_4", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_7", + "inputs": [ + "neg_4", + "slice_15" + ], + "output": "cat_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_13", + "inputs": [ + "cat_7", + "unsqueeze_13" + ], + "output": "mul_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_9", + "inputs": [ + "mul_12", + "mul_13" + ], + "output": "add_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_14", + "inputs": [ + "select_7", + "unsqueeze_12" + ], + "output": "mul_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_17", + "inputs": [ + "select_7" + ], + "output": "slice_17", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_18", + "inputs": [ + "select_7" + ], + "output": "slice_18", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_5", + "inputs": [ + "slice_18" + ], + "output": "neg_5", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_8", + "inputs": [ + "neg_5", + "slice_17" + ], + "output": "cat_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_15", + "inputs": [ + "cat_8", + "unsqueeze_13" + ], + "output": "mul_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_10", + "inputs": [ + "mul_14", + "mul_15" + ], + "output": "add_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_10", + "inputs": [ + "add_9" + ], + "output": "transpose_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_14", + "inputs": [ + "transpose_10" + ], + "output": "unsqueeze_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_11", + "inputs": [ + "add_10" + ], + "output": "transpose_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_15", + "inputs": [ + "transpose_11" + ], + "output": "unsqueeze_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_12", + "inputs": [ + "select_8" + ], + "output": "transpose_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_16", + "inputs": [ + "transpose_12" + ], + "output": "unsqueeze_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_19", + "inputs": [ + "unsqueeze_14" + ], + "output": "slice_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_20", + "inputs": [ + "unsqueeze_15" + ], + "output": "slice_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_21", + "inputs": [ + "unsqueeze_16" + ], + "output": "slice_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_13", + "inputs": [ + "slice_20" + ], + "output": "transpose_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_4", + "inputs": [ + "slice_19", + "transpose_13" + ], + "output": "matmul_4", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_16", + "inputs": [ + "matmul_4" + ], + "output": "mul_16", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_2", + "inputs": [ + "mul_16" + ], + "output": "softmax_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_5", + "inputs": [ + "softmax_2", + "slice_21" + ], + "output": "matmul_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_14", + "inputs": [ + "matmul_5" + ], + "output": "transpose_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_2", + "inputs": [ + "transpose_14" + ], + "output": "clone_2", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_9", + "inputs": [ + "clone_2" + ], + "output": "cat_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_10", + "inputs": [ + "cat_9" + ], + "output": "view_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_9", + "inputs": [ + "view_10", + "p_visual_blocks_2_attn_proj_weight", + "p_visual_blocks_2_attn_proj_bias" + ], + "output": "linear_9", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_11", + "inputs": [ + "add_8", + "linear_9" + ], + "output": "add_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_5", + "inputs": [ + "add_11", + "p_visual_blocks_2_norm2_weight", + "p_visual_blocks_2_norm2_bias" + ], + "output": "layer_norm_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_10", + "inputs": [ + "layer_norm_5", + "p_visual_blocks_2_mlp_linear_fc1_weight", + "p_visual_blocks_2_mlp_linear_fc1_bias" + ], + "output": "linear_10", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_2", + "inputs": [ + "linear_10" + ], + "output": "gelu_2", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_11", + "inputs": [ + "gelu_2", + "p_visual_blocks_2_mlp_linear_fc2_weight", + "p_visual_blocks_2_mlp_linear_fc2_bias" + ], + "output": "linear_11", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_12", + "inputs": [ + "add_11", + "linear_11" + ], + "output": "add_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_6", + "inputs": [ + "add_12", + "p_visual_blocks_3_norm1_weight", + "p_visual_blocks_3_norm1_bias" + ], + "output": "layer_norm_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_12", + "inputs": [ + "layer_norm_6", + "p_visual_blocks_3_attn_qkv_weight", + "p_visual_blocks_3_attn_qkv_bias" + ], + "output": "linear_12", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_11", + "inputs": [ + "linear_12" + ], + "output": "view_11", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_3", + "inputs": [ + "view_11" + ], + "output": "permute_3", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_9", + "inputs": [ + "permute_3" + ], + "output": "select_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_10", + "inputs": [ + "permute_3" + ], + "output": "select_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_11", + "inputs": [ + "permute_3" + ], + "output": "select_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_17", + "inputs": [ + "cos" + ], + "output": "unsqueeze_17", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_18", + "inputs": [ + "sin" + ], + "output": "unsqueeze_18", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_17", + "inputs": [ + "select_9", + "unsqueeze_17" + ], + "output": "mul_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_22", + "inputs": [ + "select_9" + ], + "output": "slice_22", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_23", + "inputs": [ + "select_9" + ], + "output": "slice_23", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_6", + "inputs": [ + "slice_23" + ], + "output": "neg_6", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_10", + "inputs": [ + "neg_6", + "slice_22" + ], + "output": "cat_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_18", + "inputs": [ + "cat_10", + "unsqueeze_18" + ], + "output": "mul_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_13", + "inputs": [ + "mul_17", + "mul_18" + ], + "output": "add_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_19", + "inputs": [ + "select_10", + "unsqueeze_17" + ], + "output": "mul_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_24", + "inputs": [ + "select_10" + ], + "output": "slice_24", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_25", + "inputs": [ + "select_10" + ], + "output": "slice_25", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_7", + "inputs": [ + "slice_25" + ], + "output": "neg_7", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_11", + "inputs": [ + "neg_7", + "slice_24" + ], + "output": "cat_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_20", + "inputs": [ + "cat_11", + "unsqueeze_18" + ], + "output": "mul_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_14", + "inputs": [ + "mul_19", + "mul_20" + ], + "output": "add_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_15", + "inputs": [ + "add_13" + ], + "output": "transpose_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_19", + "inputs": [ + "transpose_15" + ], + "output": "unsqueeze_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_16", + "inputs": [ + "add_14" + ], + "output": "transpose_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_20", + "inputs": [ + "transpose_16" + ], + "output": "unsqueeze_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_17", + "inputs": [ + "select_11" + ], + "output": "transpose_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_21", + "inputs": [ + "transpose_17" + ], + "output": "unsqueeze_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_26", + "inputs": [ + "unsqueeze_19" + ], + "output": "slice_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_27", + "inputs": [ + "unsqueeze_20" + ], + "output": "slice_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_28", + "inputs": [ + "unsqueeze_21" + ], + "output": "slice_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_18", + "inputs": [ + "slice_27" + ], + "output": "transpose_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_6", + "inputs": [ + "slice_26", + "transpose_18" + ], + "output": "matmul_6", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_21", + "inputs": [ + "matmul_6" + ], + "output": "mul_21", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_3", + "inputs": [ + "mul_21" + ], + "output": "softmax_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_7", + "inputs": [ + "softmax_3", + "slice_28" + ], + "output": "matmul_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_19", + "inputs": [ + "matmul_7" + ], + "output": "transpose_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_3", + "inputs": [ + "transpose_19" + ], + "output": "clone_3", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_12", + "inputs": [ + "clone_3" + ], + "output": "cat_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_12", + "inputs": [ + "cat_12" + ], + "output": "view_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_13", + "inputs": [ + "view_12", + "p_visual_blocks_3_attn_proj_weight", + "p_visual_blocks_3_attn_proj_bias" + ], + "output": "linear_13", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_15", + "inputs": [ + "add_12", + "linear_13" + ], + "output": "add_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_7", + "inputs": [ + "add_15", + "p_visual_blocks_3_norm2_weight", + "p_visual_blocks_3_norm2_bias" + ], + "output": "layer_norm_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_14", + "inputs": [ + "layer_norm_7", + "p_visual_blocks_3_mlp_linear_fc1_weight", + "p_visual_blocks_3_mlp_linear_fc1_bias" + ], + "output": "linear_14", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_3", + "inputs": [ + "linear_14" + ], + "output": "gelu_3", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_15", + "inputs": [ + "gelu_3", + "p_visual_blocks_3_mlp_linear_fc2_weight", + "p_visual_blocks_3_mlp_linear_fc2_bias" + ], + "output": "linear_15", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_16", + "inputs": [ + "add_15", + "linear_15" + ], + "output": "add_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_8", + "inputs": [ + "add_16", + "p_visual_blocks_4_norm1_weight", + "p_visual_blocks_4_norm1_bias" + ], + "output": "layer_norm_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_16", + "inputs": [ + "layer_norm_8", + "p_visual_blocks_4_attn_qkv_weight", + "p_visual_blocks_4_attn_qkv_bias" + ], + "output": "linear_16", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_13", + "inputs": [ + "linear_16" + ], + "output": "view_13", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_4", + "inputs": [ + "view_13" + ], + "output": "permute_4", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_12", + "inputs": [ + "permute_4" + ], + "output": "select_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_13", + "inputs": [ + "permute_4" + ], + "output": "select_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_14", + "inputs": [ + "permute_4" + ], + "output": "select_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_22", + "inputs": [ + "cos" + ], + "output": "unsqueeze_22", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_23", + "inputs": [ + "sin" + ], + "output": "unsqueeze_23", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_22", + "inputs": [ + "select_12", + "unsqueeze_22" + ], + "output": "mul_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_29", + "inputs": [ + "select_12" + ], + "output": "slice_29", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_30", + "inputs": [ + "select_12" + ], + "output": "slice_30", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_8", + "inputs": [ + "slice_30" + ], + "output": "neg_8", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_13", + "inputs": [ + "neg_8", + "slice_29" + ], + "output": "cat_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_23", + "inputs": [ + "cat_13", + "unsqueeze_23" + ], + "output": "mul_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_17", + "inputs": [ + "mul_22", + "mul_23" + ], + "output": "add_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_24", + "inputs": [ + "select_13", + "unsqueeze_22" + ], + "output": "mul_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_31", + "inputs": [ + "select_13" + ], + "output": "slice_31", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_32", + "inputs": [ + "select_13" + ], + "output": "slice_32", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_9", + "inputs": [ + "slice_32" + ], + "output": "neg_9", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_14", + "inputs": [ + "neg_9", + "slice_31" + ], + "output": "cat_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_25", + "inputs": [ + "cat_14", + "unsqueeze_23" + ], + "output": "mul_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_18", + "inputs": [ + "mul_24", + "mul_25" + ], + "output": "add_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_20", + "inputs": [ + "add_17" + ], + "output": "transpose_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_24", + "inputs": [ + "transpose_20" + ], + "output": "unsqueeze_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_21", + "inputs": [ + "add_18" + ], + "output": "transpose_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_25", + "inputs": [ + "transpose_21" + ], + "output": "unsqueeze_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_22", + "inputs": [ + "select_14" + ], + "output": "transpose_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_26", + "inputs": [ + "transpose_22" + ], + "output": "unsqueeze_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_33", + "inputs": [ + "unsqueeze_24" + ], + "output": "slice_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_34", + "inputs": [ + "unsqueeze_25" + ], + "output": "slice_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_35", + "inputs": [ + "unsqueeze_26" + ], + "output": "slice_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_23", + "inputs": [ + "slice_34" + ], + "output": "transpose_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_8", + "inputs": [ + "slice_33", + "transpose_23" + ], + "output": "matmul_8", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_26", + "inputs": [ + "matmul_8" + ], + "output": "mul_26", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_4", + "inputs": [ + "mul_26" + ], + "output": "softmax_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_9", + "inputs": [ + "softmax_4", + "slice_35" + ], + "output": "matmul_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_24", + "inputs": [ + "matmul_9" + ], + "output": "transpose_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_4", + "inputs": [ + "transpose_24" + ], + "output": "clone_4", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_15", + "inputs": [ + "clone_4" + ], + "output": "cat_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_14", + "inputs": [ + "cat_15" + ], + "output": "view_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_17", + "inputs": [ + "view_14", + "p_visual_blocks_4_attn_proj_weight", + "p_visual_blocks_4_attn_proj_bias" + ], + "output": "linear_17", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_19", + "inputs": [ + "add_16", + "linear_17" + ], + "output": "add_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_9", + "inputs": [ + "add_19", + "p_visual_blocks_4_norm2_weight", + "p_visual_blocks_4_norm2_bias" + ], + "output": "layer_norm_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_18", + "inputs": [ + "layer_norm_9", + "p_visual_blocks_4_mlp_linear_fc1_weight", + "p_visual_blocks_4_mlp_linear_fc1_bias" + ], + "output": "linear_18", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_4", + "inputs": [ + "linear_18" + ], + "output": "gelu_4", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_19", + "inputs": [ + "gelu_4", + "p_visual_blocks_4_mlp_linear_fc2_weight", + "p_visual_blocks_4_mlp_linear_fc2_bias" + ], + "output": "linear_19", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_20", + "inputs": [ + "add_19", + "linear_19" + ], + "output": "add_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_10", + "inputs": [ + "add_20", + "p_visual_blocks_5_norm1_weight", + "p_visual_blocks_5_norm1_bias" + ], + "output": "layer_norm_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_20", + "inputs": [ + "layer_norm_10", + "p_visual_blocks_5_attn_qkv_weight", + "p_visual_blocks_5_attn_qkv_bias" + ], + "output": "linear_20", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_15", + "inputs": [ + "linear_20" + ], + "output": "view_15", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_5", + "inputs": [ + "view_15" + ], + "output": "permute_5", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_15", + "inputs": [ + "permute_5" + ], + "output": "select_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_16", + "inputs": [ + "permute_5" + ], + "output": "select_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_17", + "inputs": [ + "permute_5" + ], + "output": "select_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_27", + "inputs": [ + "cos" + ], + "output": "unsqueeze_27", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_28", + "inputs": [ + "sin" + ], + "output": "unsqueeze_28", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_27", + "inputs": [ + "select_15", + "unsqueeze_27" + ], + "output": "mul_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_36", + "inputs": [ + "select_15" + ], + "output": "slice_36", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_37", + "inputs": [ + "select_15" + ], + "output": "slice_37", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_10", + "inputs": [ + "slice_37" + ], + "output": "neg_10", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_16", + "inputs": [ + "neg_10", + "slice_36" + ], + "output": "cat_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_28", + "inputs": [ + "cat_16", + "unsqueeze_28" + ], + "output": "mul_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_21", + "inputs": [ + "mul_27", + "mul_28" + ], + "output": "add_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_29", + "inputs": [ + "select_16", + "unsqueeze_27" + ], + "output": "mul_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_38", + "inputs": [ + "select_16" + ], + "output": "slice_38", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_39", + "inputs": [ + "select_16" + ], + "output": "slice_39", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_11", + "inputs": [ + "slice_39" + ], + "output": "neg_11", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_17", + "inputs": [ + "neg_11", + "slice_38" + ], + "output": "cat_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_30", + "inputs": [ + "cat_17", + "unsqueeze_28" + ], + "output": "mul_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_22", + "inputs": [ + "mul_29", + "mul_30" + ], + "output": "add_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_25", + "inputs": [ + "add_21" + ], + "output": "transpose_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_29", + "inputs": [ + "transpose_25" + ], + "output": "unsqueeze_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_26", + "inputs": [ + "add_22" + ], + "output": "transpose_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_30", + "inputs": [ + "transpose_26" + ], + "output": "unsqueeze_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_27", + "inputs": [ + "select_17" + ], + "output": "transpose_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_31", + "inputs": [ + "transpose_27" + ], + "output": "unsqueeze_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_40", + "inputs": [ + "unsqueeze_29" + ], + "output": "slice_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_41", + "inputs": [ + "unsqueeze_30" + ], + "output": "slice_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_42", + "inputs": [ + "unsqueeze_31" + ], + "output": "slice_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_28", + "inputs": [ + "slice_41" + ], + "output": "transpose_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_10", + "inputs": [ + "slice_40", + "transpose_28" + ], + "output": "matmul_10", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_31", + "inputs": [ + "matmul_10" + ], + "output": "mul_31", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_5", + "inputs": [ + "mul_31" + ], + "output": "softmax_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_11", + "inputs": [ + "softmax_5", + "slice_42" + ], + "output": "matmul_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_29", + "inputs": [ + "matmul_11" + ], + "output": "transpose_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_5", + "inputs": [ + "transpose_29" + ], + "output": "clone_5", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_18", + "inputs": [ + "clone_5" + ], + "output": "cat_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_16", + "inputs": [ + "cat_18" + ], + "output": "view_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_21", + "inputs": [ + "view_16", + "p_visual_blocks_5_attn_proj_weight", + "p_visual_blocks_5_attn_proj_bias" + ], + "output": "linear_21", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_23", + "inputs": [ + "add_20", + "linear_21" + ], + "output": "add_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_11", + "inputs": [ + "add_23", + "p_visual_blocks_5_norm2_weight", + "p_visual_blocks_5_norm2_bias" + ], + "output": "layer_norm_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_22", + "inputs": [ + "layer_norm_11", + "p_visual_blocks_5_mlp_linear_fc1_weight", + "p_visual_blocks_5_mlp_linear_fc1_bias" + ], + "output": "linear_22", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_5", + "inputs": [ + "linear_22" + ], + "output": "gelu_5", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_23", + "inputs": [ + "gelu_5", + "p_visual_blocks_5_mlp_linear_fc2_weight", + "p_visual_blocks_5_mlp_linear_fc2_bias" + ], + "output": "linear_23", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_24", + "inputs": [ + "add_23", + "linear_23" + ], + "output": "add_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_12", + "inputs": [ + "add_24", + "p_visual_blocks_6_norm1_weight", + "p_visual_blocks_6_norm1_bias" + ], + "output": "layer_norm_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_24", + "inputs": [ + "layer_norm_12", + "p_visual_blocks_6_attn_qkv_weight", + "p_visual_blocks_6_attn_qkv_bias" + ], + "output": "linear_24", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_17", + "inputs": [ + "linear_24" + ], + "output": "view_17", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_6", + "inputs": [ + "view_17" + ], + "output": "permute_6", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_18", + "inputs": [ + "permute_6" + ], + "output": "select_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_19", + "inputs": [ + "permute_6" + ], + "output": "select_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_20", + "inputs": [ + "permute_6" + ], + "output": "select_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_32", + "inputs": [ + "cos" + ], + "output": "unsqueeze_32", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_33", + "inputs": [ + "sin" + ], + "output": "unsqueeze_33", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_32", + "inputs": [ + "select_18", + "unsqueeze_32" + ], + "output": "mul_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_43", + "inputs": [ + "select_18" + ], + "output": "slice_43", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_44", + "inputs": [ + "select_18" + ], + "output": "slice_44", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_12", + "inputs": [ + "slice_44" + ], + "output": "neg_12", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_19", + "inputs": [ + "neg_12", + "slice_43" + ], + "output": "cat_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_33", + "inputs": [ + "cat_19", + "unsqueeze_33" + ], + "output": "mul_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_25", + "inputs": [ + "mul_32", + "mul_33" + ], + "output": "add_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_34", + "inputs": [ + "select_19", + "unsqueeze_32" + ], + "output": "mul_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_45", + "inputs": [ + "select_19" + ], + "output": "slice_45", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_46", + "inputs": [ + "select_19" + ], + "output": "slice_46", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_13", + "inputs": [ + "slice_46" + ], + "output": "neg_13", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_20", + "inputs": [ + "neg_13", + "slice_45" + ], + "output": "cat_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_35", + "inputs": [ + "cat_20", + "unsqueeze_33" + ], + "output": "mul_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_26", + "inputs": [ + "mul_34", + "mul_35" + ], + "output": "add_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_30", + "inputs": [ + "add_25" + ], + "output": "transpose_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_34", + "inputs": [ + "transpose_30" + ], + "output": "unsqueeze_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_31", + "inputs": [ + "add_26" + ], + "output": "transpose_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_35", + "inputs": [ + "transpose_31" + ], + "output": "unsqueeze_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_32", + "inputs": [ + "select_20" + ], + "output": "transpose_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_36", + "inputs": [ + "transpose_32" + ], + "output": "unsqueeze_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_47", + "inputs": [ + "unsqueeze_34" + ], + "output": "slice_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_48", + "inputs": [ + "unsqueeze_35" + ], + "output": "slice_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_49", + "inputs": [ + "unsqueeze_36" + ], + "output": "slice_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_33", + "inputs": [ + "slice_48" + ], + "output": "transpose_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_12", + "inputs": [ + "slice_47", + "transpose_33" + ], + "output": "matmul_12", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_36", + "inputs": [ + "matmul_12" + ], + "output": "mul_36", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_6", + "inputs": [ + "mul_36" + ], + "output": "softmax_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_13", + "inputs": [ + "softmax_6", + "slice_49" + ], + "output": "matmul_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_34", + "inputs": [ + "matmul_13" + ], + "output": "transpose_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_6", + "inputs": [ + "transpose_34" + ], + "output": "clone_6", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_21", + "inputs": [ + "clone_6" + ], + "output": "cat_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_18", + "inputs": [ + "cat_21" + ], + "output": "view_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_25", + "inputs": [ + "view_18", + "p_visual_blocks_6_attn_proj_weight", + "p_visual_blocks_6_attn_proj_bias" + ], + "output": "linear_25", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_27", + "inputs": [ + "add_24", + "linear_25" + ], + "output": "add_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_13", + "inputs": [ + "add_27", + "p_visual_blocks_6_norm2_weight", + "p_visual_blocks_6_norm2_bias" + ], + "output": "layer_norm_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_26", + "inputs": [ + "layer_norm_13", + "p_visual_blocks_6_mlp_linear_fc1_weight", + "p_visual_blocks_6_mlp_linear_fc1_bias" + ], + "output": "linear_26", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_6", + "inputs": [ + "linear_26" + ], + "output": "gelu_6", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_27", + "inputs": [ + "gelu_6", + "p_visual_blocks_6_mlp_linear_fc2_weight", + "p_visual_blocks_6_mlp_linear_fc2_bias" + ], + "output": "linear_27", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_28", + "inputs": [ + "add_27", + "linear_27" + ], + "output": "add_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_14", + "inputs": [ + "add_28", + "p_visual_blocks_7_norm1_weight", + "p_visual_blocks_7_norm1_bias" + ], + "output": "layer_norm_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_28", + "inputs": [ + "layer_norm_14", + "p_visual_blocks_7_attn_qkv_weight", + "p_visual_blocks_7_attn_qkv_bias" + ], + "output": "linear_28", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_19", + "inputs": [ + "linear_28" + ], + "output": "view_19", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_7", + "inputs": [ + "view_19" + ], + "output": "permute_7", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_21", + "inputs": [ + "permute_7" + ], + "output": "select_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_22", + "inputs": [ + "permute_7" + ], + "output": "select_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_23", + "inputs": [ + "permute_7" + ], + "output": "select_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_37", + "inputs": [ + "cos" + ], + "output": "unsqueeze_37", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_38", + "inputs": [ + "sin" + ], + "output": "unsqueeze_38", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_37", + "inputs": [ + "select_21", + "unsqueeze_37" + ], + "output": "mul_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_50", + "inputs": [ + "select_21" + ], + "output": "slice_50", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_51", + "inputs": [ + "select_21" + ], + "output": "slice_51", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_14", + "inputs": [ + "slice_51" + ], + "output": "neg_14", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_22", + "inputs": [ + "neg_14", + "slice_50" + ], + "output": "cat_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_38", + "inputs": [ + "cat_22", + "unsqueeze_38" + ], + "output": "mul_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_29", + "inputs": [ + "mul_37", + "mul_38" + ], + "output": "add_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_39", + "inputs": [ + "select_22", + "unsqueeze_37" + ], + "output": "mul_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_52", + "inputs": [ + "select_22" + ], + "output": "slice_52", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_53", + "inputs": [ + "select_22" + ], + "output": "slice_53", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_15", + "inputs": [ + "slice_53" + ], + "output": "neg_15", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_23", + "inputs": [ + "neg_15", + "slice_52" + ], + "output": "cat_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_40", + "inputs": [ + "cat_23", + "unsqueeze_38" + ], + "output": "mul_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_30", + "inputs": [ + "mul_39", + "mul_40" + ], + "output": "add_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_35", + "inputs": [ + "add_29" + ], + "output": "transpose_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_39", + "inputs": [ + "transpose_35" + ], + "output": "unsqueeze_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_36", + "inputs": [ + "add_30" + ], + "output": "transpose_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_40", + "inputs": [ + "transpose_36" + ], + "output": "unsqueeze_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_37", + "inputs": [ + "select_23" + ], + "output": "transpose_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_41", + "inputs": [ + "transpose_37" + ], + "output": "unsqueeze_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_54", + "inputs": [ + "unsqueeze_39" + ], + "output": "slice_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_55", + "inputs": [ + "unsqueeze_40" + ], + "output": "slice_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_56", + "inputs": [ + "unsqueeze_41" + ], + "output": "slice_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_38", + "inputs": [ + "slice_55" + ], + "output": "transpose_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_14", + "inputs": [ + "slice_54", + "transpose_38" + ], + "output": "matmul_14", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_41", + "inputs": [ + "matmul_14" + ], + "output": "mul_41", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_7", + "inputs": [ + "mul_41" + ], + "output": "softmax_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_15", + "inputs": [ + "softmax_7", + "slice_56" + ], + "output": "matmul_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_39", + "inputs": [ + "matmul_15" + ], + "output": "transpose_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_7", + "inputs": [ + "transpose_39" + ], + "output": "clone_7", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_24", + "inputs": [ + "clone_7" + ], + "output": "cat_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_20", + "inputs": [ + "cat_24" + ], + "output": "view_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_29", + "inputs": [ + "view_20", + "p_visual_blocks_7_attn_proj_weight", + "p_visual_blocks_7_attn_proj_bias" + ], + "output": "linear_29", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_31", + "inputs": [ + "add_28", + "linear_29" + ], + "output": "add_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_15", + "inputs": [ + "add_31", + "p_visual_blocks_7_norm2_weight", + "p_visual_blocks_7_norm2_bias" + ], + "output": "layer_norm_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_30", + "inputs": [ + "layer_norm_15", + "p_visual_blocks_7_mlp_linear_fc1_weight", + "p_visual_blocks_7_mlp_linear_fc1_bias" + ], + "output": "linear_30", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_7", + "inputs": [ + "linear_30" + ], + "output": "gelu_7", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_31", + "inputs": [ + "gelu_7", + "p_visual_blocks_7_mlp_linear_fc2_weight", + "p_visual_blocks_7_mlp_linear_fc2_bias" + ], + "output": "linear_31", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_32", + "inputs": [ + "add_31", + "linear_31" + ], + "output": "add_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_16", + "inputs": [ + "add_32", + "p_visual_blocks_8_norm1_weight", + "p_visual_blocks_8_norm1_bias" + ], + "output": "layer_norm_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_32", + "inputs": [ + "layer_norm_16", + "p_visual_blocks_8_attn_qkv_weight", + "p_visual_blocks_8_attn_qkv_bias" + ], + "output": "linear_32", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_21", + "inputs": [ + "linear_32" + ], + "output": "view_21", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_8", + "inputs": [ + "view_21" + ], + "output": "permute_8", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_24", + "inputs": [ + "permute_8" + ], + "output": "select_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_25", + "inputs": [ + "permute_8" + ], + "output": "select_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_26", + "inputs": [ + "permute_8" + ], + "output": "select_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_42", + "inputs": [ + "cos" + ], + "output": "unsqueeze_42", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_43", + "inputs": [ + "sin" + ], + "output": "unsqueeze_43", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_42", + "inputs": [ + "select_24", + "unsqueeze_42" + ], + "output": "mul_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_57", + "inputs": [ + "select_24" + ], + "output": "slice_57", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_58", + "inputs": [ + "select_24" + ], + "output": "slice_58", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_16", + "inputs": [ + "slice_58" + ], + "output": "neg_16", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_25", + "inputs": [ + "neg_16", + "slice_57" + ], + "output": "cat_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_43", + "inputs": [ + "cat_25", + "unsqueeze_43" + ], + "output": "mul_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_33", + "inputs": [ + "mul_42", + "mul_43" + ], + "output": "add_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_44", + "inputs": [ + "select_25", + "unsqueeze_42" + ], + "output": "mul_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_59", + "inputs": [ + "select_25" + ], + "output": "slice_59", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_60", + "inputs": [ + "select_25" + ], + "output": "slice_60", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_17", + "inputs": [ + "slice_60" + ], + "output": "neg_17", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_26", + "inputs": [ + "neg_17", + "slice_59" + ], + "output": "cat_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_45", + "inputs": [ + "cat_26", + "unsqueeze_43" + ], + "output": "mul_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_34", + "inputs": [ + "mul_44", + "mul_45" + ], + "output": "add_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_40", + "inputs": [ + "add_33" + ], + "output": "transpose_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_44", + "inputs": [ + "transpose_40" + ], + "output": "unsqueeze_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_41", + "inputs": [ + "add_34" + ], + "output": "transpose_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_45", + "inputs": [ + "transpose_41" + ], + "output": "unsqueeze_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_42", + "inputs": [ + "select_26" + ], + "output": "transpose_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_46", + "inputs": [ + "transpose_42" + ], + "output": "unsqueeze_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_61", + "inputs": [ + "unsqueeze_44" + ], + "output": "slice_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_62", + "inputs": [ + "unsqueeze_45" + ], + "output": "slice_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_63", + "inputs": [ + "unsqueeze_46" + ], + "output": "slice_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_43", + "inputs": [ + "slice_62" + ], + "output": "transpose_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_16", + "inputs": [ + "slice_61", + "transpose_43" + ], + "output": "matmul_16", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_46", + "inputs": [ + "matmul_16" + ], + "output": "mul_46", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_8", + "inputs": [ + "mul_46" + ], + "output": "softmax_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_17", + "inputs": [ + "softmax_8", + "slice_63" + ], + "output": "matmul_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_44", + "inputs": [ + "matmul_17" + ], + "output": "transpose_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_8", + "inputs": [ + "transpose_44" + ], + "output": "clone_8", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_27", + "inputs": [ + "clone_8" + ], + "output": "cat_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_22", + "inputs": [ + "cat_27" + ], + "output": "view_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_33", + "inputs": [ + "view_22", + "p_visual_blocks_8_attn_proj_weight", + "p_visual_blocks_8_attn_proj_bias" + ], + "output": "linear_33", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_35", + "inputs": [ + "add_32", + "linear_33" + ], + "output": "add_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_17", + "inputs": [ + "add_35", + "p_visual_blocks_8_norm2_weight", + "p_visual_blocks_8_norm2_bias" + ], + "output": "layer_norm_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_34", + "inputs": [ + "layer_norm_17", + "p_visual_blocks_8_mlp_linear_fc1_weight", + "p_visual_blocks_8_mlp_linear_fc1_bias" + ], + "output": "linear_34", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_8", + "inputs": [ + "linear_34" + ], + "output": "gelu_8", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_35", + "inputs": [ + "gelu_8", + "p_visual_blocks_8_mlp_linear_fc2_weight", + "p_visual_blocks_8_mlp_linear_fc2_bias" + ], + "output": "linear_35", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_36", + "inputs": [ + "add_35", + "linear_35" + ], + "output": "add_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_18", + "inputs": [ + "add_36", + "p_visual_blocks_9_norm1_weight", + "p_visual_blocks_9_norm1_bias" + ], + "output": "layer_norm_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_36", + "inputs": [ + "layer_norm_18", + "p_visual_blocks_9_attn_qkv_weight", + "p_visual_blocks_9_attn_qkv_bias" + ], + "output": "linear_36", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_23", + "inputs": [ + "linear_36" + ], + "output": "view_23", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_9", + "inputs": [ + "view_23" + ], + "output": "permute_9", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_27", + "inputs": [ + "permute_9" + ], + "output": "select_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_28", + "inputs": [ + "permute_9" + ], + "output": "select_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_29", + "inputs": [ + "permute_9" + ], + "output": "select_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_47", + "inputs": [ + "cos" + ], + "output": "unsqueeze_47", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_48", + "inputs": [ + "sin" + ], + "output": "unsqueeze_48", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_47", + "inputs": [ + "select_27", + "unsqueeze_47" + ], + "output": "mul_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_64", + "inputs": [ + "select_27" + ], + "output": "slice_64", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_65", + "inputs": [ + "select_27" + ], + "output": "slice_65", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_18", + "inputs": [ + "slice_65" + ], + "output": "neg_18", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_28", + "inputs": [ + "neg_18", + "slice_64" + ], + "output": "cat_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_48", + "inputs": [ + "cat_28", + "unsqueeze_48" + ], + "output": "mul_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_37", + "inputs": [ + "mul_47", + "mul_48" + ], + "output": "add_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_49", + "inputs": [ + "select_28", + "unsqueeze_47" + ], + "output": "mul_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_66", + "inputs": [ + "select_28" + ], + "output": "slice_66", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_67", + "inputs": [ + "select_28" + ], + "output": "slice_67", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_19", + "inputs": [ + "slice_67" + ], + "output": "neg_19", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_29", + "inputs": [ + "neg_19", + "slice_66" + ], + "output": "cat_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_50", + "inputs": [ + "cat_29", + "unsqueeze_48" + ], + "output": "mul_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_38", + "inputs": [ + "mul_49", + "mul_50" + ], + "output": "add_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_45", + "inputs": [ + "add_37" + ], + "output": "transpose_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_49", + "inputs": [ + "transpose_45" + ], + "output": "unsqueeze_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_46", + "inputs": [ + "add_38" + ], + "output": "transpose_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_50", + "inputs": [ + "transpose_46" + ], + "output": "unsqueeze_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_47", + "inputs": [ + "select_29" + ], + "output": "transpose_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_51", + "inputs": [ + "transpose_47" + ], + "output": "unsqueeze_51", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_68", + "inputs": [ + "unsqueeze_49" + ], + "output": "slice_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_69", + "inputs": [ + "unsqueeze_50" + ], + "output": "slice_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_70", + "inputs": [ + "unsqueeze_51" + ], + "output": "slice_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_48", + "inputs": [ + "slice_69" + ], + "output": "transpose_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_18", + "inputs": [ + "slice_68", + "transpose_48" + ], + "output": "matmul_18", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_51", + "inputs": [ + "matmul_18" + ], + "output": "mul_51", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_9", + "inputs": [ + "mul_51" + ], + "output": "softmax_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_19", + "inputs": [ + "softmax_9", + "slice_70" + ], + "output": "matmul_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_49", + "inputs": [ + "matmul_19" + ], + "output": "transpose_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_9", + "inputs": [ + "transpose_49" + ], + "output": "clone_9", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_30", + "inputs": [ + "clone_9" + ], + "output": "cat_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_24", + "inputs": [ + "cat_30" + ], + "output": "view_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_37", + "inputs": [ + "view_24", + "p_visual_blocks_9_attn_proj_weight", + "p_visual_blocks_9_attn_proj_bias" + ], + "output": "linear_37", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_39", + "inputs": [ + "add_36", + "linear_37" + ], + "output": "add_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_19", + "inputs": [ + "add_39", + "p_visual_blocks_9_norm2_weight", + "p_visual_blocks_9_norm2_bias" + ], + "output": "layer_norm_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_38", + "inputs": [ + "layer_norm_19", + "p_visual_blocks_9_mlp_linear_fc1_weight", + "p_visual_blocks_9_mlp_linear_fc1_bias" + ], + "output": "linear_38", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_9", + "inputs": [ + "linear_38" + ], + "output": "gelu_9", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_39", + "inputs": [ + "gelu_9", + "p_visual_blocks_9_mlp_linear_fc2_weight", + "p_visual_blocks_9_mlp_linear_fc2_bias" + ], + "output": "linear_39", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_40", + "inputs": [ + "add_39", + "linear_39" + ], + "output": "add_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_20", + "inputs": [ + "add_40", + "p_visual_blocks_10_norm1_weight", + "p_visual_blocks_10_norm1_bias" + ], + "output": "layer_norm_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_40", + "inputs": [ + "layer_norm_20", + "p_visual_blocks_10_attn_qkv_weight", + "p_visual_blocks_10_attn_qkv_bias" + ], + "output": "linear_40", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_25", + "inputs": [ + "linear_40" + ], + "output": "view_25", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_10", + "inputs": [ + "view_25" + ], + "output": "permute_10", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_30", + "inputs": [ + "permute_10" + ], + "output": "select_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_31", + "inputs": [ + "permute_10" + ], + "output": "select_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_32", + "inputs": [ + "permute_10" + ], + "output": "select_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_52", + "inputs": [ + "cos" + ], + "output": "unsqueeze_52", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_53", + "inputs": [ + "sin" + ], + "output": "unsqueeze_53", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_52", + "inputs": [ + "select_30", + "unsqueeze_52" + ], + "output": "mul_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_71", + "inputs": [ + "select_30" + ], + "output": "slice_71", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_72", + "inputs": [ + "select_30" + ], + "output": "slice_72", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_20", + "inputs": [ + "slice_72" + ], + "output": "neg_20", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_31", + "inputs": [ + "neg_20", + "slice_71" + ], + "output": "cat_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_53", + "inputs": [ + "cat_31", + "unsqueeze_53" + ], + "output": "mul_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_41", + "inputs": [ + "mul_52", + "mul_53" + ], + "output": "add_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_54", + "inputs": [ + "select_31", + "unsqueeze_52" + ], + "output": "mul_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_73", + "inputs": [ + "select_31" + ], + "output": "slice_73", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_74", + "inputs": [ + "select_31" + ], + "output": "slice_74", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_21", + "inputs": [ + "slice_74" + ], + "output": "neg_21", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_32", + "inputs": [ + "neg_21", + "slice_73" + ], + "output": "cat_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_55", + "inputs": [ + "cat_32", + "unsqueeze_53" + ], + "output": "mul_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_42", + "inputs": [ + "mul_54", + "mul_55" + ], + "output": "add_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_50", + "inputs": [ + "add_41" + ], + "output": "transpose_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_54", + "inputs": [ + "transpose_50" + ], + "output": "unsqueeze_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_51", + "inputs": [ + "add_42" + ], + "output": "transpose_51", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_55", + "inputs": [ + "transpose_51" + ], + "output": "unsqueeze_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_52", + "inputs": [ + "select_32" + ], + "output": "transpose_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_56", + "inputs": [ + "transpose_52" + ], + "output": "unsqueeze_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_75", + "inputs": [ + "unsqueeze_54" + ], + "output": "slice_75", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_76", + "inputs": [ + "unsqueeze_55" + ], + "output": "slice_76", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_77", + "inputs": [ + "unsqueeze_56" + ], + "output": "slice_77", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_53", + "inputs": [ + "slice_76" + ], + "output": "transpose_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_20", + "inputs": [ + "slice_75", + "transpose_53" + ], + "output": "matmul_20", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_56", + "inputs": [ + "matmul_20" + ], + "output": "mul_56", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_10", + "inputs": [ + "mul_56" + ], + "output": "softmax_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_21", + "inputs": [ + "softmax_10", + "slice_77" + ], + "output": "matmul_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_54", + "inputs": [ + "matmul_21" + ], + "output": "transpose_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_10", + "inputs": [ + "transpose_54" + ], + "output": "clone_10", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_33", + "inputs": [ + "clone_10" + ], + "output": "cat_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_26", + "inputs": [ + "cat_33" + ], + "output": "view_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_41", + "inputs": [ + "view_26", + "p_visual_blocks_10_attn_proj_weight", + "p_visual_blocks_10_attn_proj_bias" + ], + "output": "linear_41", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_43", + "inputs": [ + "add_40", + "linear_41" + ], + "output": "add_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_21", + "inputs": [ + "add_43", + "p_visual_blocks_10_norm2_weight", + "p_visual_blocks_10_norm2_bias" + ], + "output": "layer_norm_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_42", + "inputs": [ + "layer_norm_21", + "p_visual_blocks_10_mlp_linear_fc1_weight", + "p_visual_blocks_10_mlp_linear_fc1_bias" + ], + "output": "linear_42", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_10", + "inputs": [ + "linear_42" + ], + "output": "gelu_10", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_43", + "inputs": [ + "gelu_10", + "p_visual_blocks_10_mlp_linear_fc2_weight", + "p_visual_blocks_10_mlp_linear_fc2_bias" + ], + "output": "linear_43", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_44", + "inputs": [ + "add_43", + "linear_43" + ], + "output": "add_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_22", + "inputs": [ + "add_44", + "p_visual_blocks_11_norm1_weight", + "p_visual_blocks_11_norm1_bias" + ], + "output": "layer_norm_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_44", + "inputs": [ + "layer_norm_22", + "p_visual_blocks_11_attn_qkv_weight", + "p_visual_blocks_11_attn_qkv_bias" + ], + "output": "linear_44", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_27", + "inputs": [ + "linear_44" + ], + "output": "view_27", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_11", + "inputs": [ + "view_27" + ], + "output": "permute_11", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_33", + "inputs": [ + "permute_11" + ], + "output": "select_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_34", + "inputs": [ + "permute_11" + ], + "output": "select_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_35", + "inputs": [ + "permute_11" + ], + "output": "select_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_57", + "inputs": [ + "cos" + ], + "output": "unsqueeze_57", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_58", + "inputs": [ + "sin" + ], + "output": "unsqueeze_58", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_57", + "inputs": [ + "select_33", + "unsqueeze_57" + ], + "output": "mul_57", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_78", + "inputs": [ + "select_33" + ], + "output": "slice_78", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_79", + "inputs": [ + "select_33" + ], + "output": "slice_79", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_22", + "inputs": [ + "slice_79" + ], + "output": "neg_22", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_34", + "inputs": [ + "neg_22", + "slice_78" + ], + "output": "cat_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_58", + "inputs": [ + "cat_34", + "unsqueeze_58" + ], + "output": "mul_58", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_45", + "inputs": [ + "mul_57", + "mul_58" + ], + "output": "add_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_59", + "inputs": [ + "select_34", + "unsqueeze_57" + ], + "output": "mul_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_80", + "inputs": [ + "select_34" + ], + "output": "slice_80", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_81", + "inputs": [ + "select_34" + ], + "output": "slice_81", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_23", + "inputs": [ + "slice_81" + ], + "output": "neg_23", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_35", + "inputs": [ + "neg_23", + "slice_80" + ], + "output": "cat_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_60", + "inputs": [ + "cat_35", + "unsqueeze_58" + ], + "output": "mul_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_46", + "inputs": [ + "mul_59", + "mul_60" + ], + "output": "add_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_55", + "inputs": [ + "add_45" + ], + "output": "transpose_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_59", + "inputs": [ + "transpose_55" + ], + "output": "unsqueeze_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_56", + "inputs": [ + "add_46" + ], + "output": "transpose_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_60", + "inputs": [ + "transpose_56" + ], + "output": "unsqueeze_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_57", + "inputs": [ + "select_35" + ], + "output": "transpose_57", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_61", + "inputs": [ + "transpose_57" + ], + "output": "unsqueeze_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_82", + "inputs": [ + "unsqueeze_59" + ], + "output": "slice_82", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_83", + "inputs": [ + "unsqueeze_60" + ], + "output": "slice_83", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_84", + "inputs": [ + "unsqueeze_61" + ], + "output": "slice_84", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_58", + "inputs": [ + "slice_83" + ], + "output": "transpose_58", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_22", + "inputs": [ + "slice_82", + "transpose_58" + ], + "output": "matmul_22", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_61", + "inputs": [ + "matmul_22" + ], + "output": "mul_61", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_11", + "inputs": [ + "mul_61" + ], + "output": "softmax_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_23", + "inputs": [ + "softmax_11", + "slice_84" + ], + "output": "matmul_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_59", + "inputs": [ + "matmul_23" + ], + "output": "transpose_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_11", + "inputs": [ + "transpose_59" + ], + "output": "clone_11", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_36", + "inputs": [ + "clone_11" + ], + "output": "cat_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_28", + "inputs": [ + "cat_36" + ], + "output": "view_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_45", + "inputs": [ + "view_28", + "p_visual_blocks_11_attn_proj_weight", + "p_visual_blocks_11_attn_proj_bias" + ], + "output": "linear_45", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_47", + "inputs": [ + "add_44", + "linear_45" + ], + "output": "add_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_23", + "inputs": [ + "add_47", + "p_visual_blocks_11_norm2_weight", + "p_visual_blocks_11_norm2_bias" + ], + "output": "layer_norm_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_46", + "inputs": [ + "layer_norm_23", + "p_visual_blocks_11_mlp_linear_fc1_weight", + "p_visual_blocks_11_mlp_linear_fc1_bias" + ], + "output": "linear_46", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_11", + "inputs": [ + "linear_46" + ], + "output": "gelu_11", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_47", + "inputs": [ + "gelu_11", + "p_visual_blocks_11_mlp_linear_fc2_weight", + "p_visual_blocks_11_mlp_linear_fc2_bias" + ], + "output": "linear_47", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_48", + "inputs": [ + "add_47", + "linear_47" + ], + "output": "add_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_24", + "inputs": [ + "add_48", + "p_visual_blocks_12_norm1_weight", + "p_visual_blocks_12_norm1_bias" + ], + "output": "layer_norm_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_48", + "inputs": [ + "layer_norm_24", + "p_visual_blocks_12_attn_qkv_weight", + "p_visual_blocks_12_attn_qkv_bias" + ], + "output": "linear_48", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_29", + "inputs": [ + "linear_48" + ], + "output": "view_29", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_12", + "inputs": [ + "view_29" + ], + "output": "permute_12", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_36", + "inputs": [ + "permute_12" + ], + "output": "select_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_37", + "inputs": [ + "permute_12" + ], + "output": "select_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_38", + "inputs": [ + "permute_12" + ], + "output": "select_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_62", + "inputs": [ + "cos" + ], + "output": "unsqueeze_62", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_63", + "inputs": [ + "sin" + ], + "output": "unsqueeze_63", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_62", + "inputs": [ + "select_36", + "unsqueeze_62" + ], + "output": "mul_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_85", + "inputs": [ + "select_36" + ], + "output": "slice_85", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_86", + "inputs": [ + "select_36" + ], + "output": "slice_86", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_24", + "inputs": [ + "slice_86" + ], + "output": "neg_24", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_37", + "inputs": [ + "neg_24", + "slice_85" + ], + "output": "cat_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_63", + "inputs": [ + "cat_37", + "unsqueeze_63" + ], + "output": "mul_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_49", + "inputs": [ + "mul_62", + "mul_63" + ], + "output": "add_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_64", + "inputs": [ + "select_37", + "unsqueeze_62" + ], + "output": "mul_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_87", + "inputs": [ + "select_37" + ], + "output": "slice_87", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_88", + "inputs": [ + "select_37" + ], + "output": "slice_88", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_25", + "inputs": [ + "slice_88" + ], + "output": "neg_25", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_38", + "inputs": [ + "neg_25", + "slice_87" + ], + "output": "cat_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_65", + "inputs": [ + "cat_38", + "unsqueeze_63" + ], + "output": "mul_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_50", + "inputs": [ + "mul_64", + "mul_65" + ], + "output": "add_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_60", + "inputs": [ + "add_49" + ], + "output": "transpose_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_64", + "inputs": [ + "transpose_60" + ], + "output": "unsqueeze_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_61", + "inputs": [ + "add_50" + ], + "output": "transpose_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_65", + "inputs": [ + "transpose_61" + ], + "output": "unsqueeze_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_62", + "inputs": [ + "select_38" + ], + "output": "transpose_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_66", + "inputs": [ + "transpose_62" + ], + "output": "unsqueeze_66", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_89", + "inputs": [ + "unsqueeze_64" + ], + "output": "slice_89", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_90", + "inputs": [ + "unsqueeze_65" + ], + "output": "slice_90", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_91", + "inputs": [ + "unsqueeze_66" + ], + "output": "slice_91", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_63", + "inputs": [ + "slice_90" + ], + "output": "transpose_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_24", + "inputs": [ + "slice_89", + "transpose_63" + ], + "output": "matmul_24", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_66", + "inputs": [ + "matmul_24" + ], + "output": "mul_66", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_12", + "inputs": [ + "mul_66" + ], + "output": "softmax_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_25", + "inputs": [ + "softmax_12", + "slice_91" + ], + "output": "matmul_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_64", + "inputs": [ + "matmul_25" + ], + "output": "transpose_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_12", + "inputs": [ + "transpose_64" + ], + "output": "clone_12", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_39", + "inputs": [ + "clone_12" + ], + "output": "cat_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_30", + "inputs": [ + "cat_39" + ], + "output": "view_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_49", + "inputs": [ + "view_30", + "p_visual_blocks_12_attn_proj_weight", + "p_visual_blocks_12_attn_proj_bias" + ], + "output": "linear_49", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_51", + "inputs": [ + "add_48", + "linear_49" + ], + "output": "add_51", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_25", + "inputs": [ + "add_51", + "p_visual_blocks_12_norm2_weight", + "p_visual_blocks_12_norm2_bias" + ], + "output": "layer_norm_25", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_50", + "inputs": [ + "layer_norm_25", + "p_visual_blocks_12_mlp_linear_fc1_weight", + "p_visual_blocks_12_mlp_linear_fc1_bias" + ], + "output": "linear_50", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_12", + "inputs": [ + "linear_50" + ], + "output": "gelu_12", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_51", + "inputs": [ + "gelu_12", + "p_visual_blocks_12_mlp_linear_fc2_weight", + "p_visual_blocks_12_mlp_linear_fc2_bias" + ], + "output": "linear_51", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_52", + "inputs": [ + "add_51", + "linear_51" + ], + "output": "add_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_26", + "inputs": [ + "add_52", + "p_visual_blocks_13_norm1_weight", + "p_visual_blocks_13_norm1_bias" + ], + "output": "layer_norm_26", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_52", + "inputs": [ + "layer_norm_26", + "p_visual_blocks_13_attn_qkv_weight", + "p_visual_blocks_13_attn_qkv_bias" + ], + "output": "linear_52", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_31", + "inputs": [ + "linear_52" + ], + "output": "view_31", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_13", + "inputs": [ + "view_31" + ], + "output": "permute_13", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_39", + "inputs": [ + "permute_13" + ], + "output": "select_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_40", + "inputs": [ + "permute_13" + ], + "output": "select_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_41", + "inputs": [ + "permute_13" + ], + "output": "select_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_67", + "inputs": [ + "cos" + ], + "output": "unsqueeze_67", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_68", + "inputs": [ + "sin" + ], + "output": "unsqueeze_68", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_67", + "inputs": [ + "select_39", + "unsqueeze_67" + ], + "output": "mul_67", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_92", + "inputs": [ + "select_39" + ], + "output": "slice_92", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_93", + "inputs": [ + "select_39" + ], + "output": "slice_93", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_26", + "inputs": [ + "slice_93" + ], + "output": "neg_26", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_40", + "inputs": [ + "neg_26", + "slice_92" + ], + "output": "cat_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_68", + "inputs": [ + "cat_40", + "unsqueeze_68" + ], + "output": "mul_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_53", + "inputs": [ + "mul_67", + "mul_68" + ], + "output": "add_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_69", + "inputs": [ + "select_40", + "unsqueeze_67" + ], + "output": "mul_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_94", + "inputs": [ + "select_40" + ], + "output": "slice_94", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_95", + "inputs": [ + "select_40" + ], + "output": "slice_95", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_27", + "inputs": [ + "slice_95" + ], + "output": "neg_27", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_41", + "inputs": [ + "neg_27", + "slice_94" + ], + "output": "cat_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_70", + "inputs": [ + "cat_41", + "unsqueeze_68" + ], + "output": "mul_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_54", + "inputs": [ + "mul_69", + "mul_70" + ], + "output": "add_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_65", + "inputs": [ + "add_53" + ], + "output": "transpose_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_69", + "inputs": [ + "transpose_65" + ], + "output": "unsqueeze_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_66", + "inputs": [ + "add_54" + ], + "output": "transpose_66", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_70", + "inputs": [ + "transpose_66" + ], + "output": "unsqueeze_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_67", + "inputs": [ + "select_41" + ], + "output": "transpose_67", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_71", + "inputs": [ + "transpose_67" + ], + "output": "unsqueeze_71", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_96", + "inputs": [ + "unsqueeze_69" + ], + "output": "slice_96", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_97", + "inputs": [ + "unsqueeze_70" + ], + "output": "slice_97", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_98", + "inputs": [ + "unsqueeze_71" + ], + "output": "slice_98", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_68", + "inputs": [ + "slice_97" + ], + "output": "transpose_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_26", + "inputs": [ + "slice_96", + "transpose_68" + ], + "output": "matmul_26", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_71", + "inputs": [ + "matmul_26" + ], + "output": "mul_71", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_13", + "inputs": [ + "mul_71" + ], + "output": "softmax_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_27", + "inputs": [ + "softmax_13", + "slice_98" + ], + "output": "matmul_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_69", + "inputs": [ + "matmul_27" + ], + "output": "transpose_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_13", + "inputs": [ + "transpose_69" + ], + "output": "clone_13", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_42", + "inputs": [ + "clone_13" + ], + "output": "cat_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_32", + "inputs": [ + "cat_42" + ], + "output": "view_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_53", + "inputs": [ + "view_32", + "p_visual_blocks_13_attn_proj_weight", + "p_visual_blocks_13_attn_proj_bias" + ], + "output": "linear_53", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_55", + "inputs": [ + "add_52", + "linear_53" + ], + "output": "add_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_27", + "inputs": [ + "add_55", + "p_visual_blocks_13_norm2_weight", + "p_visual_blocks_13_norm2_bias" + ], + "output": "layer_norm_27", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_54", + "inputs": [ + "layer_norm_27", + "p_visual_blocks_13_mlp_linear_fc1_weight", + "p_visual_blocks_13_mlp_linear_fc1_bias" + ], + "output": "linear_54", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_13", + "inputs": [ + "linear_54" + ], + "output": "gelu_13", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_55", + "inputs": [ + "gelu_13", + "p_visual_blocks_13_mlp_linear_fc2_weight", + "p_visual_blocks_13_mlp_linear_fc2_bias" + ], + "output": "linear_55", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_56", + "inputs": [ + "add_55", + "linear_55" + ], + "output": "add_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_28", + "inputs": [ + "add_56", + "p_visual_blocks_14_norm1_weight", + "p_visual_blocks_14_norm1_bias" + ], + "output": "layer_norm_28", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_56", + "inputs": [ + "layer_norm_28", + "p_visual_blocks_14_attn_qkv_weight", + "p_visual_blocks_14_attn_qkv_bias" + ], + "output": "linear_56", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_33", + "inputs": [ + "linear_56" + ], + "output": "view_33", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_14", + "inputs": [ + "view_33" + ], + "output": "permute_14", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_42", + "inputs": [ + "permute_14" + ], + "output": "select_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_43", + "inputs": [ + "permute_14" + ], + "output": "select_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_44", + "inputs": [ + "permute_14" + ], + "output": "select_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_72", + "inputs": [ + "cos" + ], + "output": "unsqueeze_72", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_73", + "inputs": [ + "sin" + ], + "output": "unsqueeze_73", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_72", + "inputs": [ + "select_42", + "unsqueeze_72" + ], + "output": "mul_72", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_99", + "inputs": [ + "select_42" + ], + "output": "slice_99", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_100", + "inputs": [ + "select_42" + ], + "output": "slice_100", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_28", + "inputs": [ + "slice_100" + ], + "output": "neg_28", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_43", + "inputs": [ + "neg_28", + "slice_99" + ], + "output": "cat_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_73", + "inputs": [ + "cat_43", + "unsqueeze_73" + ], + "output": "mul_73", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_57", + "inputs": [ + "mul_72", + "mul_73" + ], + "output": "add_57", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_74", + "inputs": [ + "select_43", + "unsqueeze_72" + ], + "output": "mul_74", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_101", + "inputs": [ + "select_43" + ], + "output": "slice_101", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_102", + "inputs": [ + "select_43" + ], + "output": "slice_102", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_29", + "inputs": [ + "slice_102" + ], + "output": "neg_29", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_44", + "inputs": [ + "neg_29", + "slice_101" + ], + "output": "cat_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_75", + "inputs": [ + "cat_44", + "unsqueeze_73" + ], + "output": "mul_75", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_58", + "inputs": [ + "mul_74", + "mul_75" + ], + "output": "add_58", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_70", + "inputs": [ + "add_57" + ], + "output": "transpose_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_74", + "inputs": [ + "transpose_70" + ], + "output": "unsqueeze_74", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_71", + "inputs": [ + "add_58" + ], + "output": "transpose_71", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_75", + "inputs": [ + "transpose_71" + ], + "output": "unsqueeze_75", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_72", + "inputs": [ + "select_44" + ], + "output": "transpose_72", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_76", + "inputs": [ + "transpose_72" + ], + "output": "unsqueeze_76", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_103", + "inputs": [ + "unsqueeze_74" + ], + "output": "slice_103", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_104", + "inputs": [ + "unsqueeze_75" + ], + "output": "slice_104", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_105", + "inputs": [ + "unsqueeze_76" + ], + "output": "slice_105", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_73", + "inputs": [ + "slice_104" + ], + "output": "transpose_73", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_28", + "inputs": [ + "slice_103", + "transpose_73" + ], + "output": "matmul_28", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_76", + "inputs": [ + "matmul_28" + ], + "output": "mul_76", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_14", + "inputs": [ + "mul_76" + ], + "output": "softmax_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_29", + "inputs": [ + "softmax_14", + "slice_105" + ], + "output": "matmul_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_74", + "inputs": [ + "matmul_29" + ], + "output": "transpose_74", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_14", + "inputs": [ + "transpose_74" + ], + "output": "clone_14", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_45", + "inputs": [ + "clone_14" + ], + "output": "cat_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_34", + "inputs": [ + "cat_45" + ], + "output": "view_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_57", + "inputs": [ + "view_34", + "p_visual_blocks_14_attn_proj_weight", + "p_visual_blocks_14_attn_proj_bias" + ], + "output": "linear_57", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_59", + "inputs": [ + "add_56", + "linear_57" + ], + "output": "add_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_29", + "inputs": [ + "add_59", + "p_visual_blocks_14_norm2_weight", + "p_visual_blocks_14_norm2_bias" + ], + "output": "layer_norm_29", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_58", + "inputs": [ + "layer_norm_29", + "p_visual_blocks_14_mlp_linear_fc1_weight", + "p_visual_blocks_14_mlp_linear_fc1_bias" + ], + "output": "linear_58", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_14", + "inputs": [ + "linear_58" + ], + "output": "gelu_14", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_59", + "inputs": [ + "gelu_14", + "p_visual_blocks_14_mlp_linear_fc2_weight", + "p_visual_blocks_14_mlp_linear_fc2_bias" + ], + "output": "linear_59", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_60", + "inputs": [ + "add_59", + "linear_59" + ], + "output": "add_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_30", + "inputs": [ + "add_60", + "p_visual_blocks_15_norm1_weight", + "p_visual_blocks_15_norm1_bias" + ], + "output": "layer_norm_30", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_60", + "inputs": [ + "layer_norm_30", + "p_visual_blocks_15_attn_qkv_weight", + "p_visual_blocks_15_attn_qkv_bias" + ], + "output": "linear_60", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_35", + "inputs": [ + "linear_60" + ], + "output": "view_35", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_15", + "inputs": [ + "view_35" + ], + "output": "permute_15", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_45", + "inputs": [ + "permute_15" + ], + "output": "select_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_46", + "inputs": [ + "permute_15" + ], + "output": "select_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_47", + "inputs": [ + "permute_15" + ], + "output": "select_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_77", + "inputs": [ + "cos" + ], + "output": "unsqueeze_77", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_78", + "inputs": [ + "sin" + ], + "output": "unsqueeze_78", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_77", + "inputs": [ + "select_45", + "unsqueeze_77" + ], + "output": "mul_77", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_106", + "inputs": [ + "select_45" + ], + "output": "slice_106", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_107", + "inputs": [ + "select_45" + ], + "output": "slice_107", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_30", + "inputs": [ + "slice_107" + ], + "output": "neg_30", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_46", + "inputs": [ + "neg_30", + "slice_106" + ], + "output": "cat_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_78", + "inputs": [ + "cat_46", + "unsqueeze_78" + ], + "output": "mul_78", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_61", + "inputs": [ + "mul_77", + "mul_78" + ], + "output": "add_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_79", + "inputs": [ + "select_46", + "unsqueeze_77" + ], + "output": "mul_79", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_108", + "inputs": [ + "select_46" + ], + "output": "slice_108", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_109", + "inputs": [ + "select_46" + ], + "output": "slice_109", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_31", + "inputs": [ + "slice_109" + ], + "output": "neg_31", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_47", + "inputs": [ + "neg_31", + "slice_108" + ], + "output": "cat_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_80", + "inputs": [ + "cat_47", + "unsqueeze_78" + ], + "output": "mul_80", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_62", + "inputs": [ + "mul_79", + "mul_80" + ], + "output": "add_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_75", + "inputs": [ + "add_61" + ], + "output": "transpose_75", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_79", + "inputs": [ + "transpose_75" + ], + "output": "unsqueeze_79", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_76", + "inputs": [ + "add_62" + ], + "output": "transpose_76", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_80", + "inputs": [ + "transpose_76" + ], + "output": "unsqueeze_80", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_77", + "inputs": [ + "select_47" + ], + "output": "transpose_77", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_81", + "inputs": [ + "transpose_77" + ], + "output": "unsqueeze_81", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_110", + "inputs": [ + "unsqueeze_79" + ], + "output": "slice_110", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_111", + "inputs": [ + "unsqueeze_80" + ], + "output": "slice_111", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_112", + "inputs": [ + "unsqueeze_81" + ], + "output": "slice_112", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_78", + "inputs": [ + "slice_111" + ], + "output": "transpose_78", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_30", + "inputs": [ + "slice_110", + "transpose_78" + ], + "output": "matmul_30", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_81", + "inputs": [ + "matmul_30" + ], + "output": "mul_81", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_15", + "inputs": [ + "mul_81" + ], + "output": "softmax_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_31", + "inputs": [ + "softmax_15", + "slice_112" + ], + "output": "matmul_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_79", + "inputs": [ + "matmul_31" + ], + "output": "transpose_79", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_15", + "inputs": [ + "transpose_79" + ], + "output": "clone_15", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_48", + "inputs": [ + "clone_15" + ], + "output": "cat_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_36", + "inputs": [ + "cat_48" + ], + "output": "view_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_61", + "inputs": [ + "view_36", + "p_visual_blocks_15_attn_proj_weight", + "p_visual_blocks_15_attn_proj_bias" + ], + "output": "linear_61", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_63", + "inputs": [ + "add_60", + "linear_61" + ], + "output": "add_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_31", + "inputs": [ + "add_63", + "p_visual_blocks_15_norm2_weight", + "p_visual_blocks_15_norm2_bias" + ], + "output": "layer_norm_31", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_62", + "inputs": [ + "layer_norm_31", + "p_visual_blocks_15_mlp_linear_fc1_weight", + "p_visual_blocks_15_mlp_linear_fc1_bias" + ], + "output": "linear_62", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_15", + "inputs": [ + "linear_62" + ], + "output": "gelu_15", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_63", + "inputs": [ + "gelu_15", + "p_visual_blocks_15_mlp_linear_fc2_weight", + "p_visual_blocks_15_mlp_linear_fc2_bias" + ], + "output": "linear_63", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_64", + "inputs": [ + "add_63", + "linear_63" + ], + "output": "add_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_32", + "inputs": [ + "add_64", + "p_visual_blocks_16_norm1_weight", + "p_visual_blocks_16_norm1_bias" + ], + "output": "layer_norm_32", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_64", + "inputs": [ + "layer_norm_32", + "p_visual_blocks_16_attn_qkv_weight", + "p_visual_blocks_16_attn_qkv_bias" + ], + "output": "linear_64", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_37", + "inputs": [ + "linear_64" + ], + "output": "view_37", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_16", + "inputs": [ + "view_37" + ], + "output": "permute_16", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_48", + "inputs": [ + "permute_16" + ], + "output": "select_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_49", + "inputs": [ + "permute_16" + ], + "output": "select_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_50", + "inputs": [ + "permute_16" + ], + "output": "select_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_82", + "inputs": [ + "cos" + ], + "output": "unsqueeze_82", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_83", + "inputs": [ + "sin" + ], + "output": "unsqueeze_83", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_82", + "inputs": [ + "select_48", + "unsqueeze_82" + ], + "output": "mul_82", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_113", + "inputs": [ + "select_48" + ], + "output": "slice_113", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_114", + "inputs": [ + "select_48" + ], + "output": "slice_114", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_32", + "inputs": [ + "slice_114" + ], + "output": "neg_32", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_49", + "inputs": [ + "neg_32", + "slice_113" + ], + "output": "cat_49", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_83", + "inputs": [ + "cat_49", + "unsqueeze_83" + ], + "output": "mul_83", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_65", + "inputs": [ + "mul_82", + "mul_83" + ], + "output": "add_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_84", + "inputs": [ + "select_49", + "unsqueeze_82" + ], + "output": "mul_84", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_115", + "inputs": [ + "select_49" + ], + "output": "slice_115", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_116", + "inputs": [ + "select_49" + ], + "output": "slice_116", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_33", + "inputs": [ + "slice_116" + ], + "output": "neg_33", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_50", + "inputs": [ + "neg_33", + "slice_115" + ], + "output": "cat_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_85", + "inputs": [ + "cat_50", + "unsqueeze_83" + ], + "output": "mul_85", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_66", + "inputs": [ + "mul_84", + "mul_85" + ], + "output": "add_66", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_80", + "inputs": [ + "add_65" + ], + "output": "transpose_80", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_84", + "inputs": [ + "transpose_80" + ], + "output": "unsqueeze_84", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_81", + "inputs": [ + "add_66" + ], + "output": "transpose_81", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_85", + "inputs": [ + "transpose_81" + ], + "output": "unsqueeze_85", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_82", + "inputs": [ + "select_50" + ], + "output": "transpose_82", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_86", + "inputs": [ + "transpose_82" + ], + "output": "unsqueeze_86", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_117", + "inputs": [ + "unsqueeze_84" + ], + "output": "slice_117", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_118", + "inputs": [ + "unsqueeze_85" + ], + "output": "slice_118", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_119", + "inputs": [ + "unsqueeze_86" + ], + "output": "slice_119", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_83", + "inputs": [ + "slice_118" + ], + "output": "transpose_83", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_32", + "inputs": [ + "slice_117", + "transpose_83" + ], + "output": "matmul_32", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_86", + "inputs": [ + "matmul_32" + ], + "output": "mul_86", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_16", + "inputs": [ + "mul_86" + ], + "output": "softmax_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_33", + "inputs": [ + "softmax_16", + "slice_119" + ], + "output": "matmul_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_84", + "inputs": [ + "matmul_33" + ], + "output": "transpose_84", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_16", + "inputs": [ + "transpose_84" + ], + "output": "clone_16", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_51", + "inputs": [ + "clone_16" + ], + "output": "cat_51", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_38", + "inputs": [ + "cat_51" + ], + "output": "view_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_65", + "inputs": [ + "view_38", + "p_visual_blocks_16_attn_proj_weight", + "p_visual_blocks_16_attn_proj_bias" + ], + "output": "linear_65", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_67", + "inputs": [ + "add_64", + "linear_65" + ], + "output": "add_67", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_33", + "inputs": [ + "add_67", + "p_visual_blocks_16_norm2_weight", + "p_visual_blocks_16_norm2_bias" + ], + "output": "layer_norm_33", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_66", + "inputs": [ + "layer_norm_33", + "p_visual_blocks_16_mlp_linear_fc1_weight", + "p_visual_blocks_16_mlp_linear_fc1_bias" + ], + "output": "linear_66", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_16", + "inputs": [ + "linear_66" + ], + "output": "gelu_16", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_67", + "inputs": [ + "gelu_16", + "p_visual_blocks_16_mlp_linear_fc2_weight", + "p_visual_blocks_16_mlp_linear_fc2_bias" + ], + "output": "linear_67", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_68", + "inputs": [ + "add_67", + "linear_67" + ], + "output": "add_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_34", + "inputs": [ + "add_68", + "p_visual_blocks_17_norm1_weight", + "p_visual_blocks_17_norm1_bias" + ], + "output": "layer_norm_34", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_68", + "inputs": [ + "layer_norm_34", + "p_visual_blocks_17_attn_qkv_weight", + "p_visual_blocks_17_attn_qkv_bias" + ], + "output": "linear_68", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_39", + "inputs": [ + "linear_68" + ], + "output": "view_39", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_17", + "inputs": [ + "view_39" + ], + "output": "permute_17", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_51", + "inputs": [ + "permute_17" + ], + "output": "select_51", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_52", + "inputs": [ + "permute_17" + ], + "output": "select_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_53", + "inputs": [ + "permute_17" + ], + "output": "select_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_87", + "inputs": [ + "cos" + ], + "output": "unsqueeze_87", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_88", + "inputs": [ + "sin" + ], + "output": "unsqueeze_88", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_87", + "inputs": [ + "select_51", + "unsqueeze_87" + ], + "output": "mul_87", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_120", + "inputs": [ + "select_51" + ], + "output": "slice_120", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_121", + "inputs": [ + "select_51" + ], + "output": "slice_121", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_34", + "inputs": [ + "slice_121" + ], + "output": "neg_34", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_52", + "inputs": [ + "neg_34", + "slice_120" + ], + "output": "cat_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_88", + "inputs": [ + "cat_52", + "unsqueeze_88" + ], + "output": "mul_88", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_69", + "inputs": [ + "mul_87", + "mul_88" + ], + "output": "add_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_89", + "inputs": [ + "select_52", + "unsqueeze_87" + ], + "output": "mul_89", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_122", + "inputs": [ + "select_52" + ], + "output": "slice_122", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_123", + "inputs": [ + "select_52" + ], + "output": "slice_123", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_35", + "inputs": [ + "slice_123" + ], + "output": "neg_35", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_53", + "inputs": [ + "neg_35", + "slice_122" + ], + "output": "cat_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_90", + "inputs": [ + "cat_53", + "unsqueeze_88" + ], + "output": "mul_90", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_70", + "inputs": [ + "mul_89", + "mul_90" + ], + "output": "add_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_85", + "inputs": [ + "add_69" + ], + "output": "transpose_85", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_89", + "inputs": [ + "transpose_85" + ], + "output": "unsqueeze_89", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_86", + "inputs": [ + "add_70" + ], + "output": "transpose_86", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_90", + "inputs": [ + "transpose_86" + ], + "output": "unsqueeze_90", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_87", + "inputs": [ + "select_53" + ], + "output": "transpose_87", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_91", + "inputs": [ + "transpose_87" + ], + "output": "unsqueeze_91", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_124", + "inputs": [ + "unsqueeze_89" + ], + "output": "slice_124", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_125", + "inputs": [ + "unsqueeze_90" + ], + "output": "slice_125", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_126", + "inputs": [ + "unsqueeze_91" + ], + "output": "slice_126", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_88", + "inputs": [ + "slice_125" + ], + "output": "transpose_88", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_34", + "inputs": [ + "slice_124", + "transpose_88" + ], + "output": "matmul_34", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_91", + "inputs": [ + "matmul_34" + ], + "output": "mul_91", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_17", + "inputs": [ + "mul_91" + ], + "output": "softmax_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_35", + "inputs": [ + "softmax_17", + "slice_126" + ], + "output": "matmul_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_89", + "inputs": [ + "matmul_35" + ], + "output": "transpose_89", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_17", + "inputs": [ + "transpose_89" + ], + "output": "clone_17", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_54", + "inputs": [ + "clone_17" + ], + "output": "cat_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_40", + "inputs": [ + "cat_54" + ], + "output": "view_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_69", + "inputs": [ + "view_40", + "p_visual_blocks_17_attn_proj_weight", + "p_visual_blocks_17_attn_proj_bias" + ], + "output": "linear_69", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_71", + "inputs": [ + "add_68", + "linear_69" + ], + "output": "add_71", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_35", + "inputs": [ + "add_71", + "p_visual_blocks_17_norm2_weight", + "p_visual_blocks_17_norm2_bias" + ], + "output": "layer_norm_35", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_70", + "inputs": [ + "layer_norm_35", + "p_visual_blocks_17_mlp_linear_fc1_weight", + "p_visual_blocks_17_mlp_linear_fc1_bias" + ], + "output": "linear_70", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_17", + "inputs": [ + "linear_70" + ], + "output": "gelu_17", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_71", + "inputs": [ + "gelu_17", + "p_visual_blocks_17_mlp_linear_fc2_weight", + "p_visual_blocks_17_mlp_linear_fc2_bias" + ], + "output": "linear_71", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_72", + "inputs": [ + "add_71", + "linear_71" + ], + "output": "add_72", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_36", + "inputs": [ + "add_72", + "p_visual_blocks_18_norm1_weight", + "p_visual_blocks_18_norm1_bias" + ], + "output": "layer_norm_36", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_72", + "inputs": [ + "layer_norm_36", + "p_visual_blocks_18_attn_qkv_weight", + "p_visual_blocks_18_attn_qkv_bias" + ], + "output": "linear_72", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_41", + "inputs": [ + "linear_72" + ], + "output": "view_41", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_18", + "inputs": [ + "view_41" + ], + "output": "permute_18", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_54", + "inputs": [ + "permute_18" + ], + "output": "select_54", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_55", + "inputs": [ + "permute_18" + ], + "output": "select_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_56", + "inputs": [ + "permute_18" + ], + "output": "select_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_92", + "inputs": [ + "cos" + ], + "output": "unsqueeze_92", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_93", + "inputs": [ + "sin" + ], + "output": "unsqueeze_93", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_92", + "inputs": [ + "select_54", + "unsqueeze_92" + ], + "output": "mul_92", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_127", + "inputs": [ + "select_54" + ], + "output": "slice_127", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_128", + "inputs": [ + "select_54" + ], + "output": "slice_128", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_36", + "inputs": [ + "slice_128" + ], + "output": "neg_36", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_55", + "inputs": [ + "neg_36", + "slice_127" + ], + "output": "cat_55", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_93", + "inputs": [ + "cat_55", + "unsqueeze_93" + ], + "output": "mul_93", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_73", + "inputs": [ + "mul_92", + "mul_93" + ], + "output": "add_73", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_94", + "inputs": [ + "select_55", + "unsqueeze_92" + ], + "output": "mul_94", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_129", + "inputs": [ + "select_55" + ], + "output": "slice_129", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_130", + "inputs": [ + "select_55" + ], + "output": "slice_130", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_37", + "inputs": [ + "slice_130" + ], + "output": "neg_37", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_56", + "inputs": [ + "neg_37", + "slice_129" + ], + "output": "cat_56", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_95", + "inputs": [ + "cat_56", + "unsqueeze_93" + ], + "output": "mul_95", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_74", + "inputs": [ + "mul_94", + "mul_95" + ], + "output": "add_74", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_90", + "inputs": [ + "add_73" + ], + "output": "transpose_90", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_94", + "inputs": [ + "transpose_90" + ], + "output": "unsqueeze_94", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_91", + "inputs": [ + "add_74" + ], + "output": "transpose_91", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_95", + "inputs": [ + "transpose_91" + ], + "output": "unsqueeze_95", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_92", + "inputs": [ + "select_56" + ], + "output": "transpose_92", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_96", + "inputs": [ + "transpose_92" + ], + "output": "unsqueeze_96", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_131", + "inputs": [ + "unsqueeze_94" + ], + "output": "slice_131", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_132", + "inputs": [ + "unsqueeze_95" + ], + "output": "slice_132", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_133", + "inputs": [ + "unsqueeze_96" + ], + "output": "slice_133", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_93", + "inputs": [ + "slice_132" + ], + "output": "transpose_93", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_36", + "inputs": [ + "slice_131", + "transpose_93" + ], + "output": "matmul_36", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_96", + "inputs": [ + "matmul_36" + ], + "output": "mul_96", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_18", + "inputs": [ + "mul_96" + ], + "output": "softmax_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_37", + "inputs": [ + "softmax_18", + "slice_133" + ], + "output": "matmul_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_94", + "inputs": [ + "matmul_37" + ], + "output": "transpose_94", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_18", + "inputs": [ + "transpose_94" + ], + "output": "clone_18", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_57", + "inputs": [ + "clone_18" + ], + "output": "cat_57", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_42", + "inputs": [ + "cat_57" + ], + "output": "view_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_73", + "inputs": [ + "view_42", + "p_visual_blocks_18_attn_proj_weight", + "p_visual_blocks_18_attn_proj_bias" + ], + "output": "linear_73", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_75", + "inputs": [ + "add_72", + "linear_73" + ], + "output": "add_75", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_37", + "inputs": [ + "add_75", + "p_visual_blocks_18_norm2_weight", + "p_visual_blocks_18_norm2_bias" + ], + "output": "layer_norm_37", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_74", + "inputs": [ + "layer_norm_37", + "p_visual_blocks_18_mlp_linear_fc1_weight", + "p_visual_blocks_18_mlp_linear_fc1_bias" + ], + "output": "linear_74", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_18", + "inputs": [ + "linear_74" + ], + "output": "gelu_18", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_75", + "inputs": [ + "gelu_18", + "p_visual_blocks_18_mlp_linear_fc2_weight", + "p_visual_blocks_18_mlp_linear_fc2_bias" + ], + "output": "linear_75", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_76", + "inputs": [ + "add_75", + "linear_75" + ], + "output": "add_76", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_38", + "inputs": [ + "add_76", + "p_visual_blocks_19_norm1_weight", + "p_visual_blocks_19_norm1_bias" + ], + "output": "layer_norm_38", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_76", + "inputs": [ + "layer_norm_38", + "p_visual_blocks_19_attn_qkv_weight", + "p_visual_blocks_19_attn_qkv_bias" + ], + "output": "linear_76", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_43", + "inputs": [ + "linear_76" + ], + "output": "view_43", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_19", + "inputs": [ + "view_43" + ], + "output": "permute_19", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_57", + "inputs": [ + "permute_19" + ], + "output": "select_57", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_58", + "inputs": [ + "permute_19" + ], + "output": "select_58", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_59", + "inputs": [ + "permute_19" + ], + "output": "select_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_97", + "inputs": [ + "cos" + ], + "output": "unsqueeze_97", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_98", + "inputs": [ + "sin" + ], + "output": "unsqueeze_98", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_97", + "inputs": [ + "select_57", + "unsqueeze_97" + ], + "output": "mul_97", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_134", + "inputs": [ + "select_57" + ], + "output": "slice_134", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_135", + "inputs": [ + "select_57" + ], + "output": "slice_135", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_38", + "inputs": [ + "slice_135" + ], + "output": "neg_38", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_58", + "inputs": [ + "neg_38", + "slice_134" + ], + "output": "cat_58", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_98", + "inputs": [ + "cat_58", + "unsqueeze_98" + ], + "output": "mul_98", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_77", + "inputs": [ + "mul_97", + "mul_98" + ], + "output": "add_77", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_99", + "inputs": [ + "select_58", + "unsqueeze_97" + ], + "output": "mul_99", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_136", + "inputs": [ + "select_58" + ], + "output": "slice_136", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_137", + "inputs": [ + "select_58" + ], + "output": "slice_137", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_39", + "inputs": [ + "slice_137" + ], + "output": "neg_39", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_59", + "inputs": [ + "neg_39", + "slice_136" + ], + "output": "cat_59", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_100", + "inputs": [ + "cat_59", + "unsqueeze_98" + ], + "output": "mul_100", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_78", + "inputs": [ + "mul_99", + "mul_100" + ], + "output": "add_78", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_95", + "inputs": [ + "add_77" + ], + "output": "transpose_95", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_99", + "inputs": [ + "transpose_95" + ], + "output": "unsqueeze_99", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_96", + "inputs": [ + "add_78" + ], + "output": "transpose_96", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_100", + "inputs": [ + "transpose_96" + ], + "output": "unsqueeze_100", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_97", + "inputs": [ + "select_59" + ], + "output": "transpose_97", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_101", + "inputs": [ + "transpose_97" + ], + "output": "unsqueeze_101", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_138", + "inputs": [ + "unsqueeze_99" + ], + "output": "slice_138", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_139", + "inputs": [ + "unsqueeze_100" + ], + "output": "slice_139", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_140", + "inputs": [ + "unsqueeze_101" + ], + "output": "slice_140", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_98", + "inputs": [ + "slice_139" + ], + "output": "transpose_98", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_38", + "inputs": [ + "slice_138", + "transpose_98" + ], + "output": "matmul_38", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_101", + "inputs": [ + "matmul_38" + ], + "output": "mul_101", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_19", + "inputs": [ + "mul_101" + ], + "output": "softmax_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_39", + "inputs": [ + "softmax_19", + "slice_140" + ], + "output": "matmul_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_99", + "inputs": [ + "matmul_39" + ], + "output": "transpose_99", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_19", + "inputs": [ + "transpose_99" + ], + "output": "clone_19", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_60", + "inputs": [ + "clone_19" + ], + "output": "cat_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_44", + "inputs": [ + "cat_60" + ], + "output": "view_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_77", + "inputs": [ + "view_44", + "p_visual_blocks_19_attn_proj_weight", + "p_visual_blocks_19_attn_proj_bias" + ], + "output": "linear_77", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_79", + "inputs": [ + "add_76", + "linear_77" + ], + "output": "add_79", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_39", + "inputs": [ + "add_79", + "p_visual_blocks_19_norm2_weight", + "p_visual_blocks_19_norm2_bias" + ], + "output": "layer_norm_39", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_78", + "inputs": [ + "layer_norm_39", + "p_visual_blocks_19_mlp_linear_fc1_weight", + "p_visual_blocks_19_mlp_linear_fc1_bias" + ], + "output": "linear_78", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_19", + "inputs": [ + "linear_78" + ], + "output": "gelu_19", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_79", + "inputs": [ + "gelu_19", + "p_visual_blocks_19_mlp_linear_fc2_weight", + "p_visual_blocks_19_mlp_linear_fc2_bias" + ], + "output": "linear_79", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_80", + "inputs": [ + "add_79", + "linear_79" + ], + "output": "add_80", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_40", + "inputs": [ + "add_80", + "p_visual_blocks_20_norm1_weight", + "p_visual_blocks_20_norm1_bias" + ], + "output": "layer_norm_40", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_80", + "inputs": [ + "layer_norm_40", + "p_visual_blocks_20_attn_qkv_weight", + "p_visual_blocks_20_attn_qkv_bias" + ], + "output": "linear_80", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_45", + "inputs": [ + "linear_80" + ], + "output": "view_45", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_20", + "inputs": [ + "view_45" + ], + "output": "permute_20", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_60", + "inputs": [ + "permute_20" + ], + "output": "select_60", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_61", + "inputs": [ + "permute_20" + ], + "output": "select_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_62", + "inputs": [ + "permute_20" + ], + "output": "select_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_102", + "inputs": [ + "cos" + ], + "output": "unsqueeze_102", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_103", + "inputs": [ + "sin" + ], + "output": "unsqueeze_103", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_102", + "inputs": [ + "select_60", + "unsqueeze_102" + ], + "output": "mul_102", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_141", + "inputs": [ + "select_60" + ], + "output": "slice_141", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_142", + "inputs": [ + "select_60" + ], + "output": "slice_142", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_40", + "inputs": [ + "slice_142" + ], + "output": "neg_40", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_61", + "inputs": [ + "neg_40", + "slice_141" + ], + "output": "cat_61", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_103", + "inputs": [ + "cat_61", + "unsqueeze_103" + ], + "output": "mul_103", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_81", + "inputs": [ + "mul_102", + "mul_103" + ], + "output": "add_81", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_104", + "inputs": [ + "select_61", + "unsqueeze_102" + ], + "output": "mul_104", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_143", + "inputs": [ + "select_61" + ], + "output": "slice_143", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_144", + "inputs": [ + "select_61" + ], + "output": "slice_144", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_41", + "inputs": [ + "slice_144" + ], + "output": "neg_41", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_62", + "inputs": [ + "neg_41", + "slice_143" + ], + "output": "cat_62", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_105", + "inputs": [ + "cat_62", + "unsqueeze_103" + ], + "output": "mul_105", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_82", + "inputs": [ + "mul_104", + "mul_105" + ], + "output": "add_82", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_100", + "inputs": [ + "add_81" + ], + "output": "transpose_100", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_104", + "inputs": [ + "transpose_100" + ], + "output": "unsqueeze_104", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_101", + "inputs": [ + "add_82" + ], + "output": "transpose_101", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_105", + "inputs": [ + "transpose_101" + ], + "output": "unsqueeze_105", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_102", + "inputs": [ + "select_62" + ], + "output": "transpose_102", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_106", + "inputs": [ + "transpose_102" + ], + "output": "unsqueeze_106", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_145", + "inputs": [ + "unsqueeze_104" + ], + "output": "slice_145", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_146", + "inputs": [ + "unsqueeze_105" + ], + "output": "slice_146", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_147", + "inputs": [ + "unsqueeze_106" + ], + "output": "slice_147", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_103", + "inputs": [ + "slice_146" + ], + "output": "transpose_103", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_40", + "inputs": [ + "slice_145", + "transpose_103" + ], + "output": "matmul_40", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_106", + "inputs": [ + "matmul_40" + ], + "output": "mul_106", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_20", + "inputs": [ + "mul_106" + ], + "output": "softmax_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_41", + "inputs": [ + "softmax_20", + "slice_147" + ], + "output": "matmul_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_104", + "inputs": [ + "matmul_41" + ], + "output": "transpose_104", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_20", + "inputs": [ + "transpose_104" + ], + "output": "clone_20", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_63", + "inputs": [ + "clone_20" + ], + "output": "cat_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_46", + "inputs": [ + "cat_63" + ], + "output": "view_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_81", + "inputs": [ + "view_46", + "p_visual_blocks_20_attn_proj_weight", + "p_visual_blocks_20_attn_proj_bias" + ], + "output": "linear_81", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_83", + "inputs": [ + "add_80", + "linear_81" + ], + "output": "add_83", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_41", + "inputs": [ + "add_83", + "p_visual_blocks_20_norm2_weight", + "p_visual_blocks_20_norm2_bias" + ], + "output": "layer_norm_41", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_82", + "inputs": [ + "layer_norm_41", + "p_visual_blocks_20_mlp_linear_fc1_weight", + "p_visual_blocks_20_mlp_linear_fc1_bias" + ], + "output": "linear_82", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_20", + "inputs": [ + "linear_82" + ], + "output": "gelu_20", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_83", + "inputs": [ + "gelu_20", + "p_visual_blocks_20_mlp_linear_fc2_weight", + "p_visual_blocks_20_mlp_linear_fc2_bias" + ], + "output": "linear_83", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_84", + "inputs": [ + "add_83", + "linear_83" + ], + "output": "add_84", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_42", + "inputs": [ + "add_84", + "p_visual_blocks_21_norm1_weight", + "p_visual_blocks_21_norm1_bias" + ], + "output": "layer_norm_42", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_84", + "inputs": [ + "layer_norm_42", + "p_visual_blocks_21_attn_qkv_weight", + "p_visual_blocks_21_attn_qkv_bias" + ], + "output": "linear_84", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_47", + "inputs": [ + "linear_84" + ], + "output": "view_47", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_21", + "inputs": [ + "view_47" + ], + "output": "permute_21", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_63", + "inputs": [ + "permute_21" + ], + "output": "select_63", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_64", + "inputs": [ + "permute_21" + ], + "output": "select_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_65", + "inputs": [ + "permute_21" + ], + "output": "select_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_107", + "inputs": [ + "cos" + ], + "output": "unsqueeze_107", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_108", + "inputs": [ + "sin" + ], + "output": "unsqueeze_108", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_107", + "inputs": [ + "select_63", + "unsqueeze_107" + ], + "output": "mul_107", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_148", + "inputs": [ + "select_63" + ], + "output": "slice_148", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_149", + "inputs": [ + "select_63" + ], + "output": "slice_149", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_42", + "inputs": [ + "slice_149" + ], + "output": "neg_42", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_64", + "inputs": [ + "neg_42", + "slice_148" + ], + "output": "cat_64", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_108", + "inputs": [ + "cat_64", + "unsqueeze_108" + ], + "output": "mul_108", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_85", + "inputs": [ + "mul_107", + "mul_108" + ], + "output": "add_85", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_109", + "inputs": [ + "select_64", + "unsqueeze_107" + ], + "output": "mul_109", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_150", + "inputs": [ + "select_64" + ], + "output": "slice_150", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_151", + "inputs": [ + "select_64" + ], + "output": "slice_151", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_43", + "inputs": [ + "slice_151" + ], + "output": "neg_43", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_65", + "inputs": [ + "neg_43", + "slice_150" + ], + "output": "cat_65", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_110", + "inputs": [ + "cat_65", + "unsqueeze_108" + ], + "output": "mul_110", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_86", + "inputs": [ + "mul_109", + "mul_110" + ], + "output": "add_86", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_105", + "inputs": [ + "add_85" + ], + "output": "transpose_105", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_109", + "inputs": [ + "transpose_105" + ], + "output": "unsqueeze_109", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_106", + "inputs": [ + "add_86" + ], + "output": "transpose_106", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_110", + "inputs": [ + "transpose_106" + ], + "output": "unsqueeze_110", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_107", + "inputs": [ + "select_65" + ], + "output": "transpose_107", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_111", + "inputs": [ + "transpose_107" + ], + "output": "unsqueeze_111", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_152", + "inputs": [ + "unsqueeze_109" + ], + "output": "slice_152", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_153", + "inputs": [ + "unsqueeze_110" + ], + "output": "slice_153", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_154", + "inputs": [ + "unsqueeze_111" + ], + "output": "slice_154", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_108", + "inputs": [ + "slice_153" + ], + "output": "transpose_108", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_42", + "inputs": [ + "slice_152", + "transpose_108" + ], + "output": "matmul_42", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_111", + "inputs": [ + "matmul_42" + ], + "output": "mul_111", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_21", + "inputs": [ + "mul_111" + ], + "output": "softmax_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_43", + "inputs": [ + "softmax_21", + "slice_154" + ], + "output": "matmul_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_109", + "inputs": [ + "matmul_43" + ], + "output": "transpose_109", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_21", + "inputs": [ + "transpose_109" + ], + "output": "clone_21", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_66", + "inputs": [ + "clone_21" + ], + "output": "cat_66", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_48", + "inputs": [ + "cat_66" + ], + "output": "view_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_85", + "inputs": [ + "view_48", + "p_visual_blocks_21_attn_proj_weight", + "p_visual_blocks_21_attn_proj_bias" + ], + "output": "linear_85", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_87", + "inputs": [ + "add_84", + "linear_85" + ], + "output": "add_87", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_43", + "inputs": [ + "add_87", + "p_visual_blocks_21_norm2_weight", + "p_visual_blocks_21_norm2_bias" + ], + "output": "layer_norm_43", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_86", + "inputs": [ + "layer_norm_43", + "p_visual_blocks_21_mlp_linear_fc1_weight", + "p_visual_blocks_21_mlp_linear_fc1_bias" + ], + "output": "linear_86", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_21", + "inputs": [ + "linear_86" + ], + "output": "gelu_21", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_87", + "inputs": [ + "gelu_21", + "p_visual_blocks_21_mlp_linear_fc2_weight", + "p_visual_blocks_21_mlp_linear_fc2_bias" + ], + "output": "linear_87", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_88", + "inputs": [ + "add_87", + "linear_87" + ], + "output": "add_88", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_44", + "inputs": [ + "add_88", + "p_visual_blocks_22_norm1_weight", + "p_visual_blocks_22_norm1_bias" + ], + "output": "layer_norm_44", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_88", + "inputs": [ + "layer_norm_44", + "p_visual_blocks_22_attn_qkv_weight", + "p_visual_blocks_22_attn_qkv_bias" + ], + "output": "linear_88", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_49", + "inputs": [ + "linear_88" + ], + "output": "view_49", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_22", + "inputs": [ + "view_49" + ], + "output": "permute_22", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_66", + "inputs": [ + "permute_22" + ], + "output": "select_66", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_67", + "inputs": [ + "permute_22" + ], + "output": "select_67", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_68", + "inputs": [ + "permute_22" + ], + "output": "select_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_112", + "inputs": [ + "cos" + ], + "output": "unsqueeze_112", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_113", + "inputs": [ + "sin" + ], + "output": "unsqueeze_113", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_112", + "inputs": [ + "select_66", + "unsqueeze_112" + ], + "output": "mul_112", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_155", + "inputs": [ + "select_66" + ], + "output": "slice_155", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_156", + "inputs": [ + "select_66" + ], + "output": "slice_156", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_44", + "inputs": [ + "slice_156" + ], + "output": "neg_44", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_67", + "inputs": [ + "neg_44", + "slice_155" + ], + "output": "cat_67", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_113", + "inputs": [ + "cat_67", + "unsqueeze_113" + ], + "output": "mul_113", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_89", + "inputs": [ + "mul_112", + "mul_113" + ], + "output": "add_89", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_114", + "inputs": [ + "select_67", + "unsqueeze_112" + ], + "output": "mul_114", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_157", + "inputs": [ + "select_67" + ], + "output": "slice_157", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_158", + "inputs": [ + "select_67" + ], + "output": "slice_158", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_45", + "inputs": [ + "slice_158" + ], + "output": "neg_45", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_68", + "inputs": [ + "neg_45", + "slice_157" + ], + "output": "cat_68", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_115", + "inputs": [ + "cat_68", + "unsqueeze_113" + ], + "output": "mul_115", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_90", + "inputs": [ + "mul_114", + "mul_115" + ], + "output": "add_90", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_110", + "inputs": [ + "add_89" + ], + "output": "transpose_110", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_114", + "inputs": [ + "transpose_110" + ], + "output": "unsqueeze_114", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_111", + "inputs": [ + "add_90" + ], + "output": "transpose_111", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_115", + "inputs": [ + "transpose_111" + ], + "output": "unsqueeze_115", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_112", + "inputs": [ + "select_68" + ], + "output": "transpose_112", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_116", + "inputs": [ + "transpose_112" + ], + "output": "unsqueeze_116", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_159", + "inputs": [ + "unsqueeze_114" + ], + "output": "slice_159", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_160", + "inputs": [ + "unsqueeze_115" + ], + "output": "slice_160", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_161", + "inputs": [ + "unsqueeze_116" + ], + "output": "slice_161", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_113", + "inputs": [ + "slice_160" + ], + "output": "transpose_113", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_44", + "inputs": [ + "slice_159", + "transpose_113" + ], + "output": "matmul_44", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_116", + "inputs": [ + "matmul_44" + ], + "output": "mul_116", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_22", + "inputs": [ + "mul_116" + ], + "output": "softmax_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_45", + "inputs": [ + "softmax_22", + "slice_161" + ], + "output": "matmul_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_114", + "inputs": [ + "matmul_45" + ], + "output": "transpose_114", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_22", + "inputs": [ + "transpose_114" + ], + "output": "clone_22", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_69", + "inputs": [ + "clone_22" + ], + "output": "cat_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_50", + "inputs": [ + "cat_69" + ], + "output": "view_50", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_89", + "inputs": [ + "view_50", + "p_visual_blocks_22_attn_proj_weight", + "p_visual_blocks_22_attn_proj_bias" + ], + "output": "linear_89", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_91", + "inputs": [ + "add_88", + "linear_89" + ], + "output": "add_91", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_45", + "inputs": [ + "add_91", + "p_visual_blocks_22_norm2_weight", + "p_visual_blocks_22_norm2_bias" + ], + "output": "layer_norm_45", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_90", + "inputs": [ + "layer_norm_45", + "p_visual_blocks_22_mlp_linear_fc1_weight", + "p_visual_blocks_22_mlp_linear_fc1_bias" + ], + "output": "linear_90", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_22", + "inputs": [ + "linear_90" + ], + "output": "gelu_22", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_91", + "inputs": [ + "gelu_22", + "p_visual_blocks_22_mlp_linear_fc2_weight", + "p_visual_blocks_22_mlp_linear_fc2_bias" + ], + "output": "linear_91", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_92", + "inputs": [ + "add_91", + "linear_91" + ], + "output": "add_92", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_46", + "inputs": [ + "add_92", + "p_visual_blocks_23_norm1_weight", + "p_visual_blocks_23_norm1_bias" + ], + "output": "layer_norm_46", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_92", + "inputs": [ + "layer_norm_46", + "p_visual_blocks_23_attn_qkv_weight", + "p_visual_blocks_23_attn_qkv_bias" + ], + "output": "linear_92", + "workgroups": [ + 384, + 124, + 1 + ], + "kernel": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl" + }, + { + "node": "view_51", + "inputs": [ + "linear_92" + ], + "output": "view_51", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl" + }, + { + "node": "permute_23", + "inputs": [ + "view_51" + ], + "output": "permute_23", + "workgroups": [ + 47424, + 1, + 1 + ], + "kernel": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl" + }, + { + "node": "select_69", + "inputs": [ + "permute_23" + ], + "output": "select_69", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl" + }, + { + "node": "select_70", + "inputs": [ + "permute_23" + ], + "output": "select_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl" + }, + { + "node": "select_71", + "inputs": [ + "permute_23" + ], + "output": "select_71", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl" + }, + { + "node": "unsqueeze_117", + "inputs": [ + "cos" + ], + "output": "unsqueeze_117", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "unsqueeze_118", + "inputs": [ + "sin" + ], + "output": "unsqueeze_118", + "workgroups": [ + 988, + 1, + 1 + ], + "kernel": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl" + }, + { + "node": "mul_117", + "inputs": [ + "select_69", + "unsqueeze_117" + ], + "output": "mul_117", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_162", + "inputs": [ + "select_69" + ], + "output": "slice_162", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_163", + "inputs": [ + "select_69" + ], + "output": "slice_163", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_46", + "inputs": [ + "slice_163" + ], + "output": "neg_46", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_70", + "inputs": [ + "neg_46", + "slice_162" + ], + "output": "cat_70", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_118", + "inputs": [ + "cat_70", + "unsqueeze_118" + ], + "output": "mul_118", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_93", + "inputs": [ + "mul_117", + "mul_118" + ], + "output": "add_93", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "mul_119", + "inputs": [ + "select_70", + "unsqueeze_117" + ], + "output": "mul_119", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "slice_164", + "inputs": [ + "select_70" + ], + "output": "slice_164", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl" + }, + { + "node": "slice_165", + "inputs": [ + "select_70" + ], + "output": "slice_165", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl" + }, + { + "node": "neg_47", + "inputs": [ + "slice_165" + ], + "output": "neg_47", + "workgroups": [ + 7904, + 1, + 1 + ], + "kernel": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl" + }, + { + "node": "cat_71", + "inputs": [ + "neg_47", + "slice_164" + ], + "output": "cat_71", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl" + }, + { + "node": "mul_120", + "inputs": [ + "cat_71", + "unsqueeze_118" + ], + "output": "mul_120", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl" + }, + { + "node": "add_94", + "inputs": [ + "mul_119", + "mul_120" + ], + "output": "add_94", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "transpose_115", + "inputs": [ + "add_93" + ], + "output": "transpose_115", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_119", + "inputs": [ + "transpose_115" + ], + "output": "unsqueeze_119", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_116", + "inputs": [ + "add_94" + ], + "output": "transpose_116", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_120", + "inputs": [ + "transpose_116" + ], + "output": "unsqueeze_120", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "transpose_117", + "inputs": [ + "select_71" + ], + "output": "transpose_117", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl" + }, + { + "node": "unsqueeze_121", + "inputs": [ + "transpose_117" + ], + "output": "unsqueeze_121", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "slice_166", + "inputs": [ + "unsqueeze_119" + ], + "output": "slice_166", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_167", + "inputs": [ + "unsqueeze_120" + ], + "output": "slice_167", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "slice_168", + "inputs": [ + "unsqueeze_121" + ], + "output": "slice_168", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl" + }, + { + "node": "transpose_118", + "inputs": [ + "slice_167" + ], + "output": "transpose_118", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl" + }, + { + "node": "matmul_46", + "inputs": [ + "slice_166", + "transpose_118" + ], + "output": "matmul_46", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl" + }, + { + "node": "mul_121", + "inputs": [ + "matmul_46" + ], + "output": "mul_121", + "workgroups": [ + 65535, + 4, + 1 + ], + "kernel": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl" + }, + { + "node": "softmax_23", + "inputs": [ + "mul_121" + ], + "output": "softmax_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl" + }, + { + "node": "matmul_47", + "inputs": [ + "softmax_23", + "slice_168" + ], + "output": "matmul_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl" + }, + { + "node": "transpose_119", + "inputs": [ + "matmul_47" + ], + "output": "transpose_119", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl" + }, + { + "node": "clone_23", + "inputs": [ + "transpose_119" + ], + "output": "clone_23", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "cat_72", + "inputs": [ + "clone_23" + ], + "output": "cat_72", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl" + }, + { + "node": "view_52", + "inputs": [ + "cat_72" + ], + "output": "view_52", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_93", + "inputs": [ + "view_52", + "p_visual_blocks_23_attn_proj_weight", + "p_visual_blocks_23_attn_proj_bias" + ], + "output": "linear_93", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl" + }, + { + "node": "add_95", + "inputs": [ + "add_92", + "linear_93" + ], + "output": "add_95", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_47", + "inputs": [ + "add_95", + "p_visual_blocks_23_norm2_weight", + "p_visual_blocks_23_norm2_bias" + ], + "output": "layer_norm_47", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "linear_94", + "inputs": [ + "layer_norm_47", + "p_visual_blocks_23_mlp_linear_fc1_weight", + "p_visual_blocks_23_mlp_linear_fc1_bias" + ], + "output": "linear_94", + "workgroups": [ + 512, + 124, + 1 + ], + "kernel": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl" + }, + { + "node": "gelu_23", + "inputs": [ + "linear_94" + ], + "output": "gelu_23", + "workgroups": [ + 63232, + 1, + 1 + ], + "kernel": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl" + }, + { + "node": "linear_95", + "inputs": [ + "gelu_23", + "p_visual_blocks_23_mlp_linear_fc2_weight", + "p_visual_blocks_23_mlp_linear_fc2_bias" + ], + "output": "linear_95", + "workgroups": [ + 128, + 124, + 1 + ], + "kernel": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl" + }, + { + "node": "add_96", + "inputs": [ + "add_95", + "linear_95" + ], + "output": "add_96", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl" + }, + { + "node": "layer_norm_48", + "inputs": [ + "add_96", + "p_visual_merger_norm_weight", + "p_visual_merger_norm_bias" + ], + "output": "layer_norm_48", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl" + }, + { + "node": "view_53", + "inputs": [ + "layer_norm_48" + ], + "output": "view_53", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl" + }, + { + "node": "linear_96", + "inputs": [ + "view_53", + "p_visual_merger_linear_fc1_weight", + "p_visual_merger_linear_fc1_bias" + ], + "output": "linear_96", + "workgroups": [ + 512, + 31, + 1 + ], + "kernel": "kernels/984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b.wgsl" + }, + { + "node": "gelu_24", + "inputs": [ + "linear_96" + ], + "output": "gelu_24", + "workgroups": [ + 15808, + 1, + 1 + ], + "kernel": "kernels/ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232.wgsl" + }, + { + "node": "linear_97", + "inputs": [ + "gelu_24", + "p_visual_merger_linear_fc2_weight", + "p_visual_merger_linear_fc2_bias" + ], + "output": "linear_97", + "workgroups": [ + 256, + 31, + 1 + ], + "kernel": "kernels/0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4.wgsl" + } + ], + "memory": { + "slots": [ + 6291456, + 4096, + 4718592, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 6291456, + 12288, + 2097152, + 4096, + 4096, + 4096, + 8388608, + 16384, + 8388608, + 4096, + 4096, + 4096, + 33554432, + 16384, + 16777216, + 8192, + 15808, + 15808, + 7904, + 64, + 6070272, + 6070272, + 4046848, + 16187392, + 16187392, + 12140544, + 12140544, + 4046848, + 252928, + 4046848, + 2023424, + 2023424, + 4046848, + 62473216, + 62473216 + ], + "assignment": { + "p_visual_patch_embed_proj_weight": 0, + "p_visual_patch_embed_proj_bias": 1, + "p_visual_pos_embed_weight": 2, + "p_visual_blocks_0_norm1_weight": 3, + "p_visual_blocks_0_norm1_bias": 4, + "p_visual_blocks_0_attn_qkv_weight": 5, + "p_visual_blocks_0_attn_qkv_bias": 6, + "p_visual_blocks_0_attn_proj_weight": 7, + "p_visual_blocks_0_attn_proj_bias": 8, + "p_visual_blocks_0_norm2_weight": 9, + "p_visual_blocks_0_norm2_bias": 10, + "p_visual_blocks_0_mlp_linear_fc1_weight": 11, + "p_visual_blocks_0_mlp_linear_fc1_bias": 12, + "p_visual_blocks_0_mlp_linear_fc2_weight": 13, + "p_visual_blocks_0_mlp_linear_fc2_bias": 14, + "p_visual_blocks_1_norm1_weight": 15, + "p_visual_blocks_1_norm1_bias": 16, + "p_visual_blocks_1_attn_qkv_weight": 17, + "p_visual_blocks_1_attn_qkv_bias": 18, + "p_visual_blocks_1_attn_proj_weight": 19, + "p_visual_blocks_1_attn_proj_bias": 20, + "p_visual_blocks_1_norm2_weight": 21, + "p_visual_blocks_1_norm2_bias": 22, + "p_visual_blocks_1_mlp_linear_fc1_weight": 23, + "p_visual_blocks_1_mlp_linear_fc1_bias": 24, + "p_visual_blocks_1_mlp_linear_fc2_weight": 25, + "p_visual_blocks_1_mlp_linear_fc2_bias": 26, + "p_visual_blocks_2_norm1_weight": 27, + "p_visual_blocks_2_norm1_bias": 28, + "p_visual_blocks_2_attn_qkv_weight": 29, + "p_visual_blocks_2_attn_qkv_bias": 30, + "p_visual_blocks_2_attn_proj_weight": 31, + "p_visual_blocks_2_attn_proj_bias": 32, + "p_visual_blocks_2_norm2_weight": 33, + "p_visual_blocks_2_norm2_bias": 34, + "p_visual_blocks_2_mlp_linear_fc1_weight": 35, + "p_visual_blocks_2_mlp_linear_fc1_bias": 36, + "p_visual_blocks_2_mlp_linear_fc2_weight": 37, + "p_visual_blocks_2_mlp_linear_fc2_bias": 38, + "p_visual_blocks_3_norm1_weight": 39, + "p_visual_blocks_3_norm1_bias": 40, + "p_visual_blocks_3_attn_qkv_weight": 41, + "p_visual_blocks_3_attn_qkv_bias": 42, + "p_visual_blocks_3_attn_proj_weight": 43, + "p_visual_blocks_3_attn_proj_bias": 44, + "p_visual_blocks_3_norm2_weight": 45, + "p_visual_blocks_3_norm2_bias": 46, + "p_visual_blocks_3_mlp_linear_fc1_weight": 47, + "p_visual_blocks_3_mlp_linear_fc1_bias": 48, + "p_visual_blocks_3_mlp_linear_fc2_weight": 49, + "p_visual_blocks_3_mlp_linear_fc2_bias": 50, + "p_visual_blocks_4_norm1_weight": 51, + "p_visual_blocks_4_norm1_bias": 52, + "p_visual_blocks_4_attn_qkv_weight": 53, + "p_visual_blocks_4_attn_qkv_bias": 54, + "p_visual_blocks_4_attn_proj_weight": 55, + "p_visual_blocks_4_attn_proj_bias": 56, + "p_visual_blocks_4_norm2_weight": 57, + "p_visual_blocks_4_norm2_bias": 58, + "p_visual_blocks_4_mlp_linear_fc1_weight": 59, + "p_visual_blocks_4_mlp_linear_fc1_bias": 60, + "p_visual_blocks_4_mlp_linear_fc2_weight": 61, + "p_visual_blocks_4_mlp_linear_fc2_bias": 62, + "p_visual_blocks_5_norm1_weight": 63, + "p_visual_blocks_5_norm1_bias": 64, + "p_visual_blocks_5_attn_qkv_weight": 65, + "p_visual_blocks_5_attn_qkv_bias": 66, + "p_visual_blocks_5_attn_proj_weight": 67, + "p_visual_blocks_5_attn_proj_bias": 68, + "p_visual_blocks_5_norm2_weight": 69, + "p_visual_blocks_5_norm2_bias": 70, + "p_visual_blocks_5_mlp_linear_fc1_weight": 71, + "p_visual_blocks_5_mlp_linear_fc1_bias": 72, + "p_visual_blocks_5_mlp_linear_fc2_weight": 73, + "p_visual_blocks_5_mlp_linear_fc2_bias": 74, + "p_visual_blocks_6_norm1_weight": 75, + "p_visual_blocks_6_norm1_bias": 76, + "p_visual_blocks_6_attn_qkv_weight": 77, + "p_visual_blocks_6_attn_qkv_bias": 78, + "p_visual_blocks_6_attn_proj_weight": 79, + "p_visual_blocks_6_attn_proj_bias": 80, + "p_visual_blocks_6_norm2_weight": 81, + "p_visual_blocks_6_norm2_bias": 82, + "p_visual_blocks_6_mlp_linear_fc1_weight": 83, + "p_visual_blocks_6_mlp_linear_fc1_bias": 84, + "p_visual_blocks_6_mlp_linear_fc2_weight": 85, + "p_visual_blocks_6_mlp_linear_fc2_bias": 86, + "p_visual_blocks_7_norm1_weight": 87, + "p_visual_blocks_7_norm1_bias": 88, + "p_visual_blocks_7_attn_qkv_weight": 89, + "p_visual_blocks_7_attn_qkv_bias": 90, + "p_visual_blocks_7_attn_proj_weight": 91, + "p_visual_blocks_7_attn_proj_bias": 92, + "p_visual_blocks_7_norm2_weight": 93, + "p_visual_blocks_7_norm2_bias": 94, + "p_visual_blocks_7_mlp_linear_fc1_weight": 95, + "p_visual_blocks_7_mlp_linear_fc1_bias": 96, + "p_visual_blocks_7_mlp_linear_fc2_weight": 97, + "p_visual_blocks_7_mlp_linear_fc2_bias": 98, + "p_visual_blocks_8_norm1_weight": 99, + "p_visual_blocks_8_norm1_bias": 100, + "p_visual_blocks_8_attn_qkv_weight": 101, + "p_visual_blocks_8_attn_qkv_bias": 102, + "p_visual_blocks_8_attn_proj_weight": 103, + "p_visual_blocks_8_attn_proj_bias": 104, + "p_visual_blocks_8_norm2_weight": 105, + "p_visual_blocks_8_norm2_bias": 106, + "p_visual_blocks_8_mlp_linear_fc1_weight": 107, + "p_visual_blocks_8_mlp_linear_fc1_bias": 108, + "p_visual_blocks_8_mlp_linear_fc2_weight": 109, + "p_visual_blocks_8_mlp_linear_fc2_bias": 110, + "p_visual_blocks_9_norm1_weight": 111, + "p_visual_blocks_9_norm1_bias": 112, + "p_visual_blocks_9_attn_qkv_weight": 113, + "p_visual_blocks_9_attn_qkv_bias": 114, + "p_visual_blocks_9_attn_proj_weight": 115, + "p_visual_blocks_9_attn_proj_bias": 116, + "p_visual_blocks_9_norm2_weight": 117, + "p_visual_blocks_9_norm2_bias": 118, + "p_visual_blocks_9_mlp_linear_fc1_weight": 119, + "p_visual_blocks_9_mlp_linear_fc1_bias": 120, + "p_visual_blocks_9_mlp_linear_fc2_weight": 121, + "p_visual_blocks_9_mlp_linear_fc2_bias": 122, + "p_visual_blocks_10_norm1_weight": 123, + "p_visual_blocks_10_norm1_bias": 124, + "p_visual_blocks_10_attn_qkv_weight": 125, + "p_visual_blocks_10_attn_qkv_bias": 126, + "p_visual_blocks_10_attn_proj_weight": 127, + "p_visual_blocks_10_attn_proj_bias": 128, + "p_visual_blocks_10_norm2_weight": 129, + "p_visual_blocks_10_norm2_bias": 130, + "p_visual_blocks_10_mlp_linear_fc1_weight": 131, + "p_visual_blocks_10_mlp_linear_fc1_bias": 132, + "p_visual_blocks_10_mlp_linear_fc2_weight": 133, + "p_visual_blocks_10_mlp_linear_fc2_bias": 134, + "p_visual_blocks_11_norm1_weight": 135, + "p_visual_blocks_11_norm1_bias": 136, + "p_visual_blocks_11_attn_qkv_weight": 137, + "p_visual_blocks_11_attn_qkv_bias": 138, + "p_visual_blocks_11_attn_proj_weight": 139, + "p_visual_blocks_11_attn_proj_bias": 140, + "p_visual_blocks_11_norm2_weight": 141, + "p_visual_blocks_11_norm2_bias": 142, + "p_visual_blocks_11_mlp_linear_fc1_weight": 143, + "p_visual_blocks_11_mlp_linear_fc1_bias": 144, + "p_visual_blocks_11_mlp_linear_fc2_weight": 145, + "p_visual_blocks_11_mlp_linear_fc2_bias": 146, + "p_visual_blocks_12_norm1_weight": 147, + "p_visual_blocks_12_norm1_bias": 148, + "p_visual_blocks_12_attn_qkv_weight": 149, + "p_visual_blocks_12_attn_qkv_bias": 150, + "p_visual_blocks_12_attn_proj_weight": 151, + "p_visual_blocks_12_attn_proj_bias": 152, + "p_visual_blocks_12_norm2_weight": 153, + "p_visual_blocks_12_norm2_bias": 154, + "p_visual_blocks_12_mlp_linear_fc1_weight": 155, + "p_visual_blocks_12_mlp_linear_fc1_bias": 156, + "p_visual_blocks_12_mlp_linear_fc2_weight": 157, + "p_visual_blocks_12_mlp_linear_fc2_bias": 158, + "p_visual_blocks_13_norm1_weight": 159, + "p_visual_blocks_13_norm1_bias": 160, + "p_visual_blocks_13_attn_qkv_weight": 161, + "p_visual_blocks_13_attn_qkv_bias": 162, + "p_visual_blocks_13_attn_proj_weight": 163, + "p_visual_blocks_13_attn_proj_bias": 164, + "p_visual_blocks_13_norm2_weight": 165, + "p_visual_blocks_13_norm2_bias": 166, + "p_visual_blocks_13_mlp_linear_fc1_weight": 167, + "p_visual_blocks_13_mlp_linear_fc1_bias": 168, + "p_visual_blocks_13_mlp_linear_fc2_weight": 169, + "p_visual_blocks_13_mlp_linear_fc2_bias": 170, + "p_visual_blocks_14_norm1_weight": 171, + "p_visual_blocks_14_norm1_bias": 172, + "p_visual_blocks_14_attn_qkv_weight": 173, + "p_visual_blocks_14_attn_qkv_bias": 174, + "p_visual_blocks_14_attn_proj_weight": 175, + "p_visual_blocks_14_attn_proj_bias": 176, + "p_visual_blocks_14_norm2_weight": 177, + "p_visual_blocks_14_norm2_bias": 178, + "p_visual_blocks_14_mlp_linear_fc1_weight": 179, + "p_visual_blocks_14_mlp_linear_fc1_bias": 180, + "p_visual_blocks_14_mlp_linear_fc2_weight": 181, + "p_visual_blocks_14_mlp_linear_fc2_bias": 182, + "p_visual_blocks_15_norm1_weight": 183, + "p_visual_blocks_15_norm1_bias": 184, + "p_visual_blocks_15_attn_qkv_weight": 185, + "p_visual_blocks_15_attn_qkv_bias": 186, + "p_visual_blocks_15_attn_proj_weight": 187, + "p_visual_blocks_15_attn_proj_bias": 188, + "p_visual_blocks_15_norm2_weight": 189, + "p_visual_blocks_15_norm2_bias": 190, + "p_visual_blocks_15_mlp_linear_fc1_weight": 191, + "p_visual_blocks_15_mlp_linear_fc1_bias": 192, + "p_visual_blocks_15_mlp_linear_fc2_weight": 193, + "p_visual_blocks_15_mlp_linear_fc2_bias": 194, + "p_visual_blocks_16_norm1_weight": 195, + "p_visual_blocks_16_norm1_bias": 196, + "p_visual_blocks_16_attn_qkv_weight": 197, + "p_visual_blocks_16_attn_qkv_bias": 198, + "p_visual_blocks_16_attn_proj_weight": 199, + "p_visual_blocks_16_attn_proj_bias": 200, + "p_visual_blocks_16_norm2_weight": 201, + "p_visual_blocks_16_norm2_bias": 202, + "p_visual_blocks_16_mlp_linear_fc1_weight": 203, + "p_visual_blocks_16_mlp_linear_fc1_bias": 204, + "p_visual_blocks_16_mlp_linear_fc2_weight": 205, + "p_visual_blocks_16_mlp_linear_fc2_bias": 206, + "p_visual_blocks_17_norm1_weight": 207, + "p_visual_blocks_17_norm1_bias": 208, + "p_visual_blocks_17_attn_qkv_weight": 209, + "p_visual_blocks_17_attn_qkv_bias": 210, + "p_visual_blocks_17_attn_proj_weight": 211, + "p_visual_blocks_17_attn_proj_bias": 212, + "p_visual_blocks_17_norm2_weight": 213, + "p_visual_blocks_17_norm2_bias": 214, + "p_visual_blocks_17_mlp_linear_fc1_weight": 215, + "p_visual_blocks_17_mlp_linear_fc1_bias": 216, + "p_visual_blocks_17_mlp_linear_fc2_weight": 217, + "p_visual_blocks_17_mlp_linear_fc2_bias": 218, + "p_visual_blocks_18_norm1_weight": 219, + "p_visual_blocks_18_norm1_bias": 220, + "p_visual_blocks_18_attn_qkv_weight": 221, + "p_visual_blocks_18_attn_qkv_bias": 222, + "p_visual_blocks_18_attn_proj_weight": 223, + "p_visual_blocks_18_attn_proj_bias": 224, + "p_visual_blocks_18_norm2_weight": 225, + "p_visual_blocks_18_norm2_bias": 226, + "p_visual_blocks_18_mlp_linear_fc1_weight": 227, + "p_visual_blocks_18_mlp_linear_fc1_bias": 228, + "p_visual_blocks_18_mlp_linear_fc2_weight": 229, + "p_visual_blocks_18_mlp_linear_fc2_bias": 230, + "p_visual_blocks_19_norm1_weight": 231, + "p_visual_blocks_19_norm1_bias": 232, + "p_visual_blocks_19_attn_qkv_weight": 233, + "p_visual_blocks_19_attn_qkv_bias": 234, + "p_visual_blocks_19_attn_proj_weight": 235, + "p_visual_blocks_19_attn_proj_bias": 236, + "p_visual_blocks_19_norm2_weight": 237, + "p_visual_blocks_19_norm2_bias": 238, + "p_visual_blocks_19_mlp_linear_fc1_weight": 239, + "p_visual_blocks_19_mlp_linear_fc1_bias": 240, + "p_visual_blocks_19_mlp_linear_fc2_weight": 241, + "p_visual_blocks_19_mlp_linear_fc2_bias": 242, + "p_visual_blocks_20_norm1_weight": 243, + "p_visual_blocks_20_norm1_bias": 244, + "p_visual_blocks_20_attn_qkv_weight": 245, + "p_visual_blocks_20_attn_qkv_bias": 246, + "p_visual_blocks_20_attn_proj_weight": 247, + "p_visual_blocks_20_attn_proj_bias": 248, + "p_visual_blocks_20_norm2_weight": 249, + "p_visual_blocks_20_norm2_bias": 250, + "p_visual_blocks_20_mlp_linear_fc1_weight": 251, + "p_visual_blocks_20_mlp_linear_fc1_bias": 252, + "p_visual_blocks_20_mlp_linear_fc2_weight": 253, + "p_visual_blocks_20_mlp_linear_fc2_bias": 254, + "p_visual_blocks_21_norm1_weight": 255, + "p_visual_blocks_21_norm1_bias": 256, + "p_visual_blocks_21_attn_qkv_weight": 257, + "p_visual_blocks_21_attn_qkv_bias": 258, + "p_visual_blocks_21_attn_proj_weight": 259, + "p_visual_blocks_21_attn_proj_bias": 260, + "p_visual_blocks_21_norm2_weight": 261, + "p_visual_blocks_21_norm2_bias": 262, + "p_visual_blocks_21_mlp_linear_fc1_weight": 263, + "p_visual_blocks_21_mlp_linear_fc1_bias": 264, + "p_visual_blocks_21_mlp_linear_fc2_weight": 265, + "p_visual_blocks_21_mlp_linear_fc2_bias": 266, + "p_visual_blocks_22_norm1_weight": 267, + "p_visual_blocks_22_norm1_bias": 268, + "p_visual_blocks_22_attn_qkv_weight": 269, + "p_visual_blocks_22_attn_qkv_bias": 270, + "p_visual_blocks_22_attn_proj_weight": 271, + "p_visual_blocks_22_attn_proj_bias": 272, + "p_visual_blocks_22_norm2_weight": 273, + "p_visual_blocks_22_norm2_bias": 274, + "p_visual_blocks_22_mlp_linear_fc1_weight": 275, + "p_visual_blocks_22_mlp_linear_fc1_bias": 276, + "p_visual_blocks_22_mlp_linear_fc2_weight": 277, + "p_visual_blocks_22_mlp_linear_fc2_bias": 278, + "p_visual_blocks_23_norm1_weight": 279, + "p_visual_blocks_23_norm1_bias": 280, + "p_visual_blocks_23_attn_qkv_weight": 281, + "p_visual_blocks_23_attn_qkv_bias": 282, + "p_visual_blocks_23_attn_proj_weight": 283, + "p_visual_blocks_23_attn_proj_bias": 284, + "p_visual_blocks_23_norm2_weight": 285, + "p_visual_blocks_23_norm2_bias": 286, + "p_visual_blocks_23_mlp_linear_fc1_weight": 287, + "p_visual_blocks_23_mlp_linear_fc1_bias": 288, + "p_visual_blocks_23_mlp_linear_fc2_weight": 289, + "p_visual_blocks_23_mlp_linear_fc2_bias": 290, + "p_visual_merger_norm_weight": 291, + "p_visual_merger_norm_bias": 292, + "p_visual_merger_linear_fc1_weight": 293, + "p_visual_merger_linear_fc1_bias": 294, + "p_visual_merger_linear_fc2_weight": 295, + "p_visual_merger_linear_fc2_bias": 296, + "b_indices": 297, + "b_interpolation_weights": 298, + "b_positions": 299, + "b_visual_rotary_pos_emb_inv_freq": 300, + "pixels": 301, + "view": 302, + "conv3d": 303, + "view_1": 302, + "embedding": 304, + "unsqueeze": 303, + "mul": 305, + "sum_1": 303, + "add": 304, + "unsqueeze_1": 303, + "mul_1": 302, + "view_2": 303, + "view_3": 302, + "view_4": 305, + "cat": 303, + "cos": 304, + "sin": 305, + "layer_norm": 303, + "linear": 306, + "view_5": 307, + "permute": 306, + "select": 303, + "select_1": 307, + "select_2": 308, + "unsqueeze_2": 306, + "unsqueeze_3": 309, + "mul_2": 310, + "slice_1": 311, + "slice_2": 312, + "neg": 303, + "cat_1": 313, + "mul_3": 303, + "add_1": 313, + "mul_4": 310, + "slice_3": 312, + "slice_4": 311, + "neg_1": 303, + "cat_2": 306, + "mul_5": 303, + "add_2": 307, + "transpose": 310, + "unsqueeze_4": 303, + "transpose_1": 313, + "unsqueeze_5": 310, + "transpose_2": 313, + "unsqueeze_6": 308, + "slice_5": 313, + "slice_6": 303, + "slice_7": 310, + "transpose_3": 308, + "matmul": 314, + "mul_6": 315, + "softmax": 314, + "matmul_1": 303, + "transpose_4": 313, + "clone": 308, + "cat_3": 310, + "view_6": 303, + "linear_1": 313, + "add_3": 308, + "layer_norm_1": 310, + "linear_2": 315, + "gelu": 314, + "linear_3": 303, + "add_4": 313, + "layer_norm_2": 310, + "linear_4": 306, + "view_7": 307, + "permute_1": 306, + "select_3": 308, + "select_4": 303, + "select_5": 310, + "unsqueeze_7": 309, + "unsqueeze_8": 311, + "mul_7": 302, + "slice_8": 312, + "slice_9": 307, + "neg_2": 308, + "cat_4": 306, + "mul_8": 308, + "add_5": 307, + "mul_9": 308, + "slice_10": 312, + "slice_11": 302, + "neg_3": 303, + "cat_5": 302, + "mul_10": 303, + "add_6": 302, + "transpose_5": 308, + "unsqueeze_9": 303, + "transpose_6": 308, + "unsqueeze_10": 302, + "transpose_7": 308, + "unsqueeze_11": 310, + "slice_12": 308, + "slice_13": 303, + "slice_14": 302, + "transpose_8": 310, + "matmul_2": 315, + "mul_11": 314, + "softmax_1": 315, + "matmul_3": 303, + "transpose_9": 308, + "clone_1": 310, + "cat_6": 303, + "view_8": 308, + "linear_5": 310, + "add_7": 303, + "layer_norm_3": 308, + "linear_6": 314, + "gelu_1": 315, + "linear_7": 313, + "add_8": 310, + "layer_norm_4": 308, + "linear_8": 306, + "view_9": 307, + "permute_2": 306, + "select_6": 303, + "select_7": 313, + "select_8": 308, + "unsqueeze_12": 309, + "unsqueeze_13": 312, + "mul_12": 302, + "slice_15": 311, + "slice_16": 307, + "neg_4": 303, + "cat_7": 306, + "mul_13": 303, + "add_9": 307, + "mul_14": 303, + "slice_17": 311, + "slice_18": 302, + "neg_5": 313, + "cat_8": 302, + "mul_15": 313, + "add_10": 302, + "transpose_10": 303, + "unsqueeze_14": 313, + "transpose_11": 303, + "unsqueeze_15": 302, + "transpose_12": 303, + "unsqueeze_16": 308, + "slice_19": 303, + "slice_20": 313, + "slice_21": 302, + "transpose_13": 308, + "matmul_4": 314, + "mul_16": 315, + "softmax_2": 314, + "matmul_5": 313, + "transpose_14": 303, + "clone_2": 308, + "cat_9": 313, + "view_10": 303, + "linear_9": 308, + "add_11": 313, + "layer_norm_5": 303, + "linear_10": 315, + "gelu_2": 314, + "linear_11": 310, + "add_12": 308, + "layer_norm_6": 303, + "linear_12": 306, + "view_11": 307, + "permute_3": 306, + "select_9": 313, + "select_10": 310, + "select_11": 303, + "unsqueeze_17": 309, + "unsqueeze_18": 311, + "mul_17": 302, + "slice_22": 312, + "slice_23": 307, + "neg_6": 313, + "cat_10": 306, + "mul_18": 313, + "add_13": 307, + "mul_19": 313, + "slice_24": 312, + "slice_25": 302, + "neg_7": 310, + "cat_11": 302, + "mul_20": 310, + "add_14": 302, + "transpose_15": 313, + "unsqueeze_19": 310, + "transpose_16": 313, + "unsqueeze_20": 302, + "transpose_17": 313, + "unsqueeze_21": 303, + "slice_26": 313, + "slice_27": 310, + "slice_28": 302, + "transpose_18": 303, + "matmul_6": 315, + "mul_21": 314, + "softmax_3": 315, + "matmul_7": 310, + "transpose_19": 313, + "clone_3": 303, + "cat_12": 310, + "view_12": 313, + "linear_13": 303, + "add_15": 310, + "layer_norm_7": 313, + "linear_14": 314, + "gelu_3": 315, + "linear_15": 308, + "add_16": 303, + "layer_norm_8": 313, + "linear_16": 306, + "view_13": 307, + "permute_4": 306, + "select_12": 310, + "select_13": 308, + "select_14": 313, + "unsqueeze_22": 309, + "unsqueeze_23": 312, + "mul_22": 302, + "slice_29": 311, + "slice_30": 307, + "neg_8": 310, + "cat_13": 306, + "mul_23": 310, + "add_17": 307, + "mul_24": 310, + "slice_31": 311, + "slice_32": 302, + "neg_9": 308, + "cat_14": 302, + "mul_25": 308, + "add_18": 302, + "transpose_20": 310, + "unsqueeze_24": 308, + "transpose_21": 310, + "unsqueeze_25": 302, + "transpose_22": 310, + "unsqueeze_26": 313, + "slice_33": 310, + "slice_34": 308, + "slice_35": 302, + "transpose_23": 313, + "matmul_8": 314, + "mul_26": 315, + "softmax_4": 314, + "matmul_9": 308, + "transpose_24": 310, + "clone_4": 313, + "cat_15": 308, + "view_14": 310, + "linear_17": 313, + "add_19": 308, + "layer_norm_9": 310, + "linear_18": 315, + "gelu_4": 314, + "linear_19": 303, + "add_20": 313, + "layer_norm_10": 310, + "linear_20": 306, + "view_15": 307, + "permute_5": 306, + "select_15": 308, + "select_16": 303, + "select_17": 310, + "unsqueeze_27": 309, + "unsqueeze_28": 311, + "mul_27": 302, + "slice_36": 312, + "slice_37": 307, + "neg_10": 308, + "cat_16": 306, + "mul_28": 308, + "add_21": 307, + "mul_29": 308, + "slice_38": 312, + "slice_39": 302, + "neg_11": 303, + "cat_17": 302, + "mul_30": 303, + "add_22": 302, + "transpose_25": 308, + "unsqueeze_29": 303, + "transpose_26": 308, + "unsqueeze_30": 302, + "transpose_27": 308, + "unsqueeze_31": 310, + "slice_40": 308, + "slice_41": 303, + "slice_42": 302, + "transpose_28": 310, + "matmul_10": 315, + "mul_31": 314, + "softmax_5": 315, + "matmul_11": 303, + "transpose_29": 308, + "clone_5": 310, + "cat_18": 303, + "view_16": 308, + "linear_21": 310, + "add_23": 303, + "layer_norm_11": 308, + "linear_22": 314, + "gelu_5": 315, + "linear_23": 313, + "add_24": 310, + "layer_norm_12": 308, + "linear_24": 306, + "view_17": 307, + "permute_6": 306, + "select_18": 303, + "select_19": 313, + "select_20": 308, + "unsqueeze_32": 309, + "unsqueeze_33": 312, + "mul_32": 302, + "slice_43": 311, + "slice_44": 307, + "neg_12": 303, + "cat_19": 306, + "mul_33": 303, + "add_25": 307, + "mul_34": 303, + "slice_45": 311, + "slice_46": 302, + "neg_13": 313, + "cat_20": 302, + "mul_35": 313, + "add_26": 302, + "transpose_30": 303, + "unsqueeze_34": 313, + "transpose_31": 303, + "unsqueeze_35": 302, + "transpose_32": 303, + "unsqueeze_36": 308, + "slice_47": 303, + "slice_48": 313, + "slice_49": 302, + "transpose_33": 308, + "matmul_12": 314, + "mul_36": 315, + "softmax_6": 314, + "matmul_13": 313, + "transpose_34": 303, + "clone_6": 308, + "cat_21": 313, + "view_18": 303, + "linear_25": 308, + "add_27": 313, + "layer_norm_13": 303, + "linear_26": 315, + "gelu_6": 314, + "linear_27": 310, + "add_28": 308, + "layer_norm_14": 303, + "linear_28": 306, + "view_19": 307, + "permute_7": 306, + "select_21": 313, + "select_22": 310, + "select_23": 303, + "unsqueeze_37": 309, + "unsqueeze_38": 311, + "mul_37": 302, + "slice_50": 312, + "slice_51": 307, + "neg_14": 313, + "cat_22": 306, + "mul_38": 313, + "add_29": 307, + "mul_39": 313, + "slice_52": 312, + "slice_53": 302, + "neg_15": 310, + "cat_23": 302, + "mul_40": 310, + "add_30": 302, + "transpose_35": 313, + "unsqueeze_39": 310, + "transpose_36": 313, + "unsqueeze_40": 302, + "transpose_37": 313, + "unsqueeze_41": 303, + "slice_54": 313, + "slice_55": 310, + "slice_56": 302, + "transpose_38": 303, + "matmul_14": 315, + "mul_41": 314, + "softmax_7": 315, + "matmul_15": 310, + "transpose_39": 313, + "clone_7": 303, + "cat_24": 310, + "view_20": 313, + "linear_29": 303, + "add_31": 310, + "layer_norm_15": 313, + "linear_30": 314, + "gelu_7": 315, + "linear_31": 308, + "add_32": 303, + "layer_norm_16": 313, + "linear_32": 306, + "view_21": 307, + "permute_8": 306, + "select_24": 310, + "select_25": 308, + "select_26": 313, + "unsqueeze_42": 309, + "unsqueeze_43": 312, + "mul_42": 302, + "slice_57": 311, + "slice_58": 307, + "neg_16": 310, + "cat_25": 306, + "mul_43": 310, + "add_33": 307, + "mul_44": 310, + "slice_59": 311, + "slice_60": 302, + "neg_17": 308, + "cat_26": 302, + "mul_45": 308, + "add_34": 302, + "transpose_40": 310, + "unsqueeze_44": 308, + "transpose_41": 310, + "unsqueeze_45": 302, + "transpose_42": 310, + "unsqueeze_46": 313, + "slice_61": 310, + "slice_62": 308, + "slice_63": 302, + "transpose_43": 313, + "matmul_16": 314, + "mul_46": 315, + "softmax_8": 314, + "matmul_17": 308, + "transpose_44": 310, + "clone_8": 313, + "cat_27": 308, + "view_22": 310, + "linear_33": 313, + "add_35": 308, + "layer_norm_17": 310, + "linear_34": 315, + "gelu_8": 314, + "linear_35": 303, + "add_36": 313, + "layer_norm_18": 310, + "linear_36": 306, + "view_23": 307, + "permute_9": 306, + "select_27": 308, + "select_28": 303, + "select_29": 310, + "unsqueeze_47": 309, + "unsqueeze_48": 311, + "mul_47": 302, + "slice_64": 312, + "slice_65": 307, + "neg_18": 308, + "cat_28": 306, + "mul_48": 308, + "add_37": 307, + "mul_49": 308, + "slice_66": 312, + "slice_67": 302, + "neg_19": 303, + "cat_29": 302, + "mul_50": 303, + "add_38": 302, + "transpose_45": 308, + "unsqueeze_49": 303, + "transpose_46": 308, + "unsqueeze_50": 302, + "transpose_47": 308, + "unsqueeze_51": 310, + "slice_68": 308, + "slice_69": 303, + "slice_70": 302, + "transpose_48": 310, + "matmul_18": 315, + "mul_51": 314, + "softmax_9": 315, + "matmul_19": 303, + "transpose_49": 308, + "clone_9": 310, + "cat_30": 303, + "view_24": 308, + "linear_37": 310, + "add_39": 303, + "layer_norm_19": 308, + "linear_38": 314, + "gelu_9": 315, + "linear_39": 313, + "add_40": 310, + "layer_norm_20": 308, + "linear_40": 306, + "view_25": 307, + "permute_10": 306, + "select_30": 303, + "select_31": 313, + "select_32": 308, + "unsqueeze_52": 309, + "unsqueeze_53": 312, + "mul_52": 302, + "slice_71": 311, + "slice_72": 307, + "neg_20": 303, + "cat_31": 306, + "mul_53": 303, + "add_41": 307, + "mul_54": 303, + "slice_73": 311, + "slice_74": 302, + "neg_21": 313, + "cat_32": 302, + "mul_55": 313, + "add_42": 302, + "transpose_50": 303, + "unsqueeze_54": 313, + "transpose_51": 303, + "unsqueeze_55": 302, + "transpose_52": 303, + "unsqueeze_56": 308, + "slice_75": 303, + "slice_76": 313, + "slice_77": 302, + "transpose_53": 308, + "matmul_20": 314, + "mul_56": 315, + "softmax_10": 314, + "matmul_21": 313, + "transpose_54": 303, + "clone_10": 308, + "cat_33": 313, + "view_26": 303, + "linear_41": 308, + "add_43": 313, + "layer_norm_21": 303, + "linear_42": 315, + "gelu_10": 314, + "linear_43": 310, + "add_44": 308, + "layer_norm_22": 303, + "linear_44": 306, + "view_27": 307, + "permute_11": 306, + "select_33": 313, + "select_34": 310, + "select_35": 303, + "unsqueeze_57": 309, + "unsqueeze_58": 311, + "mul_57": 302, + "slice_78": 312, + "slice_79": 307, + "neg_22": 313, + "cat_34": 306, + "mul_58": 313, + "add_45": 307, + "mul_59": 313, + "slice_80": 312, + "slice_81": 302, + "neg_23": 310, + "cat_35": 302, + "mul_60": 310, + "add_46": 302, + "transpose_55": 313, + "unsqueeze_59": 310, + "transpose_56": 313, + "unsqueeze_60": 302, + "transpose_57": 313, + "unsqueeze_61": 303, + "slice_82": 313, + "slice_83": 310, + "slice_84": 302, + "transpose_58": 303, + "matmul_22": 315, + "mul_61": 314, + "softmax_11": 315, + "matmul_23": 310, + "transpose_59": 313, + "clone_11": 303, + "cat_36": 310, + "view_28": 313, + "linear_45": 303, + "add_47": 310, + "layer_norm_23": 313, + "linear_46": 314, + "gelu_11": 315, + "linear_47": 308, + "add_48": 303, + "layer_norm_24": 313, + "linear_48": 306, + "view_29": 307, + "permute_12": 306, + "select_36": 310, + "select_37": 308, + "select_38": 313, + "unsqueeze_62": 309, + "unsqueeze_63": 312, + "mul_62": 302, + "slice_85": 311, + "slice_86": 307, + "neg_24": 310, + "cat_37": 306, + "mul_63": 310, + "add_49": 307, + "mul_64": 310, + "slice_87": 311, + "slice_88": 302, + "neg_25": 308, + "cat_38": 302, + "mul_65": 308, + "add_50": 302, + "transpose_60": 310, + "unsqueeze_64": 308, + "transpose_61": 310, + "unsqueeze_65": 302, + "transpose_62": 310, + "unsqueeze_66": 313, + "slice_89": 310, + "slice_90": 308, + "slice_91": 302, + "transpose_63": 313, + "matmul_24": 314, + "mul_66": 315, + "softmax_12": 314, + "matmul_25": 308, + "transpose_64": 310, + "clone_12": 313, + "cat_39": 308, + "view_30": 310, + "linear_49": 313, + "add_51": 308, + "layer_norm_25": 310, + "linear_50": 315, + "gelu_12": 314, + "linear_51": 303, + "add_52": 313, + "layer_norm_26": 310, + "linear_52": 306, + "view_31": 307, + "permute_13": 306, + "select_39": 308, + "select_40": 303, + "select_41": 310, + "unsqueeze_67": 309, + "unsqueeze_68": 311, + "mul_67": 302, + "slice_92": 312, + "slice_93": 307, + "neg_26": 308, + "cat_40": 306, + "mul_68": 308, + "add_53": 307, + "mul_69": 308, + "slice_94": 312, + "slice_95": 302, + "neg_27": 303, + "cat_41": 302, + "mul_70": 303, + "add_54": 302, + "transpose_65": 308, + "unsqueeze_69": 303, + "transpose_66": 308, + "unsqueeze_70": 302, + "transpose_67": 308, + "unsqueeze_71": 310, + "slice_96": 308, + "slice_97": 303, + "slice_98": 302, + "transpose_68": 310, + "matmul_26": 315, + "mul_71": 314, + "softmax_13": 315, + "matmul_27": 303, + "transpose_69": 308, + "clone_13": 310, + "cat_42": 303, + "view_32": 308, + "linear_53": 310, + "add_55": 303, + "layer_norm_27": 308, + "linear_54": 314, + "gelu_13": 315, + "linear_55": 313, + "add_56": 310, + "layer_norm_28": 308, + "linear_56": 306, + "view_33": 307, + "permute_14": 306, + "select_42": 303, + "select_43": 313, + "select_44": 308, + "unsqueeze_72": 309, + "unsqueeze_73": 312, + "mul_72": 302, + "slice_99": 311, + "slice_100": 307, + "neg_28": 303, + "cat_43": 306, + "mul_73": 303, + "add_57": 307, + "mul_74": 303, + "slice_101": 311, + "slice_102": 302, + "neg_29": 313, + "cat_44": 302, + "mul_75": 313, + "add_58": 302, + "transpose_70": 303, + "unsqueeze_74": 313, + "transpose_71": 303, + "unsqueeze_75": 302, + "transpose_72": 303, + "unsqueeze_76": 308, + "slice_103": 303, + "slice_104": 313, + "slice_105": 302, + "transpose_73": 308, + "matmul_28": 314, + "mul_76": 315, + "softmax_14": 314, + "matmul_29": 313, + "transpose_74": 303, + "clone_14": 308, + "cat_45": 313, + "view_34": 303, + "linear_57": 308, + "add_59": 313, + "layer_norm_29": 303, + "linear_58": 315, + "gelu_14": 314, + "linear_59": 310, + "add_60": 308, + "layer_norm_30": 303, + "linear_60": 306, + "view_35": 307, + "permute_15": 306, + "select_45": 313, + "select_46": 310, + "select_47": 303, + "unsqueeze_77": 309, + "unsqueeze_78": 311, + "mul_77": 302, + "slice_106": 312, + "slice_107": 307, + "neg_30": 313, + "cat_46": 306, + "mul_78": 313, + "add_61": 307, + "mul_79": 313, + "slice_108": 312, + "slice_109": 302, + "neg_31": 310, + "cat_47": 302, + "mul_80": 310, + "add_62": 302, + "transpose_75": 313, + "unsqueeze_79": 310, + "transpose_76": 313, + "unsqueeze_80": 302, + "transpose_77": 313, + "unsqueeze_81": 303, + "slice_110": 313, + "slice_111": 310, + "slice_112": 302, + "transpose_78": 303, + "matmul_30": 315, + "mul_81": 314, + "softmax_15": 315, + "matmul_31": 310, + "transpose_79": 313, + "clone_15": 303, + "cat_48": 310, + "view_36": 313, + "linear_61": 303, + "add_63": 310, + "layer_norm_31": 313, + "linear_62": 314, + "gelu_15": 315, + "linear_63": 308, + "add_64": 303, + "layer_norm_32": 313, + "linear_64": 306, + "view_37": 307, + "permute_16": 306, + "select_48": 310, + "select_49": 308, + "select_50": 313, + "unsqueeze_82": 309, + "unsqueeze_83": 312, + "mul_82": 302, + "slice_113": 311, + "slice_114": 307, + "neg_32": 310, + "cat_49": 306, + "mul_83": 310, + "add_65": 307, + "mul_84": 310, + "slice_115": 311, + "slice_116": 302, + "neg_33": 308, + "cat_50": 302, + "mul_85": 308, + "add_66": 302, + "transpose_80": 310, + "unsqueeze_84": 308, + "transpose_81": 310, + "unsqueeze_85": 302, + "transpose_82": 310, + "unsqueeze_86": 313, + "slice_117": 310, + "slice_118": 308, + "slice_119": 302, + "transpose_83": 313, + "matmul_32": 314, + "mul_86": 315, + "softmax_16": 314, + "matmul_33": 308, + "transpose_84": 310, + "clone_16": 313, + "cat_51": 308, + "view_38": 310, + "linear_65": 313, + "add_67": 308, + "layer_norm_33": 310, + "linear_66": 315, + "gelu_16": 314, + "linear_67": 303, + "add_68": 313, + "layer_norm_34": 310, + "linear_68": 306, + "view_39": 307, + "permute_17": 306, + "select_51": 308, + "select_52": 303, + "select_53": 310, + "unsqueeze_87": 309, + "unsqueeze_88": 311, + "mul_87": 302, + "slice_120": 312, + "slice_121": 307, + "neg_34": 308, + "cat_52": 306, + "mul_88": 308, + "add_69": 307, + "mul_89": 308, + "slice_122": 312, + "slice_123": 302, + "neg_35": 303, + "cat_53": 302, + "mul_90": 303, + "add_70": 302, + "transpose_85": 308, + "unsqueeze_89": 303, + "transpose_86": 308, + "unsqueeze_90": 302, + "transpose_87": 308, + "unsqueeze_91": 310, + "slice_124": 308, + "slice_125": 303, + "slice_126": 302, + "transpose_88": 310, + "matmul_34": 315, + "mul_91": 314, + "softmax_17": 315, + "matmul_35": 303, + "transpose_89": 308, + "clone_17": 310, + "cat_54": 303, + "view_40": 308, + "linear_69": 310, + "add_71": 303, + "layer_norm_35": 308, + "linear_70": 314, + "gelu_17": 315, + "linear_71": 313, + "add_72": 310, + "layer_norm_36": 308, + "linear_72": 306, + "view_41": 307, + "permute_18": 306, + "select_54": 303, + "select_55": 313, + "select_56": 308, + "unsqueeze_92": 309, + "unsqueeze_93": 312, + "mul_92": 302, + "slice_127": 311, + "slice_128": 307, + "neg_36": 303, + "cat_55": 306, + "mul_93": 303, + "add_73": 307, + "mul_94": 303, + "slice_129": 311, + "slice_130": 302, + "neg_37": 313, + "cat_56": 302, + "mul_95": 313, + "add_74": 302, + "transpose_90": 303, + "unsqueeze_94": 313, + "transpose_91": 303, + "unsqueeze_95": 302, + "transpose_92": 303, + "unsqueeze_96": 308, + "slice_131": 303, + "slice_132": 313, + "slice_133": 302, + "transpose_93": 308, + "matmul_36": 314, + "mul_96": 315, + "softmax_18": 314, + "matmul_37": 313, + "transpose_94": 303, + "clone_18": 308, + "cat_57": 313, + "view_42": 303, + "linear_73": 308, + "add_75": 313, + "layer_norm_37": 303, + "linear_74": 315, + "gelu_18": 314, + "linear_75": 310, + "add_76": 308, + "layer_norm_38": 303, + "linear_76": 306, + "view_43": 307, + "permute_19": 306, + "select_57": 313, + "select_58": 310, + "select_59": 303, + "unsqueeze_97": 309, + "unsqueeze_98": 311, + "mul_97": 302, + "slice_134": 312, + "slice_135": 307, + "neg_38": 313, + "cat_58": 306, + "mul_98": 313, + "add_77": 307, + "mul_99": 313, + "slice_136": 312, + "slice_137": 302, + "neg_39": 310, + "cat_59": 302, + "mul_100": 310, + "add_78": 302, + "transpose_95": 313, + "unsqueeze_99": 310, + "transpose_96": 313, + "unsqueeze_100": 302, + "transpose_97": 313, + "unsqueeze_101": 303, + "slice_138": 313, + "slice_139": 310, + "slice_140": 302, + "transpose_98": 303, + "matmul_38": 315, + "mul_101": 314, + "softmax_19": 315, + "matmul_39": 310, + "transpose_99": 313, + "clone_19": 303, + "cat_60": 310, + "view_44": 313, + "linear_77": 303, + "add_79": 310, + "layer_norm_39": 313, + "linear_78": 314, + "gelu_19": 315, + "linear_79": 308, + "add_80": 303, + "layer_norm_40": 313, + "linear_80": 306, + "view_45": 307, + "permute_20": 306, + "select_60": 310, + "select_61": 308, + "select_62": 313, + "unsqueeze_102": 309, + "unsqueeze_103": 312, + "mul_102": 302, + "slice_141": 311, + "slice_142": 307, + "neg_40": 310, + "cat_61": 306, + "mul_103": 310, + "add_81": 307, + "mul_104": 310, + "slice_143": 311, + "slice_144": 302, + "neg_41": 308, + "cat_62": 302, + "mul_105": 308, + "add_82": 302, + "transpose_100": 310, + "unsqueeze_104": 308, + "transpose_101": 310, + "unsqueeze_105": 302, + "transpose_102": 310, + "unsqueeze_106": 313, + "slice_145": 310, + "slice_146": 308, + "slice_147": 302, + "transpose_103": 313, + "matmul_40": 314, + "mul_106": 315, + "softmax_20": 314, + "matmul_41": 308, + "transpose_104": 310, + "clone_20": 313, + "cat_63": 308, + "view_46": 310, + "linear_81": 313, + "add_83": 308, + "layer_norm_41": 310, + "linear_82": 315, + "gelu_20": 314, + "linear_83": 303, + "add_84": 313, + "layer_norm_42": 310, + "linear_84": 306, + "view_47": 307, + "permute_21": 306, + "select_63": 308, + "select_64": 303, + "select_65": 310, + "unsqueeze_107": 309, + "unsqueeze_108": 311, + "mul_107": 302, + "slice_148": 312, + "slice_149": 307, + "neg_42": 308, + "cat_64": 306, + "mul_108": 308, + "add_85": 307, + "mul_109": 308, + "slice_150": 312, + "slice_151": 302, + "neg_43": 303, + "cat_65": 302, + "mul_110": 303, + "add_86": 302, + "transpose_105": 308, + "unsqueeze_109": 303, + "transpose_106": 308, + "unsqueeze_110": 302, + "transpose_107": 308, + "unsqueeze_111": 310, + "slice_152": 308, + "slice_153": 303, + "slice_154": 302, + "transpose_108": 310, + "matmul_42": 315, + "mul_111": 314, + "softmax_21": 315, + "matmul_43": 303, + "transpose_109": 308, + "clone_21": 310, + "cat_66": 303, + "view_48": 308, + "linear_85": 310, + "add_87": 303, + "layer_norm_43": 308, + "linear_86": 314, + "gelu_21": 315, + "linear_87": 313, + "add_88": 310, + "layer_norm_44": 308, + "linear_88": 306, + "view_49": 307, + "permute_22": 306, + "select_66": 303, + "select_67": 313, + "select_68": 308, + "unsqueeze_112": 309, + "unsqueeze_113": 312, + "mul_112": 302, + "slice_155": 311, + "slice_156": 307, + "neg_44": 303, + "cat_67": 306, + "mul_113": 303, + "add_89": 307, + "mul_114": 303, + "slice_157": 311, + "slice_158": 302, + "neg_45": 313, + "cat_68": 302, + "mul_115": 313, + "add_90": 302, + "transpose_110": 303, + "unsqueeze_114": 313, + "transpose_111": 303, + "unsqueeze_115": 302, + "transpose_112": 303, + "unsqueeze_116": 308, + "slice_159": 303, + "slice_160": 313, + "slice_161": 302, + "transpose_113": 308, + "matmul_44": 314, + "mul_116": 315, + "softmax_22": 314, + "matmul_45": 313, + "transpose_114": 303, + "clone_22": 308, + "cat_69": 313, + "view_50": 303, + "linear_89": 308, + "add_91": 313, + "layer_norm_45": 303, + "linear_90": 315, + "gelu_22": 314, + "linear_91": 310, + "add_92": 308, + "layer_norm_46": 303, + "linear_92": 306, + "view_51": 307, + "permute_23": 306, + "select_69": 313, + "select_70": 310, + "select_71": 303, + "unsqueeze_117": 309, + "unsqueeze_118": 311, + "mul_117": 302, + "slice_162": 312, + "slice_163": 307, + "neg_46": 313, + "cat_70": 306, + "mul_118": 313, + "add_93": 307, + "mul_119": 313, + "slice_164": 312, + "slice_165": 302, + "neg_47": 310, + "cat_71": 302, + "mul_120": 310, + "add_94": 302, + "transpose_115": 313, + "unsqueeze_119": 310, + "transpose_116": 313, + "unsqueeze_120": 302, + "transpose_117": 313, + "unsqueeze_121": 303, + "slice_166": 313, + "slice_167": 310, + "slice_168": 302, + "transpose_118": 303, + "matmul_46": 315, + "mul_121": 314, + "softmax_23": 315, + "matmul_47": 310, + "transpose_119": 313, + "clone_23": 303, + "cat_72": 310, + "view_52": 313, + "linear_93": 303, + "add_95": 310, + "layer_norm_47": 313, + "linear_94": 304, + "gelu_23": 305, + "linear_95": 308, + "add_96": 303, + "layer_norm_48": 313, + "view_53": 310, + "linear_96": 308, + "gelu_24": 313, + "linear_97": 312 + }, + "byteLength": 880905888 + }, + "rewrites": [], + "partitions": [] +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..a0ee21ccdfa612f53a04990c0439dea5c340089c --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 505856u; +if (i >= 505856u) { return; } +out[i] = f32(b0[((i / 512u) % 988u) * 1024u + ((i / 32u) % 16u) * 64u + (((i / 1u) % 32u) * 1u + 32u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..fcb8d103a77197292c6183a202ec412cfe346487 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 988u + row) * 4096u + col; + var acc = 0.0; + for (var tile = 0u; tile < 1024u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 988u && tile + local.x < 1024u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 988u + row) * 1024u + tile + local.x]); } + if (group.x * 8u + local.y < 4096u && tile + local.x < 1024u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 1024u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 988u && col < 4096u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..90f68cbdd7532a06a5d729984572d2763750a72b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 247u + row) * 2048u + col; + var acc = 0.0; + for (var tile = 0u; tile < 4096u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 247u && tile + local.x < 4096u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 247u + row) * 4096u + tile + local.x]); } + if (group.x * 8u + local.y < 2048u && tile + local.x < 4096u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 4096u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 247u && col < 2048u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..8ac6650395a0b96a898ea7c7223e8670cf9ebd7e --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 988u + row) * 3072u + col; + var acc = 0.0; + for (var tile = 0u; tile < 1024u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 988u && tile + local.x < 1024u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 988u + row) * 1024u + tile + local.x]); } + if (group.x * 8u + local.y < 3072u && tile + local.x < 1024u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 1024u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 988u && col < 3072u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..21ccf3451e06945f74299939238334012cf37b5e --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[1u * 1011712u + ((i / 1024u) % 988u) * 1024u + ((i / 64u) % 16u) * 64u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..554d918422c13af2488def727be1c4f45cd810b9 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[((i / 1011712u) % 1u) * 1011712u + ((i / 63232u) % 16u) * 63232u + ((i / 988u) % 64u) * 1u + ((i / 1u) % 988u) * 64u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..7ee111721ab92a71be8f591c5d026d039737186f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1984u; +if (i >= 1976u) { return; } +out[i] = i32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..b6c3f6b24114e456ffc730cc2d9c23d75ee441da --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl @@ -0,0 +1,12 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let coord = (i / 1u) % 64u; +if (coord >= 0u && coord < 32u) { out[i] = f32(b0[(i / 64u) * 32u + (coord - 0u) * 1u + i % 1u]); } +if (coord >= 32u && coord < 64u) { out[i] = f32(b1[(i / 64u) * 32u + (coord - 32u) * 1u + i % 1u]); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..9aaba9df97219bba59f94d2706455053a492eb05 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 63232u; +if (i >= 63232u) { return; } +let x = f32(b0[i]); +out[i] = f32(sin(x)); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..7aff76b5bd17ac0bd8a6fdb74a14efd76d42efeb --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892.wgsl @@ -0,0 +1,22 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let batch = i / 1024u; +let channel = (i / 1u) % 1024u; +let group = channel / 1024u; +var acc = 0.0; +for (var c = 0u; c < 3u; c++) { + for (var p = 0u; p < 512u; p++) { + let pos0 = i32((i / 1u) % 1u) * 2 + i32((p / 256u) % 2u) * 1 - 0; let pos1 = i32((i / 1u) % 1u) * 16 + i32((p / 16u) % 16u) * 1 - 0; let pos2 = i32((i / 1u) % 1u) * 16 + i32((p / 1u) % 16u) * 1 - 0; + if (pos0 >= 0 && pos0 < 2 && pos1 >= 0 && pos1 < 16 && pos2 >= 0 && pos2 < 16) { acc += f32(b1[batch * 1536u + (group * 3u + c) * 512u + u32(pos0) * 256u + u32(pos1) * 16u + u32(pos2) * 1u]) * f32(b2[(channel * 3u + c) * 512u + p]); } + } +} +out[i] = f32(acc + f32(b0[channel])); + +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..3ff70afc93d50ec87d76eddad549aa674f50aedd --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 988u + row) * 1024u + col; + var acc = 0.0; + for (var tile = 0u; tile < 4096u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 988u && tile + local.x < 4096u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 988u + row) * 4096u + tile + local.x]); } + if (group.x * 8u + local.y < 1024u && tile + local.x < 4096u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 4096u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 988u && col < 1024u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..64e0844522eb135c22355fdf3c045a68f553a7a8 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl @@ -0,0 +1,17 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let batch = i / 63232u; +let row = (i / 64u) % 988u; +let col = i % 64u; +var acc = 0.0; +for (var p = 0u; p < 988u; p++) { + acc += f32(b0[(((batch / 1u) % 16u) * 976144u) + row * 988u + p]) * f32(b1[(((batch / 1u) % 16u) * 63232u) + p * 64u + col]); +} +out[i] = f32(acc); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..c2c80a59e6fa63072d17d0f72215ca006a5b8ffd --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[2u * 1011712u + ((i / 1024u) % 988u) * 1024u + ((i / 64u) % 16u) * 64u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..f358cf6204d0a03414b77b1c7bd467e603e15c43 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[((i / 1011712u) % 1u) * 1011712u + ((i / 1024u) % 988u) * 64u + ((i / 64u) % 16u) * 63232u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..055de3d9bb9e8f95a7c43a7adc78fdde0a4625d3 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 4046848u; +if (i >= 4046848u) { return; } +out[i] = f32(f32(b0[i]) * f32(b1[((i / 4096u) % 988u) * 4u + ((i / 1024u) % 4u) * 1u])); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..9c1f3aa4241f203bebbab52af61764cacd782fab --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 505856u; +if (i >= 505856u) { return; } +let x = f32(b0[i]); +out[i] = f32(-x); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..8ce14d502d68fc61b7888bfdcc13e2d539ccc8ce --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 31616u; +if (i >= 31616u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..6dfd5e2ee9acf82373360580cf963536240c8f8f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2.wgsl @@ -0,0 +1,16 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 4046848u; +if (i >= 4046848u) { return; } +let token = i32(b0[i / 1024u]); +out[i] = f32(unpack_bf16_1(u32(token - 0) * 1024u + i % 1024u)); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..1b9861a82af0dfe03fe78d4117d0a3436c489c22 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl @@ -0,0 +1,34 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +var partial: array; +@compute @workgroup_size(64) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.x + group.y * 15808u; + if (row >= 15808u) { return; } + let lane = local.x; + var maximum = -3.4028234663852886e38; + for (var p = lane; p < 988u; p += 64u) { maximum = max(maximum, f32(b0[row * 988u + p])); } + partial[lane] = maximum; + workgroupBarrier(); + for (var stride = 32u; stride > 0u; stride /= 2u) { + if (lane < stride) { partial[lane] = max(partial[lane], partial[lane + stride]); } + workgroupBarrier(); + } + maximum = partial[0]; + // All lanes must finish reading the maximum before the scratch array is reused. + workgroupBarrier(); + var total = 0.0; + for (var p = lane; p < 988u; p += 64u) { total += exp(f32(b0[row * 988u + p]) - maximum); } + partial[lane] = total; + workgroupBarrier(); + for (var stride = 32u; stride > 0u; stride /= 2u) { + if (lane < stride) { partial[lane] += partial[lane + stride]; } + workgroupBarrier(); + } + total = partial[0]; + for (var p = lane; p < 988u; p += 64u) { + let i = row * 988u + p; + out[i] = f32(exp(f32(b0[row * 988u + p]) - maximum) / total); + } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..892d73fbc16700afb1d5fbed8ecc469c8654b590 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl @@ -0,0 +1,12 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 4046848u; +if (i >= 4046848u) { return; } +let x = f32(b0[i]); +if (x > 10.0) { out[i] = f32(x); return; } +if (x < -10.0) { out[i] = f32(0.0); return; } +out[i] = f32(0.5 * x * (1.0 + tanh(clamp(0.7978845608028654 * (x + 0.044715 * x*x*x), -10.0, 10.0)))); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..65e958b63f06e96ab79900d2b5c1f9a2479f417a --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 4194240u; +if (i >= 15618304u) { return; } +out[i] = f32(f32(b0[i]) * 0.125); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..4e26df2e12e091f662331cc7e6b7c38e7aa5e4c0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 3035136u; +if (i >= 3035136u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..a764e55a9684ab16b5925a378697170f728105c5 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 63232u; +if (i >= 63232u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..3bd6b563f48fef97171c3c2f14abb68c492049d1 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let coord = (i / 1024u) % 988u; +if (coord >= 0u && coord < 988u) { out[i] = f32(b0[(i / 1011712u) * 1011712u + (coord - 0u) * 1024u + i % 1024u]); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..80b4c64b3a095bb11bc9770052ae2c03d92ee13b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3.wgsl @@ -0,0 +1,11 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 63232u; +if (i >= 63232u) { return; } +let coord = (i / 1u) % 64u; +if (coord >= 0u && coord < 32u) { out[i] = f32(b0[(i / 64u) * 32u + (coord - 0u) * 1u + i % 1u]); } +if (coord >= 32u && coord < 64u) { out[i] = f32(b0[(i / 64u) * 32u + (coord - 32u) * 1u + i % 1u]); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..5003cc82b722a6590aee986ad38aa2957d591c23 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 3968u; +if (i >= 3952u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..df96bfd77c8295963287595f1eb16c1a38415c78 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 3035136u; +if (i >= 3035136u) { return; } +out[i] = f32(b0[((i / 1011712u) % 3u) * 1024u + ((i / 1024u) % 988u) * 3072u + ((i / 64u) % 16u) * 64u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..3bddce4253e4cd0380438b858d7fb2bb9c7f1220 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 505856u; +if (i >= 505856u) { return; } +out[i] = f32(b0[((i / 512u) % 988u) * 1024u + ((i / 32u) % 16u) * 64u + (((i / 1u) % 32u) * 1u + 0u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..50b9d5f63c9f9e7c8b06f8b0f368142b57bbb793 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 247u + row) * 4096u + col; + var acc = 0.0; + for (var tile = 0u; tile < 4096u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 247u && tile + local.x < 4096u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 247u + row) * 4096u + tile + local.x]); } + if (group.x * 8u + local.y < 4096u && tile + local.x < 4096u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 4096u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 247u && col < 4096u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..b8b8824075f747152c0c18adb78f70160560aae2 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[((i / 63232u) % 16u) * 64u + ((i / 64u) % 988u) * 1024u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..b0d2cac544c694f2f42e1fa38e0ce8af80e52959 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(f32(b0[i]) + (f32(b1[i]) * 1.0)); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..4e747fa6aa94159afe9b56754111c89c9edef2d1 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..c870b998808d8027e343378497cbfac0dc886ed0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl @@ -0,0 +1,17 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 4194240u; +if (i >= 15618304u) { return; } +let batch = i / 976144u; +let row = (i / 988u) % 988u; +let col = i % 988u; +var acc = 0.0; +for (var p = 0u; p < 64u; p++) { + acc += f32(b0[(((batch / 1u) % 16u) * 63232u) + row * 64u + p]) * f32(b1[(((batch / 1u) % 16u) * 63232u) + p * 988u + col]); +} +out[i] = f32(acc); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..e7d1c8a8afbaa1154578f51752a77b60e39c7b30 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[((i / 1011712u) % 1u) * 1011712u + ((i / 63232u) % 16u) * 63232u + (((i / 64u) % 988u) * 1u + 0u) * 64u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..ec5d306e956dce6db3f98c8bf406423e763a0957 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl @@ -0,0 +1,29 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; +fn unpack_bf16_1(index: u32) -> f32 { + let pair = b1[index / 2u]; + let bits = (pair >> ((index % 2u) * 16u)) & 65535u; + return bitcast(bits << 16u); +} + +var tile_a: array; +var tile_b: array; +@compute @workgroup_size(8, 8) +fn main(@builtin(workgroup_id) group: vec3, @builtin(local_invocation_id) local: vec3) { + let row = group.y * 8u + local.y; + let col = group.x * 8u + local.x; + let i = (group.z * 988u + row) * 1024u + col; + var acc = 0.0; + for (var tile = 0u; tile < 1024u; tile += 8u) { + tile_a[local.y * 8u + local.x] = 0.0; + tile_b[local.x * 8u + local.y] = 0.0; + if (row < 988u && tile + local.x < 1024u) { tile_a[local.y * 8u + local.x] = f32(b0[(group.z * 988u + row) * 1024u + tile + local.x]); } + if (group.x * 8u + local.y < 1024u && tile + local.x < 1024u) { tile_b[local.x * 8u + local.y] = unpack_bf16_1((group.x * 8u + local.y) * 1024u + tile + local.x); } + workgroupBarrier(); + for (var p = 0u; p < 8u; p++) { acc += tile_a[local.y * 8u + p] * tile_b[p * 8u + local.x]; } + workgroupBarrier(); + } + if (row < 988u && col < 1024u) { out[i] = f32(acc + f32(b2[col])); } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..3b9e9e752c8ccd04b8d28d0db1a040262ec24326 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(b0[0u * 1011712u + ((i / 1024u) % 988u) * 1024u + ((i / 64u) % 16u) * 64u + ((i / 1u) % 64u) * 1u]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..8b172021104c9a75a4a9cdf0756340a7bd00352b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 31616u; +if (i >= 31616u) { return; } +out[i] = f32(f32(b0[((i / 32u) % 988u) * 2u + ((i / 16u) % 2u) * 1u]) * f32(b1[((i / 1u) % 16u) * 1u])); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..1ffdb3900e0f1641f07feabdf583317b197ec935 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl @@ -0,0 +1,18 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var b2: array; +@group(0) @binding(3) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let base = (i / 1024u) * 1024u; +var mean = 0.0; +for (var j = 0u; j < 1024u; j++) { mean += f32(b0[base + j]); } +mean /= 1024.0; +var variance = 0.0; +for (var j = 0u; j < 1024u; j++) { let centered = f32(b0[base + j]) - mean; variance += centered * centered; } +out[i] = f32((f32(b0[i]) - mean) * inverseSqrt(variance / 1024.0 + 1e-06) * f32(b1[i % 1024u]) + f32(b2[i % 1024u])); + +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..5aaeb7dd972953795b5e28e65738ce46f1a9595d --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af.wgsl @@ -0,0 +1,11 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +var acc = 0.0; +for (var j = 0u; j < 4u; j++) { acc += f32(b0[(((i / 1024u) % 988u) * 4096u + ((i / 1u) % 1024u) * 1u) + (((j / 1u) % 4u) * 1024u)]); } +out[i] = f32(acc); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..fcb85b33ffc489f54d167040ce91d2ecb3dab657 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232.wgsl @@ -0,0 +1,17 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +let x = f32(b0[i]); +if (x > 10.0) { out[i] = f32(x); return; } +if (x < -10.0) { out[i] = f32(0.0); return; } +let z = x * 0.7071067811865476; +let t = 1.0 / (1.0 + 0.3275911 * abs(z)); +let polynomial = (((((1.061405429 * t - 1.453152027) * t) + 1.421413741) * t - 0.284496736) * t + 0.254829592) * t; +let erf = sign(z) * (1.0 - polynomial * exp(-z * z)); +out[i] = f32(0.5 * x * (1.0 + erf)); + +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..91c25641666650e6cc777d72c587fef0e43c6c63 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 63232u; +if (i >= 63232u) { return; } +let x = f32(b0[i]); +out[i] = f32(cos(x)); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..1c0aa1a843194351d8f0f988454fcdd40fba02ec --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl @@ -0,0 +1,10 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var b1: array; +@group(0) @binding(2) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1011712u; +if (i >= 1011712u) { return; } +out[i] = f32(f32(b0[i]) * f32(b1[((i / 1024u) % 988u) * 64u + ((i / 1u) % 64u) * 1u])); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3.wgsl b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3.wgsl new file mode 100644 index 0000000000000000000000000000000000000000..1801ba8a49676526cefdb8c12a8796633605c1d8 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/kernels/fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3.wgsl @@ -0,0 +1,9 @@ +@group(0) @binding(0) var b0: array; +@group(0) @binding(1) var out: array; + +@compute @workgroup_size(64) +fn main(@builtin(global_invocation_id) gid: vec3) { +let i = gid.x + gid.y * 1517568u; +if (i >= 1517568u) { return; } +out[i] = f32(b0[i]); +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/manifest.json b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/manifest.json new file mode 100644 index 0000000000000000000000000000000000000000..de59d0845af9cab1c00d6be961c94a8faaf6c370 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/manifest.json @@ -0,0 +1,316 @@ +{ + "format": "webtorch", + "version": 1, + "producer": { + "name": "webtorch", + "version": "0.1.0a1", + "torch": "2.14.0" + }, + "entrypoints": { + "forward": "graph.json" + }, + "requiredFeatures": [], + "assets": [ + { + "path": "weights/00000.bin", + "byteLength": 67108864, + "sha256": "5ff01e44eac7d7a30d3779fe7970f1ec882ae3a807ded59b8c25b203b57bd746" + }, + { + "path": "weights/00001.bin", + "byteLength": 67108864, + "sha256": "3f698d7140ff322989ac4a6aa5c05976740689c7129be1f179362c94bef2730f" + }, + { + "path": "weights/00002.bin", + "byteLength": 67108864, + "sha256": "1a05e5a106c236dedfca3a681806500e8d9f518767ec432ffa7a53a0061e94f8" + }, + { + "path": "weights/00003.bin", + "byteLength": 67108864, + "sha256": "da533794b3c088224ed91b19ce038c0b07acbfa7b01eeb5b6b1e0d8bc39e5bc8" + }, + { + "path": "weights/00004.bin", + "byteLength": 67108864, + "sha256": "b95eb7e977231963dd5335fab05dc5d111c3c5c716bc0bac3e0f48af84b5cf18" + }, + { + "path": "weights/00005.bin", + "byteLength": 67108864, + "sha256": "17c20eaa5be55412038d213e9820d01a4f1f822678a1fbe5d7df20b5012b546e" + }, + { + "path": "weights/00006.bin", + "byteLength": 67108864, + "sha256": "65031b11b25789c6ccbcddf46f2784210191bc64a6eca510ba6eb479f4dab7c9" + }, + { + "path": "weights/00007.bin", + "byteLength": 67108864, + "sha256": "65e01ad7b5d868aa12a669a3ac8ab2b7c5434fd3e484da3331a80608d42f3ff2" + }, + { + "path": "weights/00008.bin", + "byteLength": 67108864, + "sha256": "d1edbabeb49f1b143f5c09814a3185c0557fbeaf313d214876198ddc11ac0b6a" + }, + { + "path": "weights/00009.bin", + "byteLength": 62696096, + "sha256": "81e70e09fa4e106a132f634c3234dd50f42093f90cff24efe8732daa4a99a2fd" + }, + { + "path": "kernels/fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3.wgsl", + "byteLength": 296, + "sha256": "fbf9f7c699b99624e8563e1f8fab5b68cf89160d60e3daf5945f1ffe5a8954c3" + }, + { + "path": "kernels/43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892.wgsl", + "byteLength": 1055, + "sha256": "43ea6958ff4adf11ea8ba706a86d3b1a2a3f54d2b94ff5e795680fc33d552892" + }, + { + "path": "kernels/bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b.wgsl", + "byteLength": 296, + "sha256": "bf3ebcda6a36c384622b5a3d36a8c118cb368061ec695b8bc0fb46b550faf09b" + }, + { + "path": "kernels/5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2.wgsl", + "byteLength": 594, + "sha256": "5ca8bfbf9adfc79a462d5daf66dcee8c547b376772b0edcd07f9a084f90a17d2" + }, + { + "path": "kernels/88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591.wgsl", + "byteLength": 290, + "sha256": "88a9af67da30bf6c4a9f13401f1a21aa87f0731e780bbf00d45e23bec4aa5591" + }, + { + "path": "kernels/587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f.wgsl", + "byteLength": 421, + "sha256": "587dd6b2a30d3945c4c8a5e00d7e8fa4d00fe491838abba0dd670f56af7ddb1f" + }, + { + "path": "kernels/dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af.wgsl", + "byteLength": 445, + "sha256": "dcc64ada7c202b3c7a4fa83dbec165a67733352558b015eff6047e5e250907af" + }, + { + "path": "kernels/ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200.wgsl", + "byteLength": 379, + "sha256": "ab1e7db44b714b30926b7a0f1c35175c6b3477b2cc9c2e8bd5f025cff4c61200" + }, + { + "path": "kernels/237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9.wgsl", + "byteLength": 290, + "sha256": "237127aa3787a2a94feb4244d1b1efe7c3e5c8b5cd9e0ee544a0e99638215ac9" + }, + { + "path": "kernels/ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a.wgsl", + "byteLength": 433, + "sha256": "ce90f1e7d902eecec3952a34ca17617870d27474379f6e7c82faee10f8376e5a" + }, + { + "path": "kernels/5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2.wgsl", + "byteLength": 292, + "sha256": "5b3a06020ba272e83296e7f824f0f46ec379e0ceb428dda7760cccea4fda9cb2" + }, + { + "path": "kernels/855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3.wgsl", + "byteLength": 501, + "sha256": "855590b18d4dbaabbe80b309cf365dfc1beb2e6ee716d5022c5d4c855287c7c3" + }, + { + "path": "kernels/ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6.wgsl", + "byteLength": 313, + "sha256": "ee196d65aaf47e2ddd77b2315e4c555b915f83d661650ce4953975023efbabd6" + }, + { + "path": "kernels/4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70.wgsl", + "byteLength": 313, + "sha256": "4185ea53905ca7c884728b8f221f459d17104de04ad9cadbad887a4c9f75cc70" + }, + { + "path": "kernels/d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d.wgsl", + "byteLength": 767, + "sha256": "d16842c527e3b75143d68b32c2099a38e0195b20ce1b8664132a79bad3bcff4d" + }, + { + "path": "kernels/19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075.wgsl", + "byteLength": 1455, + "sha256": "19d5b2f3b725edaeae396debb3683dda307ae239c5342e1b079a2e01328b6075" + }, + { + "path": "kernels/707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82.wgsl", + "byteLength": 296, + "sha256": "707b7b188f55bd9c37b6bad7708d7b38bc286b7147e6355716910e7a44f9ae82" + }, + { + "path": "kernels/88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf.wgsl", + "byteLength": 405, + "sha256": "88e625463de0ca80326d53aa24f84a402f18e2e96f9ec322c6a1ac2dea47cfbf" + }, + { + "path": "kernels/cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076.wgsl", + "byteLength": 389, + "sha256": "cd6a942d0e0231d1e8fd05a2ce362512dfaed46ceba46fc86593182de4a7a076" + }, + { + "path": "kernels/1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763.wgsl", + "byteLength": 389, + "sha256": "1be156f874ee05b766376dcddd23bbce11a1feb3c5dae1bd7d35869c8da15763" + }, + { + "path": "kernels/558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0.wgsl", + "byteLength": 389, + "sha256": "558739fe02ea790140335a119fbd59441cc9b64320b5bfdff4daee09d3e883e0" + }, + { + "path": "kernels/80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17.wgsl", + "byteLength": 292, + "sha256": "80b140b8a7c9a19ca722fbb3b863a3d3640c28ffb7466d84f26433a8e5cbcf17" + }, + { + "path": "kernels/f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066.wgsl", + "byteLength": 420, + "sha256": "f92c5546622dc3aea6badf14abe019d854d3d9cb34a315d841bac05f9eb91066" + }, + { + "path": "kernels/9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035.wgsl", + "byteLength": 382, + "sha256": "9070ec757115bd7c81186acd9d29ce7bc0258c77cbd02866b5dfb9c54eecd035" + }, + { + "path": "kernels/075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad.wgsl", + "byteLength": 383, + "sha256": "075bce0424ae09dc9afdefb37dbec1402758d41a459cb4473f055eca1cef73ad" + }, + { + "path": "kernels/5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209.wgsl", + "byteLength": 311, + "sha256": "5ab3a53d6787b4ebe7eb4dae3c2da6962874d0c8cb5f23117d03473c6c76a209" + }, + { + "path": "kernels/2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16.wgsl", + "byteLength": 562, + "sha256": "2bc311be08e7b4d612eda975fc9d13df28242058c479729c041a68fda6404f16" + }, + { + "path": "kernels/9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6.wgsl", + "byteLength": 374, + "sha256": "9d29d01524ce6f64fd00438ed7f03ce6796d0f22be1be262d6fbe43c51ffd2b6" + }, + { + "path": "kernels/c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361.wgsl", + "byteLength": 422, + "sha256": "c667300f7d1060bdf36ea2a09ce4905b84ff7e9d1711fcc29c947425e0126361" + }, + { + "path": "kernels/1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1.wgsl", + "byteLength": 411, + "sha256": "1d0e64f42c129b2019e2b9c0bd7ae7718b3b8bd67afa0dd6ae462619cc6401d1" + }, + { + "path": "kernels/c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8.wgsl", + "byteLength": 605, + "sha256": "c09ba2ff8e99d3ef1fa686820ba2f6b198f2bd5f7755c8ee15dbf73344b641e8" + }, + { + "path": "kernels/6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd.wgsl", + "byteLength": 310, + "sha256": "6b83f8154d25e77d442948180ca249a492f7d9490a41d3dda46cd9bcb2fb37fd" + }, + { + "path": "kernels/6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564.wgsl", + "byteLength": 1407, + "sha256": "6619fc22f4476c11499f21aed05ce1963328fe028d204aa287d1414d3222b564" + }, + { + "path": "kernels/55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70.wgsl", + "byteLength": 603, + "sha256": "55202c927e8c2e4f319a6e89a594e7524c7c36d903219eccd579c5b9b53ebf70" + }, + { + "path": "kernels/5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1.wgsl", + "byteLength": 409, + "sha256": "5814d60ecf77c9336c3118f792e0bf32f3b08128ae7987f7e535598864c1a6a1" + }, + { + "path": "kernels/83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8.wgsl", + "byteLength": 424, + "sha256": "83993849c704ba6fb220c0b8a0fd6a3847d253423143816289ff7e939dd204f8" + }, + { + "path": "kernels/cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1.wgsl", + "byteLength": 1455, + "sha256": "cbb27a57c814432e940e67eb4f69d697bcb0099119a6bc46d85ed252de5cd9c1" + }, + { + "path": "kernels/08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a.wgsl", + "byteLength": 1455, + "sha256": "08dc45bcb86ff32fc939539b38d21b0d0d8873250e8ad9da05a42b297127cf3a" + }, + { + "path": "kernels/67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586.wgsl", + "byteLength": 487, + "sha256": "67991f0575b151ad2e89edf7eca755a0d62686cddce367e5d3d5382518167586" + }, + { + "path": "kernels/49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f.wgsl", + "byteLength": 1455, + "sha256": "49be6278b2b5df6dd69f6ff38e1e73dcfebc38d79f1f2694d34101dcb5c7476f" + }, + { + "path": "kernels/984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b.wgsl", + "byteLength": 1455, + "sha256": "984f5c91f469bb3fdfb0d8ddfe082a64ba3dfe87fc9dc4c1db582ca1f62d5f2b" + }, + { + "path": "kernels/ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232.wgsl", + "byteLength": 666, + "sha256": "ea188fbe79cee6ca9210d873c95f40fd3edd4c7140e6b2eb4739fedb2678e232" + }, + { + "path": "kernels/0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4.wgsl", + "byteLength": 1455, + "sha256": "0f22bffe633c43ee9cc9d88dd97725a7b0171c08b4c0e3f7fe3a53ad985f6cf4" + }, + { + "path": "graph.json", + "byteLength": 3401193, + "sha256": "7945de65609359c334ba15f9b09aaa67f18a136f541e7d7f77d7090d7dcbeef5" + }, + { + "path": "source/config.json", + "byteLength": 2908, + "sha256": "ed1c1723241f23f7f4e23430759cbd7dcfb4103cbdfe052bfe7626b57c2615b4" + }, + { + "path": "source/LICENSE", + "byteLength": 11544, + "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" + } + ], + "metadata": { + "repository": "Qwen/Qwen3.5-2B", + "revision": "15852e8c16360a2fea060d615a32b45270f8a8fc", + "architecture": "qwen3_5", + "modalities": [ + "text", + "image" + ], + "license": "apache-2.0", + "profile": "fp32-vision", + "imageGrid": [ + 1, + 26, + 38 + ], + "checkpointCertified": false + }, + "validation": { + "checkpointCertified": false, + "hardware": [] + } +} diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/LICENSE b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/LICENSE new file mode 100644 index 0000000000000000000000000000000000000000..f938136e3adacfd92be087f6e113b5d6d97f678f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/LICENSE @@ -0,0 +1,202 @@ + + Apache License + Version 2.0, January 2004 + http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + (except as stated in this section) patent license to make, have made, + use, offer to sell, sell, import, and otherwise transfer the Work, + where such license applies only to those patent claims licensable + by such Contributor that are necessarily infringed by their + Contribution(s) alone or by combination of their Contribution(s) + with the Work to which such Contribution(s) was submitted. If You + institute patent litigation against any entity (including a + cross-claim or counterclaim in a lawsuit) alleging that the Work + or a Contribution incorporated within the Work constitutes direct + or contributory patent infringement, then any patent licenses + granted to You under this License for that Work shall terminate + as of the date such litigation is filed. + + 4. Redistribution. You may reproduce and distribute copies of the + Work or Derivative Works thereof in any medium, with or without + modifications, and in Source or Object form, provided that You + meet the following conditions: + + (a) You must give any other recipients of the Work or + Derivative Works a copy of this License; and + + (b) You must cause any modified files to carry prominent notices + stating that You changed the files; and + + (c) You must retain, in the Source form of any Derivative Works + that You distribute, all copyright, patent, trademark, and + attribution notices from the Source form of the Work, + excluding those notices that do not pertain to any part of + the Derivative Works; and + + (d) If the Work includes a "NOTICE" text file as part of its + distribution, then any Derivative Works that You distribute must + include a readable copy of the attribution notices contained + within such NOTICE file, excluding those notices that do not + pertain to any part of the Derivative Works, in at least one + of the following places: within a NOTICE text file distributed + as part of the Derivative Works; within the Source form or + documentation, if provided along with the Derivative Works; or, + within a display generated by the Derivative Works, if and + wherever such third-party notices normally appear. The contents + of the NOTICE file are for informational purposes only and + do not modify the License. You may add Your own attribution + notices within Derivative Works that You distribute, alongside + or as an addendum to the NOTICE text from the Work, provided + that such additional attribution notices cannot be construed + as modifying the License. + + You may add Your own copyright statement to Your modifications and + may provide additional or different license terms and conditions + for use, reproduction, or distribution of Your modifications, or + for any such Derivative Works as a whole, provided Your use, + reproduction, and distribution of the Work otherwise complies with + the conditions stated in this License. + + 5. Submission of Contributions. Unless You explicitly state otherwise, + any Contribution intentionally submitted for inclusion in the Work + by You to the Licensor shall be under the terms and conditions of + this License, without any additional terms or conditions. + Notwithstanding the above, nothing herein shall supersede or modify + the terms of any separate license agreement you may have executed + with Licensor regarding such Contributions. + + 6. Trademarks. This License does not grant permission to use the trade + names, trademarks, service marks, or product names of the Licensor, + except as required for reasonable and customary use in describing the + origin of the Work and reproducing the content of the NOTICE file. + + 7. Disclaimer of Warranty. Unless required by applicable law or + agreed to in writing, Licensor provides the Work (and each + Contributor provides its Contributions) on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or + implied, including, without limitation, any warranties or conditions + of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A + PARTICULAR PURPOSE. You are solely responsible for determining the + appropriateness of using or redistributing the Work and assume any + risks associated with Your exercise of permissions under this License. + + 8. Limitation of Liability. In no event and under no legal theory, + whether in tort (including negligence), contract, or otherwise, + unless required by applicable law (such as deliberate and grossly + negligent acts) or agreed to in writing, shall any Contributor be + liable to You for damages, including any direct, indirect, special, + incidental, or consequential damages of any character arising as a + result of this License or out of the use or inability to use the + Work (including but not limited to damages for loss of goodwill, + work stoppage, computer failure or malfunction, or any and all + other commercial damages or losses), even if such Contributor + has been advised of the possibility of such damages. + + 9. Accepting Warranty or Additional Liability. While redistributing + the Work or Derivative Works thereof, You may choose to offer, + and charge a fee for, acceptance of support, warranty, indemnity, + or other liability obligations and/or rights consistent with this + License. However, in accepting such obligations, You may act only + on Your own behalf and on Your sole responsibility, not on behalf + of any other Contributor, and only if You agree to indemnify, + defend, and hold each Contributor harmless for any liability + incurred by, or claims asserted against, such Contributor by reason + of your accepting any such warranty or additional liability. + + END OF TERMS AND CONDITIONS + + APPENDIX: How to apply the Apache License to your work. + + To apply the Apache License to your work, attach the following + boilerplate notice, with the fields enclosed by brackets "[]" + replaced with your own identifying information. (Don't include + the brackets!) The text should be enclosed in the appropriate + comment syntax for the file format. We also recommend that a + file or class name and description of purpose be included on the + same "printed page" as the copyright notice for easier + identification within third-party archives. + + Copyright 2026 Alibaba Cloud + + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. \ No newline at end of file diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/config.json b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/config.json new file mode 100644 index 0000000000000000000000000000000000000000..d30a15be1bbfd610f58ad80f1fbeb6778f58a80f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/source/config.json @@ -0,0 +1,96 @@ +{ + "architectures": [ + "Qwen3_5ForConditionalGeneration" + ], + "image_token_id": 248056, + "model_type": "qwen3_5", + "text_config": { + "attention_bias": false, + "attention_dropout": 0.0, + "attn_output_gate": true, + "dtype": "bfloat16", + "eos_token_id": 248044, + "full_attention_interval": 4, + "head_dim": 256, + "hidden_act": "silu", + "hidden_size": 2048, + "initializer_range": 0.02, + "intermediate_size": 6144, + "layer_types": [ + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention", + "linear_attention", + "linear_attention", + "linear_attention", + "full_attention" + ], + "linear_conv_kernel_dim": 4, + "linear_key_head_dim": 128, + "linear_num_key_heads": 16, + "linear_num_value_heads": 16, + "linear_value_head_dim": 128, + "max_position_embeddings": 262144, + "mlp_only_layers": [], + "model_type": "qwen3_5_text", + "mtp_num_hidden_layers": 1, + "mtp_use_dedicated_embeddings": false, + "num_attention_heads": 8, + "num_hidden_layers": 24, + "num_key_value_heads": 2, + "rms_norm_eps": 1e-06, + "tie_word_embeddings": true, + "use_cache": true, + "vocab_size": 248320, + "mamba_ssm_dtype": "float32", + "rope_parameters": { + "mrope_interleaved": true, + "mrope_section": [ + 11, + 11, + 10 + ], + "rope_type": "default", + "rope_theta": 10000000, + "partial_rotary_factor": 0.25 + } + }, + "tie_word_embeddings": true, + "transformers_version": "4.57.0.dev0", + "video_token_id": 248057, + "vision_config": { + "deepstack_visual_indexes": [], + "depth": 24, + "hidden_act": "gelu_pytorch_tanh", + "hidden_size": 1024, + "in_channels": 3, + "initializer_range": 0.02, + "intermediate_size": 4096, + "model_type": "qwen3_5", + "num_heads": 16, + "num_position_embeddings": 2304, + "out_hidden_size": 2048, + "patch_size": 16, + "spatial_merge_size": 2, + "temporal_patch_size": 2 + }, + "vision_end_token_id": 248054, + "vision_start_token_id": 248053 +} \ No newline at end of file diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00000.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00000.bin new file mode 100644 index 0000000000000000000000000000000000000000..06198b6eb262e8722be59fd7351e315de552a255 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00000.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ff01e44eac7d7a30d3779fe7970f1ec882ae3a807ded59b8c25b203b57bd746 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00001.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00001.bin new file mode 100644 index 0000000000000000000000000000000000000000..d5e039d506963a394a09a7bf76eec3d070807af6 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00001.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f698d7140ff322989ac4a6aa5c05976740689c7129be1f179362c94bef2730f +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00002.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00002.bin new file mode 100644 index 0000000000000000000000000000000000000000..2d176a30733a3d0854fdae3810c57ca08723839b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00002.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1a05e5a106c236dedfca3a681806500e8d9f518767ec432ffa7a53a0061e94f8 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00003.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00003.bin new file mode 100644 index 0000000000000000000000000000000000000000..8c1b896698187229b358e96b5239d98d747d26bb --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00003.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da533794b3c088224ed91b19ce038c0b07acbfa7b01eeb5b6b1e0d8bc39e5bc8 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00004.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00004.bin new file mode 100644 index 0000000000000000000000000000000000000000..7fb830564f6043b13c7d2ede5663729f599f5117 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00004.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b95eb7e977231963dd5335fab05dc5d111c3c5c716bc0bac3e0f48af84b5cf18 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00005.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00005.bin new file mode 100644 index 0000000000000000000000000000000000000000..b7daccd2555758784196a6908e9642d0af3c8247 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00005.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17c20eaa5be55412038d213e9820d01a4f1f822678a1fbe5d7df20b5012b546e +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00006.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00006.bin new file mode 100644 index 0000000000000000000000000000000000000000..611a0d57ba672f2f98d48fb3ff39b58046aa9979 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00006.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65031b11b25789c6ccbcddf46f2784210191bc64a6eca510ba6eb479f4dab7c9 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00007.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00007.bin new file mode 100644 index 0000000000000000000000000000000000000000..559752756ac3ba1299bfd33b460132ca18b308e2 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00007.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65e01ad7b5d868aa12a669a3ac8ab2b7c5434fd3e484da3331a80608d42f3ff2 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00008.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00008.bin new file mode 100644 index 0000000000000000000000000000000000000000..b8afca3e6704fd0646aed84ad4e7d1ecb4d85331 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00008.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1edbabeb49f1b143f5c09814a3185c0557fbeaf313d214876198ddc11ac0b6a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00009.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00009.bin new file mode 100644 index 0000000000000000000000000000000000000000..5f9f834339c654e83a272d795fd888bf86fc20ea --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/vision/416x608/weights/00009.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:81e70e09fa4e106a132f634c3234dd50f42093f90cff24efe8732daa4a99a2fd +size 62696096 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00000.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00000.bin new file mode 100644 index 0000000000000000000000000000000000000000..cbd614c29160d261f1aaf53fc5f2db30e6e85966 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00000.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:84ffbe4377ff841ace0fd11d616bc3466b93dcf57d52517ca8840997f19eb4c6 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00001.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00001.bin new file mode 100644 index 0000000000000000000000000000000000000000..af4e09326541e5fd5c48481b4d60116910f78e58 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00001.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30bde451b91aff2928cffe4865bbc86dbdea76dd6e4af4467d692d3f474a4e8d +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00002.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00002.bin new file mode 100644 index 0000000000000000000000000000000000000000..a65f269fcf8eb96cd7edac019ca903bdf7fdc457 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00002.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a48e75076e26169bd4285f359d0288716ebcdb123b1f79ebe66d7744e74ecc4 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00003.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00003.bin new file mode 100644 index 0000000000000000000000000000000000000000..e84fbcf345c2c0528ce0ca09eacbcce63ba4cfaa --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00003.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d586da92796726ab87caabd21324b47f5332b0daad223a1322d1a5e75a276489 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00004.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00004.bin new file mode 100644 index 0000000000000000000000000000000000000000..7faebe0c9cb439352ac01ce287563debc1a48ee8 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00004.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8615920b4bd70b2e1c379f78d8fd2a3b454d7e1aa4db6ce5fda24b64e0b57c3a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00005.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00005.bin new file mode 100644 index 0000000000000000000000000000000000000000..b28a16e4c4fdbbda6ce73d58892473b572fa97fc --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00005.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5da61ce89024c8030b4efb637f69cdb77189724dcd9f7da9b987a7fb92a510a9 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00006.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00006.bin new file mode 100644 index 0000000000000000000000000000000000000000..2f29a48c718d0b980602a37dfaf26f748319d88c --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00006.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:213bb58a0acf92bc272be0a009c1c660375cfcbea1525ef81a191efcd3a32ee0 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00007.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00007.bin new file mode 100644 index 0000000000000000000000000000000000000000..698188c73825cf12006072b0624cd43c1fc09dbf --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00007.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e48c21b8fd01fd6eee6b534eba62c0c7285963b5c18391b1c854fbfee0c0c21b +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00008.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00008.bin new file mode 100644 index 0000000000000000000000000000000000000000..e62b29d9e8a55705c892265d7015094e2d1a48db --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00008.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b45e3336fac9353a2b90a731184c0a725fe0bf4b4f6c1cdcfd5d4e2d8f5f3849 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00009.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00009.bin new file mode 100644 index 0000000000000000000000000000000000000000..1e66c997b83f3c5e25de092ae26a83e57879007a --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00009.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:097d3ef6aed94a420d026323d9e43f07730289dd1a9fe22bdeae57d76b84f0b6 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00010.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00010.bin new file mode 100644 index 0000000000000000000000000000000000000000..b20954ff1d9a5ad9982b133d4bf3eabb45b41b3e --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00010.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1b9904b4ef7840fedc8badd04438db0d7b9e7baadafe8931534c8801438a11f +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00011.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00011.bin new file mode 100644 index 0000000000000000000000000000000000000000..181c178f2d0051162d863f32af8266dbf5b6ae57 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00011.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b52d09d0ce3fa311c4e08c9e6aded6bd20d221461f44aa6305a39e9c098b578 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00012.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00012.bin new file mode 100644 index 0000000000000000000000000000000000000000..ccfb96d7e1a55ddb5724001886b1ab1237b00a3f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00012.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5193cee36808d007e7b7bdd958e49c0a3c30f99be53cdc163396553201b7a652 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00013.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00013.bin new file mode 100644 index 0000000000000000000000000000000000000000..8e08adca607c63ad161b3fad7a924ce438eb1e65 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00013.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c82b1141090140d5899e34a0d87c3d4f570a5e1d92d39f2c7adb0ae49aacdef +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00014.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00014.bin new file mode 100644 index 0000000000000000000000000000000000000000..8f4e0b9a2080242f7db78caa15acdcf849431731 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00014.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bea09d102c10e33637d240a9e420c57bcb5cbf2d241c05ae2b07cf5ac0984b4d +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00015.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00015.bin new file mode 100644 index 0000000000000000000000000000000000000000..d18f6fde5eddb5e899387d09d32248045c1322df --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00015.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:58c0a62c68f73cc28c5ac1b3f299de85cda77fe73a2576c60442ff780f96d5ea +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00016.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00016.bin new file mode 100644 index 0000000000000000000000000000000000000000..ece99f249d2fbe5b62f719a2f12ec41561bdd06f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00016.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7f9818fafcf00a517c6378c077ad893a22f5bbc835eb902c6fd7d79e0f30b62 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00017.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00017.bin new file mode 100644 index 0000000000000000000000000000000000000000..613a869ec729b5e4822aff91295b6746e3a1a481 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00017.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b99b5548fc4106ce86f9017b0a02cfdf25a0d144663bb81588502a08cd8b6e10 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00018.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00018.bin new file mode 100644 index 0000000000000000000000000000000000000000..faf04a27dd5126d65bead6e0f137f85eefc351c0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00018.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c78473c3bd855f84ec7536c96a6543522f43b935df6cda7a60da65c8e030db3a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00019.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00019.bin new file mode 100644 index 0000000000000000000000000000000000000000..cb0d3979fd2a6cb06af3014aa71e76a82164615c --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00019.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:052414ca871ce558c2755607d0e74ba11a74f3c5b6dcd4917cc3e7eeb34c6abc +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00020.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00020.bin new file mode 100644 index 0000000000000000000000000000000000000000..e65a26d2d79916d802285dafef2716092b1572fc --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00020.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c6e80bb9f7563139a0556ad416c6cc014d400b6940f79c13047a6185e29be5f +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00021.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00021.bin new file mode 100644 index 0000000000000000000000000000000000000000..185f8338fce5229b0720649713c0ded85468ad4c --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00021.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7548c258d2190bc57dc1711fdbe1a045bce190c1910717673e95c758888d4f4a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00022.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00022.bin new file mode 100644 index 0000000000000000000000000000000000000000..17af60fc9b21e8d026b3c0aa54720983af092824 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00022.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1964c13f5e04a8ec1cd8984a05ca312c0c6a06da8e0b14e00d22cc4099c7e08 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00023.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00023.bin new file mode 100644 index 0000000000000000000000000000000000000000..fbba11def7b67373ce248d2f559c3922b5c9be30 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00023.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8170cdf5e359d50eda5e303409c49da35728a18d69964b267afc508b4f2a9517 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00024.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00024.bin new file mode 100644 index 0000000000000000000000000000000000000000..665b755e14152b15e68c9983f082e49a3b296c2b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00024.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:76ccd5e026b83375d3ed471720c58bb691c086300d0e2bde44a13cb14fc47472 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00025.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00025.bin new file mode 100644 index 0000000000000000000000000000000000000000..890181deac76ebe5765cce6795379bae84ad7131 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00025.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f48ba9580896e09ae04297e2efb002953264953cb1ea4b69a5f1285c79d58a42 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00026.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00026.bin new file mode 100644 index 0000000000000000000000000000000000000000..e2bfd7262accfad803e07138c8b79d63b44c888a --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00026.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b6f45d85696e1a093a24bff31ad919e14e550dcc4a4333a4e1b0ff393c585aa2 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00027.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00027.bin new file mode 100644 index 0000000000000000000000000000000000000000..8393b87c92fbefe76a16818f60aa2ab17d1ae9bd --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00027.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:58b1278a12ac53ceacc3a06b7c68e2fd3b678db7c62a7a924abaf4245203a40e +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00028.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00028.bin new file mode 100644 index 0000000000000000000000000000000000000000..0172ff83ddf1fc57addfc17b19f08f2bf3f11df0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00028.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7bbd025cdeea82f063f7adbd40c49a0f6ae828c950577a9d4040a3f33b4c83a4 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00029.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00029.bin new file mode 100644 index 0000000000000000000000000000000000000000..b29a1c9f0a9e79d0b3800904239c7be457a0698b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00029.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c0e6602750dee3aa3f39a1b6eb768b95ee13c562979f9808a73d0d85482e7fb +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00030.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00030.bin new file mode 100644 index 0000000000000000000000000000000000000000..089515821c96c00f0c3f2b15b047751dda268c78 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00030.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3331d8407f07119b893918da0b638b3bd5460b6a7cf38b1aea1f7d41998832e8 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00031.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00031.bin new file mode 100644 index 0000000000000000000000000000000000000000..b8fe9745eb3439c47e0802ea0e9524e28c8338bc --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00031.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fec0cd64eb9aae03dcefc9ba7e4a617d1de8b62f07b6066079215986f8227d35 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00032.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00032.bin new file mode 100644 index 0000000000000000000000000000000000000000..f57c8cf8e316e86fa620f97a70fc5499188c0015 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00032.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a54ec78ecbf1b6763e9d13f02084ca5a70a402eb1ae91a11a593f9ff6eedcc0 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00033.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00033.bin new file mode 100644 index 0000000000000000000000000000000000000000..8535f57e3393b9fc2b08085929d544781f7bbe1d --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00033.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:54df940fb40f2070f3d4aa726de9fce1efc3fbaf4b2d5b8ce596fdb518e3fb30 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00034.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00034.bin new file mode 100644 index 0000000000000000000000000000000000000000..6c8b429c6c2b4a35beed0b1435d99b16e49da1fd --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00034.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:172f5ed200bc6801bd91789aaf7fa6d2dce41a12b04008aca8e5de995a65830e +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00035.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00035.bin new file mode 100644 index 0000000000000000000000000000000000000000..06c537f99868e7121bb5b116bb345c1d8f435d16 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00035.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12ada36385384289eead8757f40477bcd85d95fa44b5cb294c58b7791d79adf7 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00036.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00036.bin new file mode 100644 index 0000000000000000000000000000000000000000..3958b6d1a4bd47e947cbf47b94cdc322d94ef230 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00036.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8f43da56c71e795876be62db263f8602d9de8ea03759024e86ae191f4e65b31 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00037.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00037.bin new file mode 100644 index 0000000000000000000000000000000000000000..eabab822ced8d6ffdace84da20331bd3b34e8ccb --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00037.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:489ab647c6b547c3d92875408dd525fb32697e68650cc4fd353983b628fa8fb1 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00038.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00038.bin new file mode 100644 index 0000000000000000000000000000000000000000..80410586d803983a157ec825c26001bc029e993f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00038.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf54a3dcfed4247cd50cbb3df7299b40be305bf5702249267602b1ce20d0e7b7 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00039.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00039.bin new file mode 100644 index 0000000000000000000000000000000000000000..d51b6a1063b25a0cc549ec30ab7ecbc2281856ee --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00039.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cdddd6e904675a38816906ea9d2d2cebd0db040537d32fa1b511dce00978d00c +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00040.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00040.bin new file mode 100644 index 0000000000000000000000000000000000000000..5c6fcce77fa42cbd2af3c43bfc62c4a541e14ca1 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00040.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f07317fb099f0c7aa6b654998355df2caa934fb371a700280fc15dd9e5c5bc73 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00041.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00041.bin new file mode 100644 index 0000000000000000000000000000000000000000..cd80c5494fccf355e00c38b08ea29827240a0db9 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00041.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8ef7f4a5f33b9d03d82ffae546970d82891f0d92c5c9e156ef4afd27a82474d +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00042.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00042.bin new file mode 100644 index 0000000000000000000000000000000000000000..02024922229eabc3c32a42e3e0888376b1950ff0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00042.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f24982b6c4187e7ddd19ebe75db47ebea5213c73aae3467e9e1c9e6c9bcb5f2 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00043.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00043.bin new file mode 100644 index 0000000000000000000000000000000000000000..273466abb89dae3153a429b75c34505699881ec2 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00043.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:19245767be3034959a7ae1a3a53a91b596384d83e10c8c0c85a263b900b8c288 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00044.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00044.bin new file mode 100644 index 0000000000000000000000000000000000000000..b9aa8478781b198de68a4edfe087400c63e18dad --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00044.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6ec40f20593ae375aa35648be661954f3293a17762df94cc0b02042eaa3a68f +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00045.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00045.bin new file mode 100644 index 0000000000000000000000000000000000000000..23103f99104a576025b84e2c4e6803ee0faf48c5 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00045.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27ac6830453866b68c0e35913389f38a3e042705a80edddd43a83664f43cab9a +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00046.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00046.bin new file mode 100644 index 0000000000000000000000000000000000000000..09f431cc4c713a74fd900e44ec756da972223bd4 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00046.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9695b695ba98b4cf3cb772662dee4727997e62dea94c54d71054125e9fcc0e77 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00047.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00047.bin new file mode 100644 index 0000000000000000000000000000000000000000..e31ffbad70b4e867270cce033e441c57e033ba03 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00047.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40ace035e27598cf0c6959de484630d60877259f34a05376db274f3807fcd0ff +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00048.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00048.bin new file mode 100644 index 0000000000000000000000000000000000000000..e865a9da52d5ec8b07255e0bae8fee69a90cd6b1 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00048.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6435b1511555e6d084f5606a88a552cafb0ec6a18969909c5b03b304c702b758 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00049.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00049.bin new file mode 100644 index 0000000000000000000000000000000000000000..2e0a9312f59bfc9dd799b5ac5e9cc975f1287e1f --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00049.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf1d6531963ff56a913326864ab9bdb05c85b20e0fc6e3648803a49ad4fceb92 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00050.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00050.bin new file mode 100644 index 0000000000000000000000000000000000000000..199c47db1d1cbfadfd885039e193628f8a4f4061 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00050.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:487f124693c79edf4dec4a891e5f27fa253da1b0d8b91392e2533de72556541b +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00051.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00051.bin new file mode 100644 index 0000000000000000000000000000000000000000..4bd05d9e4bf0d50294d7ebf3ae45b31e48fe77f6 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00051.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f57abd1b78a9826709fd4113456316648aedc474c443a740d3feb4f33b2ab6c +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00052.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00052.bin new file mode 100644 index 0000000000000000000000000000000000000000..53da276774eb92477aef9a5a6cf1287fc45ab3f0 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00052.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e385fdc62f5de26a18c9b076c9828d20201e096e588f2f58ea1a19f100e9ef16 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00053.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00053.bin new file mode 100644 index 0000000000000000000000000000000000000000..b38267c139b4715cce68a546586a2ad093c3649b --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00053.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2d22b24a6c3c0e6b680ed53ff3519bbbcf7d62a5720a2f907ca252e6aff6999 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00054.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00054.bin new file mode 100644 index 0000000000000000000000000000000000000000..e16a3b8657ae95b573aa7f5016463413ea3a4176 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00054.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a58b0f07d003d6cbf2867e8a28ce47be85d856a7617e34df3a84ad424120748 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00055.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00055.bin new file mode 100644 index 0000000000000000000000000000000000000000..030cdc6d91bd109b0e42cc984bcbb1f9da09bfb1 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00055.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e332e1395a7713359d9173a671c6e5e0d5dfb4678410a0653e354e8bb55df55 +size 67108864 diff --git a/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00056.bin b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00056.bin new file mode 100644 index 0000000000000000000000000000000000000000..37989a90f0e6a9cb912d376dbe75af818b8a0e71 --- /dev/null +++ b/qwen35-2b-multimodal-fp32-three-grid-state-alias-token-major-v2-v3/weights/00056.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:69c511d71323fd74a057001c446adc7f4a75577735b6c3b4bed59acdd276de23 +size 6651264