MuXodious/Nanbeige4.2-3B-ARA-heresy | MXFP8
#52
by INC4AI - opened
Pipeline Failure Report
Model: MuXodious/Nanbeige4.2-3B-ARA-heresy
Quantization Scheme: MXFP8
Failed Phase: quantize
Run ID: Nanbeige4.2-3B-ARA-heresy-AutoRound-MXFP8-Tuning
Error Category: unknown
Full Error Log
10:05:12 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/tokenizer_config.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Ftokenizer_config.json=&etag=%221e47e2cebb285d1dda85bf1af25044bd216d0dd3%22 "HTTP/1.1 200 OK"
10:05:12 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
10:05:12 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
10:05:12 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/tokenizer.model "HTTP/1.1 302 Found"
10:05:12 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/xet-read-token/3655f8c710d17a72e0282da5c31446f73798fc70 "HTTP/1.1 200 OK"
10:05:15 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/tokenizer.json "HTTP/1.1 302 Found"
10:05:17 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/added_tokens.json "HTTP/1.1 307 Temporary Redirect"
10:05:17 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/added_tokens.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fadded_tokens.json=&etag=%228805f6dd0517ef0a74400d304c63bf176b3e28ed%22 "HTTP/1.1 200 OK"
10:05:17 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/added_tokens.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fadded_tokens.json=&etag=%228805f6dd0517ef0a74400d304c63bf176b3e28ed%22 "HTTP/1.1 200 OK"
10:05:18 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect"
10:05:18 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/special_tokens_map.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fspecial_tokens_map.json=&etag=%22fb83292a14c95f398736acae643c48c152b9eb71%22 "HTTP/1.1 200 OK"
10:05:18 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/special_tokens_map.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fspecial_tokens_map.json=&etag=%22fb83292a14c95f398736acae643c48c152b9eb71%22 "HTTP/1.1 200 OK"
10:05:18 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/chat_template.jinja "HTTP/1.1 307 Temporary Redirect"
10:05:18 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/chat_template.jinja?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fchat_template.jinja=&etag=%22f2e394026e4efa88081fcf8782c6cccb69da0e8a%22 "HTTP/1.1 200 OK"
10:05:18 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/chat_template.jinja?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fchat_template.jinja=&etag=%22f2e394026e4efa88081fcf8782c6cccb69da0e8a%22 "HTTP/1.1 200 OK"
10:05:19 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy "HTTP/1.1 200 OK"
10:05:19 [INFO] Loading model...
10:05:19 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy "HTTP/1.1 200 OK"
10:05:19 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py "HTTP/1.1 307 Temporary Redirect"
10:05:20 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fmodeling_nanbeige.py=&etag=%22b4b65e5badf612c389b328b6d253bb0647a47e6c%22 "HTTP/1.1 200 OK"
10:05:20 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fmodeling_nanbeige.py=&etag=%22b4b65e5badf612c389b328b6d253bb0647a47e6c%22 "HTTP/1.1 200 OK"
[transformers] A new version of the following files was downloaded from https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy:
- modeling_nanbeige.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
10:05:20 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/model.safetensors "HTTP/1.1 404 Not Found"
10:05:20 [INFO] HTTP Request: HEAD https://huggingface.co/MuXodious/Nanbeige4.2-3B-ARA-heresy/resolve/3655f8c710d17a72e0282da5c31446f73798fc70/model.safetensors.index.json "HTTP/1.1 307 Temporary Redirect"
10:05:20 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/model.safetensors.index.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fmodel.safetensors.index.json=&etag=%225593aba061fe47f344e609b8d3d01c23da6a1013%22 "HTTP/1.1 200 OK"
10:05:20 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/3655f8c710d17a72e0282da5c31446f73798fc70/model.safetensors.index.json?%2FMuXodious%2FNanbeige4.2-3B-ARA-heresy%2Fresolve%2F3655f8c710d17a72e0282da5c31446f73798fc70%2Fmodel.safetensors.index.json=&etag=%225593aba061fe47f344e609b8d3d01c23da6a1013%22 "HTTP/1.1 200 OK"
10:05:21 [INFO] HTTP Request: GET https://huggingface.co/api/models/MuXodious/Nanbeige4.2-3B-ARA-heresy/tree/3655f8c710d17a72e0282da5c31446f73798fc70?recursive=true&expand=false "HTTP/1.1 200 OK"
10:05:56 [ERROR] Quantization failed: 'type'
Traceback (most recent call last):
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 479, in <module>
quantize(args)
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 293, in quantize
model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/common.py", line 205, in patched
return underlying_func(klass, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 394, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4291, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.cache/huggingface/modules/transformers_modules/MuXodious/Nanbeige4_dot_2_hyphen_3B_hyphen_ARA_hyphen_heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py", line 2421, in __init__
self.model = NanbeigeModel(config)
^^^^^^^^^^^^^^^^^^^^^
File "/root/.cache/huggingface/modules/transformers_modules/MuXodious/Nanbeige4_dot_2_hyphen_3B_hyphen_ARA_hyphen_heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py", line 1994, in __init__
[NanbeigeDecoderLayer(config, layer_idx) for layer_idx in range(config.num_hidden_layers)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.cache/huggingface/modules/transformers_modules/MuXodious/Nanbeige4_dot_2_hyphen_3B_hyphen_ARA_hyphen_heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py", line 1642, in __init__
self.self_attn = NANBEIGE_ATTENTION_CLASSES[config._attn_implementation](config=config, layer_idx=layer_idx)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.cache/huggingface/modules/transformers_modules/MuXodious/Nanbeige4_dot_2_hyphen_3B_hyphen_ARA_hyphen_heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py", line 1067, in __init__
self._init_rope()
File "/root/.cache/huggingface/modules/transformers_modules/MuXodious/Nanbeige4_dot_2_hyphen_3B_hyphen_ARA_hyphen_heresy/3655f8c710d17a72e0282da5c31446f73798fc70/modeling_nanbeige.py", line 1077, in _init_rope
scaling_type = self.config.rope_scaling["type"]
~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'type'
Auto-generated by error_analysis pipeline. cc @lvkaokao
Looks like the rope_scaling config is missing the 'type' key in that Nanbeige model init. If you're trying to run this locally, you'll need to ensure the config dict includes that field before instantiation. I can't execute code or modify files here, but if you want a quick patch snippet or an explanation of why that key matters for RoPE scaling, just say the word.