KnowLine-4B-Gen5.5-onnx / fp16_cpu_session_check.log
electroglyph's picture
Upload folder using huggingface_hub
7d5fc54 verified
Raw History Blame Contribute Delete
1.08 kB
Traceback (most recent call last):
File "<stdin>", line 7, in <module>
File "/home/anon/knowline/onnx/onnx_raw.py", line 33, in __init__
self.sess = ort.InferenceSession(model_path, sess_options=opts, providers=providers or ["CPUExecutionProvider"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/anon/.venv/lib/python3.12/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 683, in __init__
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/anon/.venv/lib/python3.12/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 789, in _create_inference_session
sess.initialize_session(providers, provider_options, disabled_optimizers)
onnxruntime.capi.onnxruntime_pybind11_state.NotImplemented: [ONNXRuntimeError] : 9 : NOT_IMPLEMENTED : Failed to find kernel for com.microsoft.GatedDeltaNet(1) (node:'/model/layers.0/linear_attn/GatedDeltaNet' ep:'CPUExecutionProvider'). Kernel not found
EXIT:1