Commit History

  1. chore: add smoke test and debug logs requested by christian

    b1713fd
  2. fix: replace buggy native chat method with custom generate pipeline

    d597a14
  3. fix: switch back to native chat method to avoid generation bugs

    11467f8
  4. fix: logic error in response parsing and add debug logs

    c8ef672
  5. fix: remove forced ChatML template and parse native tags

    a5bc998
  6. fix: set use_cache=False to prevent kv-cache tensor shape mismatch crashes

    860c4e6
  7. fix: replace buggy model.chat() regex with custom generation pipeline

    873c1dd

  1. fix: update chat template to use ChatML format instead of legacy tags

    3bdcc9b
  2. fix: inject official MiniCPM chat template to prevent garbage hallucinated outputs

    3078db7
  3. fix: switch to official MiniCPM .chat() method to fix gibberish output

    f3ca13a
  4. fix: use returned input_ids length for slicing position_ids in monkeypatch

    2ea4cde
  5. fix: monkeypatch MiniCPM prepare_inputs_for_generation to prevent position_ids broadcasting crash

    762c3ac
  6. fix: correctly extract input_ids from BatchEncoding UserDict to prevent generate shape crash

    5dbfbb6
  7. fix: pass only input_ids to Core Router generate to prevent PyTorch attention shape mismatch

    3c0b10f
  8. fix: use eager attention for MiniCPM4.1-8B to prevent SDPA crash, fix Nemotron Parse processor format

    32bc132
  9. fix: add cv2/albumentations for Nemotron Parse, fix Core Router generate kwargs shape error

    7d2d8f9
  10. fix: switch Core Router to AutoModelForCausalLM for generate support, fix Nemotron Parse inference with AutoProcessor

    bb9bc8a
  11. fix: block flash_attn at runtime with sys.modules=None to prevent FA2 on HF ZeroGPU where flash_attn is pre-installed

    9fc5c52
  12. fix: resolve infinite recursion in flash_attn patch by capturing original get_imports before patching

    70f54cc
  13. fix: replace flash_attn mock with get_imports patch to properly disable FA2 for MiniCPM4.1-8B and Nemotron Parse

    d006ae4
  14. fix: use correct AutoModelForImageTextToText+AutoProcessor for MiniCPM-V-4.6, eager attn for Core Router

    ed8a9e5
  15. fix: use AutoModelForCausalLM for vision, add sdpa attn for Core Router, add open_clip_torch dep

    4816f79
  16. fix: correct vision model dtype, Nemotron Parse model ID, and patch missing is_torch_fx_available

    4e3a057
  17. fix: implement lazy loading for Core Router to prevent Space startup timeout

    a81525d
  18. fix: correct MiniCPM-V-4.6 model ID and switch Core Router to AutoModel to resolve ModelWrapper crash

    b0584e4
  19. fix: resolve Core Router crash by removing attn_implementation override on MiniCPM4.1-8B

    1dbf78e
  20. feat: add OpenBMB Core Router (MiniCPM4.1-8B) and wire it to Gradio UI

    e074efd