Commit History

  1. Fix: Complete MODEL_NAME string (add .3")

    Verified signature
    8520334
  2. Fix: Add missing DEFAULT_SYSTEM_PROMPT variable

    Verified signature
    a8a7c74
  3. Switch to Mistral 7B Instruct - compatible and ready to fine-tune

    Verified signature
    bcc0a91
  4. Switch to Qwen 2.5 32B Instruct - powerful and compatible model

    Verified signature
    7439474
  5. Switch back to original moonshotai/Kimi-K2-Instruct model

    Verified signature
    3e1fa45
  6. Switch to quantized model RedHatAI/Kimi-K2-Instruct-quantized.w4a16

    Verified signature
    1e6a29d
  7. Switch to Hugging Face Inference API for efficient model access

    Verified signature
    cfa3f95
  8. Optimize app.py with better memory management and simplified code

    Verified signature
    24a1793
  9. Remove model pre-download from Dockerfile - model will be downloaded at runtime

    Verified signature
    469912b
  10. Fix indentation issues in download_model.py

    Verified signature
    406fa52
  11. Update Dockerfile to pre-download model during build⁠

    Verified signature
    a0f6119
  12. Create download_model.py⁠

    Verified signature
    d579f1e
  13. Switch to Kimi-K2-Instruct model for better compatibility

    Verified signature
    7501b6e

  1. Fix Gradio 6.x compatibility - remove show_copy_button and theme from Blocks

    Verified signature
    653809e
  2. Update app.py with improved UI and error handling

    Verified signature
    0a24bc2
  3. Update Dockerfile with optimized settings for Kimi-K2

    Verified signature
    ea506a5
  4. Add compressed-tensors and update dependencies for Kimi-K2

    Verified signature
    fac206b
  5. Apply patch BEFORE transformers import to fix is_torch_fx_available error

    Verified signature
    ef80b0e
  6. Fix import error by patching is_torch_fx_available function

    Verified signature
    b76db2a
  7. Add tiktoken dependency for model tokenizer

    Verified signature
    2345889
  8. Add application file to load Kimi-K2-Thinking model

    Verified signature
    9d2d217
  9. Add requirements for model loading

    Verified signature
    0d3e6aa
  10. Add Dockerfile for development environment

    Verified signature
    0b8536a
  11. initial commit

    Verified signature
    42a2f6a