rag-backend / model /loader.py

Commit History

  1. fix: update model

    imtrt004
    ab16882
  2. fix: remove exAI

    imtrt004
    6780118
  3. fix: still error

    imtrt004
    ac40983
  4. fix: still error

    imtrt004
    666afe0
  5. fix: check_model_input issue

    imtrt004
    bd1ed9f
  6. fix: update req

    imtrt004
    3e3b4c9
  7. fix: update req

    imtrt004
    01693a1
  8. fix: update req and docker

    imtrt004
    c227cde
  9. fix: update base model

    imtrt004
    11d16b6
  10. fix: exAI ropeparam

    imtrt004
    5f8085e

  1. fix: update dependency

    imtrt004
    9f311d9

  1. fix: update backend lib with log

    imtrt004
    2aa0b72
  2. fix: update model lists

    imtrt004
    7997082
  3. feat: select model from admin panel

    imtrt004
    1903740
  4. fix: update model to 360m

    imtrt004
    198a583
  5. feat: update base free model

    imtrt004
    67a030a

  1. perf: switch default LLM to SmolLM2-1.7B - 40-50% faster tok/s, better instruction following

    imtrt004
    18dc770
  2. perf: greedy decoding + dtype fix - 2-3x faster inference on CPU

    imtrt004
    d16b829
  3. fix: rewrite loader.py as clean UTF-8 - remove Windows-1252 em-dashes causing SyntaxError

    imtrt004
    8210d54
  4. feat: self-hosted Qwen2.5-1.5B-Instruct via transformers — no external API, no compilation

    imtrt004
    deea70e
  5. feat: replace llama-cpp-python/Groq with free HF InferenceClient (zero compilation)

    imtrt004
    98e3f05
  6. fix: double .gguf extension — skip symlink when path already ends in .gguf; add verbose step logging

    imtrt004
    dbce995
  7. feat: LLM readiness tracking — 503 while loading, llm_ready in /health

    imtrt004
    256f0fc
  8. fix: symlink blob to .gguf extension so llama.cpp C loader accepts it

    imtrt004
    915613c
  9. fix: use hf_hub_download + realpath to avoid snapshot ./path crash

    imtrt004
    fd0d531

  1. fix: correct GGUF filename case — Qwen3-4B-Q4_K_M.gguf

    imtrt004
    1057c73
  2. Initial backend

    imtrt004
    b5be2eb