SummarizerApp / app /services

Commit History

  1. style: apply ruff formatting to structured_summarizer⁠

    ming +1: Claude
    bd7d2c1
  2. docs: add comprehensive V4 API documentation and optimize inference with SDPA⁠

    ming +1: Claude
    0072188

  1. chore: code formatting improvements and update gitignore⁠

    ming
    db3b809
  2. Add V4 local server setup with MPS optimization for Android testing⁠

    ming +1: Claude
    45b6536

  1. Remove outlines library and all related code⁠

    ming
    d25a17f
  2. Migrate to Ruff for linting/formatting and add comprehensive import tests⁠

    ming
    29ed661

  1. Fix Outlines API usage for V4 JSON streaming endpoint⁠

    ming
    b47201f

  1. Fix Outlines API usage - handle different calling patterns⁠

    ming
    4c4036e
  2. Fix Outlines import - use generator instead of generate⁠

    ming
    9452571
  3. Change Outlines debug log to info level for visibility

    ming
    5fa0ba2
  4. Add detailed Outlines API exploration and logging⁠

    ming
    f099d0c
  5. Fix Outlines import - use correct API for installed version⁠

    ming
    e8ab865
  6. Improve Outlines import error handling and logging⁠

    ming
    33cd483
  7. Improve error messaging for Outlines unavailability

    ming
    734e281
  8. Fix Python 3.10 requirement and torch_dtype deprecation⁠

    ming
    6b859f2
  9. Add Outlines JSON streaming endpoint for V4 structured summarization⁠

    ming
    441f66b

  1. Fix JSON parsing errors in V4 NDJSON stream⁠

    ming
    85dcd04
  2. fix: Move inputs to model device in _single_chunk_summarize to fix CPU/GPU device mismatch

    ming
    cfe8d29
  3. Fix device placement error in V2 BART model⁠

    ming
    12a2e7c
  4. Implement Option 3: Use FP16 for 2-3x faster inference⁠

    ming
    7fff563
  5. Optimize V4 generation speed: greedy decoding + reduced max_tokens⁠

    ming
    fd2a8c1
  6. Fix buffer parsing and strengthen brevity constraints⁠

    ming
    d112a13
  7. Optimize V4 output verbosity and generation speed⁠

    ming
    17499f7
  8. Fix bitsandbytes UID error with getpass patch⁠

    ming
    dd29a6d
  9. Switch V4 to GPU INT4 quantization with Qwen-1.5B⁠

    ming
    a36f560
  10. debug: Add comprehensive logging to diagnose 4-token issue⁠

    ming
    df75294

  1. feat: Guarantee complete V4 NDJSON summaries with fallback⁠

    ming
    b321440
  2. fix: Use Qwen chat template and harden NDJSON parsing⁠

    ming
    bf21a65

  1. feat: Change device_map to auto for V4 model⁠

    ming
    d0701b0
  2. feat: Add V4 NDJSON patch-based structured summarization⁠

    ming
    93c9664

  1. Revert adaptive token logic, restore client-controlled max_tokens⁠

    ming +1: Claude
    6a1e8a3
  2. fix: Backend ignores client max_tokens to verify Android app hypothesis⁠

    ming +1: Claude
    80ea70f
  3. fix: CRITICAL - Override model config defaults causing early stopping⁠

    ming +1: Claude
    6c96c54
  4. fix: Improve V3 summary completeness with enhanced token allocation⁠

    ming +1: Claude
    6b2de93
  5. fix: V3 API mid-sentence cutoff with adaptive token calculation⁠

    ming +1: Claude
    5e83010

  1. feat: Implement V3 Web Scraping + Summarization API⁠

    ming
    2ed2bd7

  1. Update v2 API and HF streaming summarizer improvements

    ming
    fc9914e
  2. Improve V2 summarization: adaptive tokens, recursive summarization, better defaults⁠

    ming
    9884884
  3. Comment out asyncio.sleep for better streaming performance

    ming
    698636a

  1. Enhance HF V2 summaries: increase token limits, improve length parameters⁠

    ming
    52f6c42
  2. Improve V2 summarization prompts for more detailed output⁠

    ming
    de8b12b
  3. Add model ID logging to HF streaming service⁠

    ming
    e186c67
  4. Fix HF streaming beam expansion issue⁠

    ming
    df1ab37
  5. Enforce singleton batch for HF streaming (fix TextStreamer batch size 1 error)⁠

    ming
    843f837
  6. Fix BatchEncoding normalization and attention_mask creation⁠

    ming
    357c039
  7. Harden HF V2 streaming + full traceback logging⁠

    ming
    f293bb9
  8. Fix HF streaming crash: enforce batch size = 1 for TextIteratorStreamer⁠

    ming
    3570bfd
  9. Fix TextStreamer batch size error in V2 API⁠

    ming
    87d9e3a
  10. Add support for sshleifer/distilbart-cnn-6-6 model for V2 API⁠

    ming
    6e48ad3
  11. Improve HuggingFace model error handling and startup robustness⁠

    ming
    bf6cabf