Spaces:

Comfoa
/

Civilly-Simplified-Backend

Sleeping

App Files Files Community

Civilly-Simplified-Backend / backend

Commit History

May 31

03:57
fix:fetch-page-image-urls-for-existing-records

Comfoa

ccaa906
03:49
fix:populate-page-image-urls-in-fetch-latest-endpoint

Comfoa

a3a2425
03:43
fix:add-OCR-deps-and-Dockerfile-system-libs

Comfoa

781c298
00:34
feat: scrape all cities every 2h add /api/scrape-all cron endpoint enable Sulphur Springs

Comfoa

74a944c

May 30

21:02
fix: add asyncio timeouts to prevent Vercel 502 on slow Laserfiche fetches

Comfoa

3890aa9
19:50
fix: replace paid Google Vision with free Hugging Face OCR (TrOCR + Nougat)

Comfoa

98be750
19:46
fix: 502/503 errors, add Google Vision OCR, improve geo-locate robustness

Comfoa

a3716c2
19:41
fix: complete OCR pipeline rewrite - 3-tier, all pages, all engines

Comfoa

210a6bf
19:36
fix: OCR async, connector fetch_page_images, lambda closures, parsers init

Comfoa

36f705a
17:38
fix: force re-summarize with force parameter, remove broken _execute import

Comfoa

22e3f53
17:23
feat: add force parameter to fetch-latest to clear cached summaries

Comfoa

b4ac2b4
17:09
fix: OCR.space during document fetch (not summarization) to stay within Vercel 10s timeout

Comfoa

3027ea9
16:46
fix: prefer existing raw_text over OCR to avoid Vercel 10s timeout

Comfoa

953436d
16:40
fix: reduce OCR.space to 1 page to fit within Vercel free plan 10s timeout

Comfoa

a24463b
16:28
fix: add traceback logging for Groq httpx calls to debug deployment failure

Comfoa

3b5f1e6
16:17
fix: replace OpenAI SDK with direct httpx calls to Groq API to avoid SDK compatibility issues on Vercel

Comfoa

04a041b
16:08
fix: use AsyncOpenAI consistently with await for all Groq API calls

Comfoa

e51ca76
05:22
fix: wrap Groq API call in try/except to catch async exceptions and surface error reason

Comfoa

566bc9a
05:19
fix: use AsyncOpenAI with await for non-blocking Groq API calls in async context

Comfoa

fce292b
05:15
fix: sync Groq call directly in async context, removed asyncio.to_thread that was causing silent failures

Comfoa

f64e1e0
05:11
fix: run Groq API call in thread via asyncio.to_thread to avoid blocking event loop

Comfoa

629252a
05:06
fix: remove failing Groq Vision API, use only free OCR.space API for scanned document OCR

Comfoa

03edaaf
05:02
fix: reuse event loop across requests in ASGI bridge, make OCR.space sync to avoid loop issues

Comfoa

ad6b9b4
04:56
fix: use Groq Vision API (llama 3.2 11B) to read text from scanned images, fallback to OCR.space, then text

Comfoa

5188afe
04:53
fix: use free OCR.space API as primary OCR on Vercel Lambda, Groq Vision removed to avoid circular import

Comfoa

9b8828f
04:47
fix: Vision API now extracts text first (no JSON mode), falls back to free OCR.space API, added httpx dep

Comfoa

19d4905
04:43
fix: always try free Groq Vision API for OCR first on Vercel Lambda, fallback to local OCR only if Vision fails

Comfoa

a134d66
04:06
feat: add server-side Groq Vision API for OCR on Vercel Lambda — reads text from images directly, no local OCR needed

Comfoa

8f26d9d
03:57
fix: combine ASGI-to-WSGI bridge with direct lifespan init for connectors/DB/summarizer

Comfoa

6d83c40
03:54
fix: use Mangum lifespan=auto so DB, connectors, and summarizer initialize on first request

Comfoa

a52678f
03:07
fix: replace Mangum with custom ASGI-to-WSGI bridge for Vercel experimentalServices

Comfoa

af12bff
03:03
fix: set Mangum handler to Handler.HTTP explicitly for Vercel experimentalServices

Comfoa

7df68d3
03:01
fix: add cryptography to requirements - missing Fernet import

Comfoa

826c4b5
02:59
fix: add back numpy and Pillow deps required by social card generation

Comfoa

7335778
02:58
fix: remove uvicorn[standard] native deps - use bare uvicorn for Lambda compatibility

Comfoa

cfc8130
02:55
fix: absolute minimal WSGI entry point - imports only inside handler

Comfoa

9c10afa
02:48
fix: replace psycopg2-binary with pg8000 (pure Python) to avoid Vercel Lambda 250MB native dep crash

Comfoa

65d006f
02:43
fix: make Vercel entry point lazy-load FastAPI on first request to prevent cold-start crash

Comfoa

39db043
02:20
fix: wrap lifespan startup in try/except so health endpoint works even if DB init fails

Comfoa

21bb921
01:53
fix: lazy import psycopg2 inside _get_pg_conn() to prevent Vercel Lambda crash on module load

Comfoa

8cd9061
01:09
fix: remove stale backend/vercel.json that was conflicting with top-level experimentalServices

Comfoa

c0f069c

May 29

23:29
feat: Vercel-ready OpenCouncil with 3 cities connected (Paris, Sulphur Springs, Frisco)

Comfoa

6ce841a

May 10

02:06
Add PG migration for big_picture and what_you_can_do columns

Comfoa

8b0bf2b
02:04
Implement Three P's framework: Life-Centric categories, Big Picture TL;DR, What You Can Do

Comfoa

ec586f2
01:02
fix: align DeepSeek JSON output schema with frontend TypeScript interfaces

Comfoa

8afcaa0
00:02
feat: improve OCR preprocessing pipeline with upscaling, deskew, Otsu threshold, morphology, and multi-PSM Tesseract strategy

Comfoa

6c3e68f

May 9

23:50
Add /api/minutes/seed endpoint for pushing pre-computed OCR data to HF Space PostgreSQL

Comfoa

a40a869
23:47
Add pre-computed OCR database for Paris city council minutes

Comfoa

ba1c420
22:25
Fix: detect stub text in _summarize_with_text and return _build_unreadable_response before calling DeepSeek (prevents LLM from echoing 'not available' message as summary)

Comfoa

812fab8
22:07
Fix HF deployment: handle missing OCR engines + stub text detection

Comfoa

2433aa4

Commit History

May 31

fix:fetch-page-image-urls-for-existing-records

fix:populate-page-image-urls-in-fetch-latest-endpoint

fix:add-OCR-deps-and-Dockerfile-system-libs

feat: scrape all cities every 2h add /api/scrape-all cron endpoint enable Sulphur Springs

May 30

fix: add asyncio timeouts to prevent Vercel 502 on slow Laserfiche fetches

fix: replace paid Google Vision with free Hugging Face OCR (TrOCR + Nougat)

fix: 502/503 errors, add Google Vision OCR, improve geo-locate robustness

fix: complete OCR pipeline rewrite - 3-tier, all pages, all engines

fix: OCR async, connector fetch_page_images, lambda closures, parsers init

fix: force re-summarize with force parameter, remove broken _execute import

feat: add force parameter to fetch-latest to clear cached summaries

fix: OCR.space during document fetch (not summarization) to stay within Vercel 10s timeout

fix: prefer existing raw_text over OCR to avoid Vercel 10s timeout

fix: reduce OCR.space to 1 page to fit within Vercel free plan 10s timeout

fix: add traceback logging for Groq httpx calls to debug deployment failure

fix: replace OpenAI SDK with direct httpx calls to Groq API to avoid SDK compatibility issues on Vercel

fix: use AsyncOpenAI consistently with await for all Groq API calls

fix: wrap Groq API call in try/except to catch async exceptions and surface error reason

fix: use AsyncOpenAI with await for non-blocking Groq API calls in async context

fix: sync Groq call directly in async context, removed asyncio.to_thread that was causing silent failures

fix: run Groq API call in thread via asyncio.to_thread to avoid blocking event loop

fix: remove failing Groq Vision API, use only free OCR.space API for scanned document OCR

fix: reuse event loop across requests in ASGI bridge, make OCR.space sync to avoid loop issues

fix: use Groq Vision API (llama 3.2 11B) to read text from scanned images, fallback to OCR.space, then text

fix: use free OCR.space API as primary OCR on Vercel Lambda, Groq Vision removed to avoid circular import

fix: Vision API now extracts text first (no JSON mode), falls back to free OCR.space API, added httpx dep

fix: always try free Groq Vision API for OCR first on Vercel Lambda, fallback to local OCR only if Vision fails

feat: add server-side Groq Vision API for OCR on Vercel Lambda — reads text from images directly, no local OCR needed

fix: combine ASGI-to-WSGI bridge with direct lifespan init for connectors/DB/summarizer

fix: use Mangum lifespan=auto so DB, connectors, and summarizer initialize on first request

fix: replace Mangum with custom ASGI-to-WSGI bridge for Vercel experimentalServices

fix: set Mangum handler to Handler.HTTP explicitly for Vercel experimentalServices

fix: add cryptography to requirements - missing Fernet import

fix: add back numpy and Pillow deps required by social card generation

fix: remove uvicorn[standard] native deps - use bare uvicorn for Lambda compatibility

fix: absolute minimal WSGI entry point - imports only inside handler

fix: replace psycopg2-binary with pg8000 (pure Python) to avoid Vercel Lambda 250MB native dep crash

fix: make Vercel entry point lazy-load FastAPI on first request to prevent cold-start crash

fix: wrap lifespan startup in try/except so health endpoint works even if DB init fails

fix: lazy import psycopg2 inside _get_pg_conn() to prevent Vercel Lambda crash on module load

fix: remove stale backend/vercel.json that was conflicting with top-level experimentalServices

May 29

feat: Vercel-ready OpenCouncil with 3 cities connected (Paris, Sulphur Springs, Frisco)

May 10

Add PG migration for big_picture and what_you_can_do columns

Implement Three P's framework: Life-Centric categories, Big Picture TL;DR, What You Can Do

fix: align DeepSeek JSON output schema with frontend TypeScript interfaces

feat: improve OCR preprocessing pipeline with upscaling, deskew, Otsu threshold, morphology, and multi-PSM Tesseract strategy

May 9

Add /api/minutes/seed endpoint for pushing pre-computed OCR data to HF Space PostgreSQL

Add pre-computed OCR database for Paris city council minutes

Fix: detect stub text in _summarize_with_text and return _build_unreadable_response before calling DeepSeek (prevents LLM from echoing 'not available' message as summary)

Fix HF deployment: handle missing OCR engines + stub text detection