Spaces:
Running
Running
Commit History
-
fix(pipeline): stop abandoning slow NCBI BLAST jobs + EBI fallback
NCBI BLAST routinely exceeds its optimistic RTOE under load, but the stuck heuristic (max(RTOE*5, 180s)) declared jobs STUCK after ~3 minutes even with a 900s poll budget, then re-submitted and failed 3x. The poll now gives a job at least half its budget before declaring STUCK. Add a resilience net: when NCBI fails or returns unparsable output, the pipeline BLAST step falls back to EBI BLAST (uncached, so transient errors are not cached for 24h), mapping NCBI databases to EBI equivalents. The pipeline only fails when both providers fail. BlastTool stype mapping fixed for blastx/tblastn. Verified: 8 new resilience tests + full seq_tools (48) pass; frontend tsc clean.60c8e2d
-
fix(blast): handle NCBI server overload gracefully
- Sync-mode fallback now uses a 300s httpx timeout (was 60s, which broke NCBI blocking responses for slow nr queries) and short-circuits inline READY results without a second poll cycle - Poll interval lowered to 5s when an API key is present (NCBI allows 3 req/s with a key) - Stuck-job threshold raised to max(5x RTOE, 180s) so overloaded NCBI jobs aren't abandoned prematurely - Fast-mode BLAST budget raised 180s -> 600s, normal mode 600s -> 900s to survive NCBI overload windows908c122
-
fix: harden BLAST pipeline against NCBI timeouts and server overload
- Add EMAIL parameter to NCBI submit_blast (required by NCBI API) - Catch httpx.TimeoutException and HTTPStatusError in _request_with_retry - Add stuck-job detection in check_status_until_ready (5x RTOE threshold) - Add synchronous mode fallback when async RTOE is unreasonable (>300s) - Tolerate up to 3 consecutive poll failures before giving up - Increase retries from 1 to 2 (3 total attempts) - Increase poll start delay from 5s to 10s (NCBI rate limit guidance) - Add QUEUED status handling in poll loop - Fix EBI BlastTool: increase poll timeout (120->180s), add failure tolerance - Pipeline v2: pass retries=2 to run_blast_with_retry - Add comprehensive BLAST test suite (test_blast_comprehensive.py) with: * Multiple protein datasets (crambin, insulin, GFP, lysozyme, hemoglobin) * Full NCBI roundtrip tests, XML parsing, retry verification * EBI BLAST tool tests, error handling (empty/invalid/long sequences) * Random fuzz tests (5 random sequences), consecutive reliability tests …2dadeea
-
fix: increase BLAST timeout from 5min to 10min for long proteins
- blast.py: max_wait_seconds default 300 -> 600 - pipeline_v2.py: non-fast-mode timeout 300 -> 600 - TP63 (761aa) against nr needs >5min, was timing out1ed0170
-
fix: NCBI_API_KEY not loading - blast.py read os.environ before dotenv
- Add NCBI_API_KEY to Settings class in config.py - blast.py now reads from settings instead of raw os.environ - Fixes 429 rate limiting on all NCBI BLAST requestscd964d7 -
fix: remove NCBI rate limiting, retry only on connection errors
16dd8be -
fix: BLAST reliability - API key, exponential backoff, retry, error tracking
7bbb868
-
fix: strip NCBI QBlastInfo preamble before XML parsing
a0c9dbc
-
fix: handle NCBI UNKNOWN status and add pathway_enrichment to frontend status order
6547179
-
fix: E-value underflow, AlphaFold step, steps_completed append, UniProt always runs
3154548
-
Deploy prep: Render config + Dockerfile, refactored backend auth flow, dashboard, landing page, error states, guest flow
76fb273