Spaces:
Sleeping
Sleeping
Commit History
-
perf: optimize ensemble for CPU inference on HuggingFace Spaces
aviseth- Increase timeouts: 45s per model, 60s total (from 20s/30s) - Reduce max_length from 256 to 128 tokens for faster inference - Truncate input text to 2000 chars to reduce processing time - Use torch.inference_mode() instead of no_grad() for better performance - Update timeout error message to explain CPU limitations93a6c45
-
fix: suppress beta/gamma warnings globally and increase ensemble timeouts for CPU
aviseth- Move warning filters to module level (before imports) to catch all warnings - Increase per-model timeout from 10s to 20s for HF Spaces CPU - Increase total ensemble timeout from 15s to 30s - Prevents timeout failures on CPU-only inferencebb4a756 -
fix: suppress tokenizer and model loading warnings on HF Spaces
aviseth- Set clean_up_tokenization_spaces=True explicitly on AutoTokenizer.from_pretrained() to silence the FutureWarning about the default changing in transformers v4.45 - Wrap AutoModelForSequenceClassification.from_pretrained() in warnings.catch_warnings() to suppress the UserWarning about beta/gamma parameter renames in XLNet LayerNorm layers - Import warnings stdlib module5412e6a
-
fix: f-string backslash syntax error in generate_explanation_text
aviseth69e2ee8
-
refactor: clean up inference.py, remove inline comments, extract _patch_xlnet_configs
avisethf2161c4 -
fix: use slow tokenizer for roberta to avoid tokenizer.json format incompatibility
aviseth2b9ff0f
-
fix: default MODEL_NAMES to fine-tuned HF repos, fix .gitignore
aviseth4e491ac -
fix: smart MODELS_DIR path resolution for Docker
avisetheca2087
-
fix: remove deprecated use_cache from xlnet config
aviseth8214774 -
fix: patch xlnet tokenizer_config at runtime
avisethe83ba6b -
fix: Python 3.9 compat list[dict] type hints
avisethc5c3134 -
fix: preload all models at startup
aviseth5188693 -
fix: evict model cache to prevent OOM
avisethb8be780 -
fix: remove syntax error in xlnet inference
aviseth2f435d5 -
fix: xlnet list fields in _token_importance
avisethd08d3f2 -
fix: xlnet tokenizer list fields
aviseth7ff3220 -
fix: distilbert token_type_ids and xlnet inference errors
avisetheede205 -
Initial deployment
06e73d2