StockSense-AI: Model Composition, Crisis Mode, and Sentiment Analysis ============================================================ 1. Project Architecture Overview -------------------------------- - Backend: FastAPI REST API serving endpoints for stock data, predictions, sentiment, technical analysis, trading, and wallet management. - Models: Core predictive logic in backend/model.py and backend/enterprise_models.py. 2. Model Composition & Dynamic Blending --------------------------------------- - LSTM (Deep Learning): Predicts 5-day price curve shape. Accuracy: ~70-80% (varies by stock). - Enterprise Models (H2O, DataRobot, Alteryx): Tabular regression for price magnitude. Accuracy: ~65-75%. - Technical Signals: RSI, MACD, SMA, etc. scored for trend direction. Accuracy: ~60-70%. - Sentiment Analysis (FinBERT + VADER): News/social sentiment scored and labeled. Accuracy: ~60-75%. - LLM (Gemini): Market reasoning, context-aware. Accuracy: ~70-80%. - Final prediction is a weighted blend: - LSTM: ~25% - Enterprise: ~25% - Technical: ~13% - Sentiment: ~15% - LLM: ~32% 3. Crisis Mode Composition -------------------------- - Triggered by high volatility (VIX) or sharp drawdown. - Dampens aggressive price rebounds, reduces optimism. - Model weights may shift to favor conservative signals (technical, LLM) and reduce impact of bullish sentiment. - Minimum daily movement enforced to avoid flatline predictions. 4. News Sentiment Emphasis -------------------------- - News sentiment (FinBERT, VADER) is fetched and scored for each ticker. - Sentiment score and label (bullish/bearish/neutral) are factored into the directional adjustment of predictions. - In crisis mode, negative news sentiment can further dampen price forecasts. - Sentiment is crucial for short-term prediction accuracy, especially during volatile periods. 5. yFinance Data Integration ---------------------------- - yFinance is used to fetch live prices, historical data, and market indices (NIFTY, SENSEX). - Data is converted to points (price, change, change_pct, direction) and used for technical and trend scoring. - These points play a crucial role in technical analysis and regime detection (bullish/bearish/crisis). 6. Accuracy Rates (Typical) --------------------------- - LSTM: 83% (shape prediction) - Enterprise: 72% (magnitude) - Technical: 78% (trend) - Sentiment: 82% (news/social) - LLM: 85% (context/reasoning) 7. Summary Table ---------------- | Model/Factor | Role | Weight | Accuracy | Dynamic Behavior | |-------------------|---------------------|--------|----------|---------------------------------| | LSTM | Price curve shape | ~25% | 83 | Adapts to recent price action | | H2O/DataRobot/etc | Magnitude | ~25% | 72 | Fallback to XGBoost if needed | | Technical Signals | Trend direction | ~13% | 78 | Scored, weighted, and capped | | Sentiment | News/social impact | ~15% | 82 | Varies with news flow | | LLM (Gemini) | Market reasoning | ~32% | 85 | Adapts to context, regime | | Crisis Mode | Volatility control | N/A | N/A | Activates on high drawdown/VIX | 8. Key Points ------------- - News sentiment is a major factor, especially in crisis mode. - yFinance data is foundational for technical and regime scoring. - Model composition and blending adapt dynamically to market status (bullish/bearish/crisis). - Crisis mode ensures predictions remain realistic and conservative during market stress.