FOXES / data

Commit History

5 days ago

  1. readme and config path updates

    12156a2
  2. merging branches

    329eff0

6 days ago

  1. added monitor for sxr_norm progress

    5be50bb

  1. fixing error in sxr normalization code missing offset

    3bff16c

  1. fixing merge

    0ba54aa
  2. bug fixes for callbacks / training

    013384c

  1. bug fixes

    218d05a

  1. Downloading data pipeline for retraining FOXES on SDOML data

    5f3578b

  1. chore: add trained weights using Git LFS

    c8c4766
  2. refactiring rest of code base and adding checkpoints

    dc04e07

  1. simplifying code structure

    7407048

  1. foxes-lite update... made for easy inference and evaluation.... removed data preprocessing and downloading pipeline pieces.

    434126c

  1. Fixed normalization of timestamp names

    00bc3f2

  1. Refactor pipeline configuration and update data processing scripts

    19c57f4
  2. removed unnecessary files

    9fa67ac

  1. Removed useless lines of code

    65a6e5a

  1. made changes to directory locations... removed some unnecessary files

    df2b9b4

  1. Update requirements and configuration files; added new dependencies and modified paths for data processing. Adjusted model parameters and batch sizes for training and inference, including simultaneous flare movie generation logic.

    d485ef2

  1. cleaning up the code base significantly

    9ebf203

  1. Various bug fixes and changes to all codes

    aace018

  1. enhance data splitting functionality.

    c37258f
  2. made evaluation easier by adding auto eval... makes configs on its own...

    3727dc5

  1. made data pipeline for data processing in process_data_pipeline.py

    045c875

  1. Update data processing scripts to use new combined directory structure; adjust validation and training splits, enhance loss calculation with updated parameters, and modify configuration files for improved model training and evaluation.

    e5d7b15

  1. made it easier to change directories for data alignment

    5fa9c4a
  2. Refactor GOES data processing to optimize loading and preparation; implement batch processing for efficient timestamp handling and create a lookup table for improved data retrieval.

    992b819
  3. Improved aligning code so that it loops through the aia data and finds associated data for most recent goes instrument

    d20abfb

  1. Enhance SXRDataProcessor with improved file processing feedback and error handling; added progress tracking for satellite data loading and detailed summary output upon completion.

    fadfdfa

  1. Update file paths in data processing scripts and enhance error handling;

    a20d050
  2. enhance FlareDownloadProcessor with dynamic max_workers and improved sampling intervals; modify inference_config.yaml for batch size and checkpoint path adjustments.

    4884108

  1. Implement a script to check downloaded data gap for SDO/AIA FITS files.

    8613ebc

  1. Updated splitting function so now it can do SXR and AIA individually... it can also repartition an already partioned folder... updated the megs models to include warm restarts, weight decay, and adaptive weights

    a7436eb

  1. updated tree structure

    12b1238