Updated the log directory structure to change all log paths from `/home/user/logs` to `/home/user/log` to simplify file management. Also update related scripts and configuration files to reflect this change.
- Remove LFS cleanup related settings from the configuration file.
- Rename and refactor the `manage_archives` method to `check_and_cleanup_before_upload` to check the archive file count and perform the necessary cleanup before upload.
- Updated scripts to invoke new cleanup logic before upload to ensure more efficient archive management.
Adding Hugging Face data persistence tool and related configurations
- Add rules file to define writing requirements for project code and documentation.
- Add LFS storage cleanup configuration option in the configuration file.
- Added Python scripts to implement Hugging Face data persistence features, including uploading, managing, and restoring archived files.
- Updated Shell scripts to call new Python modules to streamline archive processing.
Enhance persistence configuration and scripts for Hugging Face integration
- Updated Dockerfile to create additional directories for caching and downloads.
- Modified persistence.conf to adjust sync interval and exclude patterns.
- Improved persistence-start.sh to set up Hugging Face cache directory.
- Refined persistence.sh for better error handling and configuration management.
- Added initial backup delay and improved archive handling in scripts.