Spaces:
Sleeping
Sleeping
Commit History
-
Remove hf_bulk_upload_tool (migrated to jrrribeiro/HF_Dataset_Uploader)
fe20ae1 -
Ignore generated staging; apply GUI/upload fixes: progress, cancellation, caching, mklink suppression
2574ede
-
Refactor progress bar update logic and improve error handling in upload process
847955e -
Add per-file delay and enhanced rate limiting handling in upload process
4815f65 -
Enhance upload functionality with progress tracking and error handling in BirdNET HF Bulk Upload Tool
31a2ff2
-
Add v2 of BirdNET HF Bulk Upload Tool with enhanced features and performance optimizations
5ff126a -
Add BirdNET HF Bulk Upload Tool with upload script and requirements
aed52e5 -
Add tests for batch uploader and deduplicator logic
- Implemented unit tests for BatchUploader to validate retry logic, deduplication, and file upload scenarios. - Added a test for Deduplicator to ensure it handles timeouts correctly. - Created temporary audio files and CSVs for testing purposes. - Included various log files to capture upload processes and error handling.2b0510e
-
Release 1.0.4: Critical fixes for Windows exe and upload timeouts
## Critical Bug Fixes 🔧 ### Windows Exe Issue - **Fixed**: Gradio module missing from PyInstaller bundle - **Issue**: v1.0.3 exe crashed with 'ModuleNotFoundError: No module named gradio' - **Solution**: Added explicit gradio dependency in spec file + installed package ### Upload Timeout Issues - **Fixed**: Long uploads hanging/timing out (stayed at 70%) - **Issue**: batch_uploader had wrong API parameter (path_or_file vs path_or_fileobj) - **Solution**: Corrected parameter names and added retry logic with backoff ## Changes - **build/pyinstaller_uploader.spec**: Added missing dependencies - **src/uploader/batch_uploader.py**: Fixed API parameter + added repo_type - **requirements.txt**: Ensured all dependencies are listed - **web_ui.py & README.md**: Updated to v1.0.4 ## v1.0.4 Features - ✅ Exe now starts without module errors - ✅ Uploads handle timeouts with automatic retry (up to 5 attempts) - ✅ Auto-dataset creation still works - ✅ Better error messages for upload failures ##…4e68920 -
Release 1.0.3: Auto-create datasets if they don't exist
## Major Feature: Auto-Dataset Creation 🎯 - **Web UI**: Now creates dataset automatically if not found - **CLI**: Automatically initializes dataset structure with required folders - Users no longer need to manually create datasets on HuggingFace first! ## Auto-Creation Flow 1. User enters repo_id (e.g., 'username/my-dataset') 2. App tries to validate existing dataset 3. If dataset doesn't exist: Create it automatically 4. If structure incomplete: Initialize required folders and manifest 5. Upload proceeds with a working dataset ## Error Handling Improvements - Clear error messages when dataset creation fails - Helpful hints for permission issues - Better error context for troubleshooting ## Code Changes - **web_ui.py**: Enhanced dataset validation with auto-creation - **main.py**: CLI now auto-creates datasets (upload command) - Fixed API parameter names (path_or_fileobj) ## Tested On - Web UI: Can now upload to non-existent datasets - CLI: init-repo and upload both create structu…0c612f8 -
Release 1.0.2: Critical fix for Windows exe entry point
## Critical Bug Fix - Fixed: app.py now executes correctly in PyInstaller exe - Issue: 'if __name__ == __main__:' block never runs in exe - Solution: Removed guard, code runs on import ## Improvements - Better error handling for 404 (dataset not found) - Clear instructions when dataset doesn't exist - Added test_imports.py for troubleshooting - Windows exe shows status messages ## Changes - app.py: Removed if __name__ guard, added logging - web_ui.py: Better 404 error handling with instructions - Added test_imports.py and debug.bat for debugging - Updated .gitignore to exclude build artifactsb77c32b -
Release 1.0.1: Bug fixes and improved error handling
## Bug Fixes - Fixed HfApi parameter name (path_or_file → path_or_fileobj) for CSV and shard uploads - Improved error handling in app.py with logging and traceback ## New Features - Added TROUBLESHOOTING.md with comprehensive debugging guide - Added app_debug.py for detailed error logging - Added launcher.bat for better error visibility on Windows - Added error message with proper formatting and descriptions ## Changes in src/uploader/web_ui.py - Corrected API calls to use path_or_fileobj instead of path_or_file - Both CSV upload (line 174) and shard upload (line 203) now use correct parameter ## Testing - Windows exe now logs errors to ~/.birdnet-uploader/logs/ - Better error messages for network issues and API failures - Port conflicts properly detected and reported ## Documentation - Updated README.md to link TROUBLESHOOTING guide - Web UI now shows v1.0.1 features - Provided SHA256 checksum for integrity verification54ead58 -
docs: update HF download link from GitHub to Hugging Face dataset
- Update Windows portable download link to point directly to HF dataset - Fix placeholder URLs from 'your-org' to 'jrrribeiro' - Add direct HF link in README.md with ~100 MB size info - Reference WINDOWS_PORTABLE_SETUP.md guide - Keep checksum SHA256 visible in web UI64cfee6 -
chore: update implementation files
055fe47 -
Release 1.0.0: Windows portable executable hosted on Hugging Face
- Built Windows portable with PyInstaller (100 MB zip) - Uploaded to HF dataset: jrrribeiro/birdnet-uploader-releases - Added download link to web UI with checksum - Added comprehensive documentation and upload scripts - Supports both web UI and CLI modes without Python installationba0c4c4
-
Fix environment variable references for uploader web UI in app.py
2bef5e1 -
Remove unit tests for AuthService, DetectionQueueService, EphemeralCacheManager, InviteEmailNotifier, models, project CLI, and ValidationService
92232c9 -
Import uploader files from validator workspace
4e31d1f -
Add comprehensive usage guide for BirdNET Uploader
USAGE.md covers: - Installation options (Windows standalone, pip, Docker, source) - Quick start (5-minute setup guide) - Common workflows: * Upload with progress tracking * Resume interrupted uploads * Upload with custom token * Batch uploads - Token management (3 methods: stored, env var, CLI option) - Advanced usage: * Parallel uploads with --workers * Custom dataset paths * Session management * Cache clearing for re-uploads - Troubleshooting: * No stored token * Token validation failed * Dataset not found * Upload stuck/slow * DLL not found (Windows) * Disk space issues - Dataset structure after upload - Performance tips - Security best practices - FAQ with common questions References TOKEN_SECURITY.md, TOKEN_USAGE_EXAMPLES.md, and CI_CD_PIPELINE.md for detailed info. Provides clear step-by-step instructions for end users.f961d5d -
Add comprehensive CI/CD pipeline with build and test automation
CI/CD Workflows: - Add build-and-test.yml: Main CI with multi-OS matrix testing (ubuntu, windows, macos) * test-multi-os: Run unit + integration tests on Python 3.10, 3.11, 3.12 * build-windows-exe: Build PyInstaller exe, verify with --help, run dry-run smoke test * token-security-check: Run token security tests + hardcoded token scan * docs-check: Verify TOKEN_SECURITY.md and TOKEN_USAGE_EXAMPLES.md exist Build & Publish Scripts: - Add build/build_and_publish.py: Orchestrate local build/test/publish workflow * Builds release bundle * Runs smoke test (Windows only) * Publishes to Hugging Face (optional) * Supports --clean, --smoke-test, --publish, --hf-repo options Documentation: - Add docs/CI_CD_PIPELINE.md: Complete CI/CD documentation * Workflow overview and triggers * Local development commands * PyInstaller configuration * Smoke test details * Token security in CI * Release artifact structure * Troubleshooting guide * GitHub Actions secrets setup …31e07dd -
Implement secure token handling with HF_TOKEN env var support
- Add HF_TOKEN environment variable support (priority: HF_TOKEN > keyring) - Update AuthService.get_token() to check env var before keyring - Document token resolution order in docstrings and CLI help - Add comprehensive token security guide (TOKEN_SECURITY.md) - Add token usage examples for Docker, GitHub Actions, Kubernetes (TOKEN_USAGE_EXAMPLES.md) - Add 13 new security tests in test_token_security.py: * Verify tokens never leak in error messages * Test env var takes precedence over keyring * Test whitespace stripping * Test empty env var fallback behavior * Test CLI output doesn't expose tokens - Improve Dockerfile.windows comments on token handling - Ensure tokens never appear in logs (no changes needed, design already secure) Security improvements: - CLI --token option takes precedence (for explicit control) - HF_TOKEN env var useful for Docker/CI/CD (secure at runtime) - Keyring storage for interactive local use (OS-level encryption) - All paths documented with securi…4046a11
-
Make session storage container-friendly
876cca8 -
Add uploader release flow and integration test
7c83d76
-
Replace validator app with correct uploader app from GitHub
1f2c564 -
Forçar atualização total do app
2f1a5fb
-
fix: Option B use matched absolute segment paths to prevent upload path failures
3ab4a64 -
fix: solid status color and coalesced refresh to eliminate flicker
5d694ae -
fix: stop timer churn causing status flicker in Options A/B
58e27c7 -
Add Python __pycache__ (.pyc) files
Adds compiled Python bytecode files (.pyc) under cli/__pycache__ and src/__pycache__, and updates src/ui/__pycache__/upload_app_factory.cpython-313.pyc. These are generated artifacts for Python 3.14 (and 3.13 for one file). Consider excluding __pycache__ from version control (e.g., via .gitignore) to avoid committing bytecode files.543e327 -
fix: Improve repo initialization, prevent flicker, add better error handling for ingestion
**Repo Creation (Dataset Repo tab):** - Add retry logic (3x) to ensure_project_dataset_structure with 1-2s delays - Verify API access BEFORE creating repository - Improved error messages distinguishing auth failures, permission issues, and structural problems **UI Flicker Prevention (Options A & B):** - Enhanced snapshot rendering: skip ALL outputs when nothing changed (not just status/progress) - Smart timer control: only update timer state when running status changes - Prevents continuous rerendering on unchanged snapshots **Ingestion Error Handling (Option B):** - Catch repo initialization errors early and return error report (not raising) - Improve error messages during file uploads with context - Include error details in snapshot for UI display - Truncate long error messages (>200 chars) for readability - Add debug fields to ingest result structure **Upload Retry Improvements:** - Better error context in _upload_audio_with_retry - Include failed path name in retry error message…e9b5c63 -
fix: Remove show_api incompatibility, enforce HF token, implement Option B controls, fix archive paths
- Remove show_api param from Gradio launch (Gradio version incompatibility) - Make HF Token mandatory across all tabs - Add state-aware snapshot rendering to prevent flicker - Implement Option B with async session (Start/Pause/Resume/Cancel/Refresh) - Add pause/cancel/progress callback support to ingestion backend - Fix archive wrapper folder handling (e.g. Segments/) in segment discovery - Fix stale resume-state skipping when remote file is missing - Auto-stop timer when job completes (no continuous refresh after done)0666dee
-
fix(ui): token reuse, live progress refresh, and ingestion defaults
320f383
-
feat(ui): add setup-first Dataset Repo tab with visibility option and tab prefill
f0bff77 -
fix(build): align huggingface_hub with gradio requirements
d8a95d8
-
fix(ci): force sync target to BirdNET-Uploader-App space
c933e50 -
chore(ci): set safe defaults for hf space sync target
c2c2c6e -
fix(space): pin huggingface_hub to gradio-compatible version
d575aac -
Add Python bytecode cache files
Add compiled Python bytecode (.pyc) files under src/__pycache__ and src/ui/__pycache__ (Python 3.13) for upload_app_factory and package init. These are generated artifacts and are typically excluded from version control (consider adding them to .gitignore).3a3eba5 -
refactor(ui): simplify app into two clear English workflows
bdd3e10 -
fix: add missing cli/__init__.py for proper package imports
1385c0d -
fix(space): remove invalid literal callback input in gradio handlers
4811843 -
feat(ui): add visual progress bar for segments upload status
b5f4ac8 -
feat(ui): add human-readable percentage progress for segments upload controls
7ea05c5 -
feat(space-upload): add pause/resume/cancel with background progress and auto-skip resume
e87da82 -
feat: support tar.gz compression for segments upload + add local cli script
- Replace folder picker with compressed file upload (.tar, .tar.gz, .zip) - Supports efficient .tar.gz format (50GB -> ~30GB) - Remove local path dependency (Space-compatible only) - Add upload_segments_local.py script for local execution - Update README with two upload strategies (Space vs local CLI) - Maintains directory structure during extraction20568c9 -
feat: add direct segments folder upload to hf dataset via ui button
90a0223 -
feat(local): add native folder picker for segments path selection
2b3cbf3 -
feat(ui): accept segments zip upload for HF Space dry-run and upload
d20ce7e -
fix(space): use hf port and align gradio 5.23 runtime stack
0aec723 -
fix(deploy): align space sdk and pin stable gradio4 dependency matrix
54728e9