Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
Commit History
-
feat: local dataset paths, API route, and versioned fetch routing
alexis779- Add server API to read local LeRobot dataset files safely (path validation). - Add localDataset helpers, internalFetch, and parquet/versionUtils updates for local vs Hugging Face URLs. - Wire home, episode viewer, stats, and filtering panels to local dataset flow. - Add unit tests for localDataset and extend versionUtils tests. - Add .gitignore and .prettierignore (node_modules, .next, build artifacts). Made-with: Cursorbe47857
-
add unit tests for all dataset version parsers and CI workflow
- Tests for stringFormatting (v3.0 path builders) - Tests for typeGuards (BigInt/parquet helpers) - Tests for dataProcessing (chart grouping pipeline) - Tests for parquetUtils (formatStringWithVars with v2.0/v2.1 templates, arrayToCSV, getRows) - Tests for versionUtils (buildVersionedUrl + mocked getDatasetVersionAndInfo for v2.0/v2.1/v3.0) - Tests for fetch-data (computeColumnMinMax + version-specific path construction) - GitHub Actions workflow to run tests on push/PR to main Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>8d999b7
-
load the episode’s row range for v3 datasets (based on the file’s start index
Unverified signature1f94f4a
-
remove old ref
Unverified signature2985a11 -
memory cap and cache cleanup
Unverified signature0ec6cb5
-
fix(memory): prevent server OOM from unbounded Next.js fetch cache and dataset info cache
- Add `cache: "no-store"` to fetchParquetFile, fetchJson, and tasks.jsonl fetch so Next.js does not accumulate large parquet ArrayBuffers in its Data Cache across many requests over days of continuous operation - Cap datasetInfoCache at 200 entries with FIFO eviction to prevent unbounded growth Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>2b90078
-
style: run prettier formatting
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>291477f
-
Merge branch 'main' into feat/speedup_visulization
Unverified signaturee457eba -
style: run prettier formatting
Fix code style issues in 5 files to pass format:check CI. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>59b5c7b -
refactor: extract utilities and improve type safety (Phases 1-3)
This PR implements a comprehensive refactoring to improve code maintainability and type safety without changing any functionality. ## Phase 1: Extract Constants - Created src/utils/constants.ts with centralized constants - Eliminated 40+ magic numbers (padding values, thresholds, config) - Updated all files to import from constants module ## Phase 2: Extract Business Logic - Created src/utils/dataProcessing.ts with chart processing functions - Extracted ~500 lines of duplicated scale grouping logic - Functions: groupRowBySuffix, computeGroupStats, groupByScale, etc. - Created src/utils/languageInstructions.ts for language extraction - Consolidates duplicate logic from v2 and v3 data fetching - Created src/utils/stringFormatting.ts for path formatting - Standard padding and path building utilities ## Phase 3: Improve Type Safety - Created src/utils/typeGuards.ts with type guard functions - Replaced 15+ unsafe type assertions with proper type guards - Added typed interfaces fo…2cbfbf8 -
chore: apply Prettier formatting
Run prettier --write to fix code style across all files. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>28ef794 -
feat: add comprehensive TypeScript types and type checking
Add complete TypeScript type definitions for the entire codebase based on the LeRobot dataset format, replacing all `any` types in core modules with proper types. ## Type Definitions Added - Create `src/types/` directory with domain-based type organization - `dataset.types.ts`: Dataset metadata, features (video, numeric, boolean) - `episode.types.ts`: Episode data structures for v2.x and v3.0 formats - `video.types.ts`: Video info and segmentation types - `chart.types.ts`: Chart data structures ## Core Changes - Replace all `any` types in data fetching (`fetch-data.ts`, `parquetUtils.ts`) - Add return types to all functions in episode data processing - Type component props in `episode-viewer.tsx`, `side-nav.tsx`, `data-recharts.tsx` - Fix BigInt/number conversions for v3.0 dataset compatibility - Handle null checks for optional fields (video_path, timestamps) ## Build & CI/CD - Add `type-check`, `type-check:watch`, and `validate` scripts to package.json - Remove `ignoreBuildErrors` …4f26d07
-
fix playback and typing
Unverified signaturea990603 -
perf: faster video loading
Unverified signature9196260
-
change the way we check the dataset version (#8)
8ffbccb
-
Fix/dataset v3 (#3)
* fix metadata reading for dataset v3 * remove debuggingc8b127a
-
clean debugging and unused functions and vars
eff9a58 -
Refactor episode data loading to support v3.0 structure and enhance video player segmentation features. Added debug logging for version checks and data loading processes (will remove later).
aa2bc0d
-
Added check for v3.0
5fe6175 -
Added files from Mishig PR
Co-authored-by: Mishig <dmishig@gmail.com>8a37195