Spaces:
Runtime error
Runtime error
Commit History
-
index.md -> readme.md; add molab links (#145)
Akshay Agrawal +1: Copilot Autofix powered by AIUnverified signatureThis PR renames index.md to README.md so the files render on GitHub. It also adds open in molab links so users can actually run the notebooks --------- Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>477e2cb
-
feat: overhaul for relaunch
Greg Wilson- Create `requirements.txt` with pinned dependencies for building site. - Update .gitignore. - Enhance Makefile. - Rename existing lessons to be lesson/dd_specific.py (two digits, lower case). - Notebooks with other names are not included in index page. - Add SQL tutorial. - Add scripts to regenerate SQLite databases. - Add queueing theory tutorial. - Rename `scripts` directory to `bin`. - Replace old `build.py` with: - `bin/extract.py` gets metadata from `*/index.md` lesson pages. - `bin/build.py` builds root home page and lesson home pages. - `bin/check_empty_cells.py`: look for empty cells in notebooks (enhanced). - `bin/check_missing_titles.py`: look for notebooks without an H1 title. - `bin/check_notebook_packages.py`: check consistency of package versions within lesson. - Add `make check_packages NOTEBOOKS="*/??_*.py"` to check package consistency within lesson. - If `NOTEBOOKS` not specified, all notebooks are che…aaef24a
-
a big --fix indeed
3b7283c
-
Merge pull request #119 from thliang01/Working-with-Apache-Arrow
Srihari ThyagarajanUnverified signatureDuckDB : Improve Apache Arrow + DuckDB notebook clarity and technical accuracy911073a
-
refactor: improve Apache Arrow notebook clarity and technical accuracy
Unverified signature- Update marimo version from 0.14.11 to 0.14.12 - Reorganize imports: move psutil and os to module level for better code organization - Clarify memory behavior: note Pandas Copy-on-Write (CoW) impact on copy operations - Improve readability: reformat performance benefits section with clearer language - Fix grammar: change "data bigger than" to "data larger than" for consistency These changes enhance the notebook's educational value by providing more accurate technical details about memory operations and improving overall code structure.2604086
-
Merge pull request #117 from thliang01/Working-with-Apache-Arrow
Srihari ThyagarajanUnverified signaturefeat: Expand Apache Arrow tutorial with advanced examples and performance benchmarksa100272
-
feat: enhance Arrow tutorial with performance benchmarks
Unverified signature- Import `sqlglot`, `psutil`, and `altair` - Add comprehensive performance comparisons between Arrow-based and traditional approaches demonstrating 2-10x speedup - Add memory efficiency analysis showing 20-40% memory savings with Arrow columnar format - Include complex query benchmarks with joins and window functions - Add memory usage tracking during zero-copy vs copy operations - Visualize performance differences using Altair charts - Fix AttributeError by updating altair_chart usage syntax - Update dependencies: duckdb 1.2.1→1.3.2, add sqlglot & psutil The enhanced tutorial now provides concrete evidence of Apache Arrow's benefits through measurable benchmarks, helping users understand the real-world performance advantages of using Arrow's columnar format and zero-copy operations in data processing workflows.b85ef90 -
chore: Update DuckDB `version` to 1.3.2
Unverified signaturea220659 -
version changes
Unverified signature40fcd1e -
update duckdb version
Unverified signature226a210
-
feat: Expand Apache Arrow tutorial with advanced examples and performance benchmarks
Unverified signature- Add comprehensive examples for converting between DuckDB, Arrow, and Polars/Pandas DataFrames - Add advanced multi-source data joining example combining DuckDB tables, Polars DataFrames, and Pandas DataFrames - Include performance demonstration with 1M row dataset showcasing zero-copy benefits - Enhance documentation with detailed explanations of Arrow's columnar format advantages - Demonstrate zero-copy conversions using .to_arrow(), pl.from_arrow(), and .to_pandas() methods - Improve code organization with hidden cells for better notebook readability - Include timing measurements to demonstrate query performance on large datasets - Expand summary section highlighting key learning outcomes This enhancement provides users with more comprehensive examples of Apache Arrow's capabilities, including real-world scenarios for combining heterogeneous data sources and quantifiable performance benefits of the zero-copy architecture.5d24bcb
-
feat: Add Apache Arrow integration tutorial notebook
Unverified signature- Create comprehensive tutorial demonstrating Apache Arrow usage with DuckDB - Cover Arrow table creation from DuckDB queries - Demonstrate loading Arrow tables into DuckDB for zero-copy operations - Include examples of interoperability with Polars and Pandas DataFrames - Add marimo notebook with interactive SQL queries and data transformations - Configure dependencies: duckdb==1.2.1, pyarrow==19.0.1, polars==1.25.2, pandas==2.2.3 This tutorial helps users understand how to leverage Apache Arrow's columnar format for efficient data transfer between DuckDB and other data processing libraries, enabling high-performance analytical workflows.ef43da6
-
docs: Add thliang01 to the list of notebook authors
Unverified signature34c490f -
refactor: Improve DuckDB Parquet tutorial notebook
Unverified signature- Add author attribution to notebook header - Add sqlglot dependency for future SQL parsing capabilities - Use consistent table references via variables instead of string literals - Remove unused pyarrow import - Improve markdown formatting for better readability The notebook now properly references the created airbnb_stock table through variables, making the code more maintainable and reducing the risk of typos in table names.e64bc6a
-
feat: Add DuckDB Parquet tutorial notebook
Create interactive marimo notebook demonstrating Parquet file analysis with DuckDB. Features remote file querying, table creation, and Airbnb stock price visualization using Plotly. - Direct FROM clause queries on remote Parquet files - read_parquet() function for optimized column selection - SQL-based time series analysis with reactive cells97902b8
-
Merge pull request #83 from Azmi-84/duckdb
Srihari ThyagarajanUnverified signatureAdd DuckDB getting started guide with interactive examples.68f7784
-
author contributions README update
Unverified signature11971dd -
fix duplicate scripts
Unverified signature04c2f10
-
Hide code cells in getting started guide for improved user experience
Azmi-84This commit updates the DuckDB getting started script by hiding code cells to streamline the user interface. The changes enhance readability and focus on the interactive components, making it easier for users to engage with the content without being distracted by the underlying code.34f04d3
-
Merge pull request #94 from marimo-team/Mustjaab/main
Srihari ThyagarajanUnverified signatureAmendment to `DuckDB_Loading_CSVs`3fb7b66
-
Enhance and redesign DuckDB introductory notebook
Azmi-84This commit addresses and resolves the suggestions provided in the review, including: - Ensuring the notebook follows the best practices outlined in the contribution guidelines. - Removing irrelevant markdown blocks and using marimo features. Additionally, the notebook has been completely redesigned with: - Improved structure and flow for better readability and learning experience. - Enhanced examples and interactive content for database connections, table creation, and data manipulation. - Better integration of visuals using Plotly and Marimo for basic interactive analysis. - Updated dependency management using for reproducibility. The notebook now provides a polished and user-friendly guide to DuckDB, ensuring a high-quality learning experience for users.e5fc993
-
fix typo
Srihari ThyagarajanUnverified signatured4325de -
typo fix
Srihari ThyagarajanUnverified signature27a6ebd -
Update duckdb/DuckDB_Loading_CSVs.py
Srihari Thyagarajan +1: CopilotUnverified signatureCo-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>84f9d62 -
changes and fixes
Unverified signature7eca5fd
-
Move imports to bottom of file
9c1149a -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>edb9168 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>d20b588 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>9319960 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>1282838 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>8dd2b9d -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>2db2198 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>b5a10e2 -
Update duckdb/009_loading_json.py
Unverified signatureCo-authored-by: Srihari Thyagarajan <57552973+Haleshot@users.noreply.github.com>2ec0628
-
Add DuckDB getting started guide with interactive examples. This commit introduces a new Python script that serves as a comprehensive guide to getting started with DuckDB. It includes interactive examples for database connections, table creation, data insertion, basic queries, and integration with Polars. The guide aims to facilitate learning and experimentation with DuckDB's features in a user-friendly manner.
Azmi-84dd84d5b
-
Include dependencies in 009_loading_json.py notebook file
f319815 -
Add DuckDB: Loading JSON notebook
6df230f
-
Create folder for duckdb
Akshay Agrawalb8aa041