Spaces:
Running
Running
|
Download README.md from duckdb-extensions/README: direct link, hf CLI and curl.
- Browser
- Download file 1.55 kB
-
https://huggingface.co/spaces/duckdb-extensions/README/resolve/main/README.md
- Command line
-
hf download hf://spaces/duckdb-extensions/README/README.md
-
curl -L -o README.md https://huggingface.co/spaces/duckdb-extensions/README/resolve/main/README.md
1.55 kB
metadata
title: README
emoji: 💻
colorFrom: yellow
colorTo: red
sdk: static
pinned: false
Project repository: https://github.com/lhoestq/duckdb-hf-extension
Installation
The extension requires DuckDB 2.0
SET allow_extension_repositories = 'allowed';
CREATE OR REPLACE EXTENSION REPOSITORY hf_repo
WITH PREFIX 'https://hf.co/buckets/duckdb-extensions/builds/resolve';
INSTALL hf FROM hf_repo;
Usage
Read/write to Hugging Face buckets, datasets, models and spaces. Optimized with Xet.
LOAD hf FROM hf_repo;
SELECT * FROM 'hf://datasets/fka/prompts.chat/prompts.csv';
SELECT * FROM hf_dataset('stanfordnlp/imdb', split := 'train');
SELECT * FROM hf_ls('hf://buckets/commoncrawl/commoncrawl/crawl-data');
COPY (SELECT * FROM range(10) t(i)) TO 'hf://datasets/me/demo/out.parquet';
COPY (SELECT * FROM read_parquet('hf://datasets/me/demo/*.parquet'))
TO 'hf://datasets/me/demo/partitioned' (FORMAT PARQUET, PARTITION_BY (kind));
Authentication
Login with the hf CLI:
hf auth login
Or pass a token manually:
CREATE SECRET (TYPE HUGGINGFACE, TOKEN 'hf_...');