8000 Deltacat V2 API Milestone · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
New issue

Deltacat V2 API

No due date 0% complete

Create DeltaCAT V2 APIs, including (1) a native DeltaCAT Catalog implementation, (2) a native DeltaCAT CLI and corresponding Linux-FS-like APIs, (3) Ray/Daft Data source/sink adapters (to enable local/distributed reads/writes of DeltaCAT catalogs).

The DeltaCAT Catalog implementation should also include all capabilities indeltacat/storage/rivulet/dataset.py…

Create DeltaCAT V2 APIs, including (1) a native DeltaCAT Catalog implementation, (2) a native DeltaCAT CLI and corresponding Linux-FS-like APIs, (3) Ray/Daft Data source/sink adapters (to enable local/distributed reads/writes of DeltaCAT catalogs).

The DeltaCAT Catalog implementation should also include all capabilities indeltacat/storage/rivulet/dataset.py (mostly on the table version level), including:

  1. Manage (multiple) schemas on dataset
  2. Import data (e.g. from_csv)
  3. Export data (e.g. to webdataset)
  4. Read and write methods (currently, deltacat catalog has somewhat different read/write methods from rivulet)
Loading
0