Open
Description
Description
Lance is becoming more and more popular (and arguably significantly better than parquet). It would be awesome if write_lance
supports streaming writes like write_parquet
does, that way we can process large datasets spanning many terabytes without having to memory about materialization / memory constraints
Use case
No response