-
Notifications
You must be signed in to change notification settings - Fork 67
Insights: Lightning-AI/litData
Overview
Could not load contribution data
Please try again later
1 Release published by 1 person
-
v0.2.49
published
Jun 4, 2025
6 Pull requests merged by 1 person
-
fix: suppress FileNotFoundError when acquiring file lock for count file
#615 merged
Jun 6, 2025 -
docs: Add documentation for batching methods in CombinedStreamingDataset
#609 merged
Jun 4, 2025 -
Update bug report template with Lightning Studio sharing instructions
#611 merged
Jun 4, 2025 -
🕒 Add Test Duration Reporting to Pytest in CI
#614 merged
Jun 4, 2025 -
bump version to 0.2.49
#613 merged
Jun 4, 2025 -
fix: Mark flaky tests to rerun on failure
#610 merged
Jun 3, 2025
2 Pull requests opened by 1 person
-
chore: suppress FileNotFoundError for locks in downloader classes
#617 opened
Jun 8, 2025
5 Issues closed by 2 people
-
[Errno 2] No such file or directory: '/cache/chunks/.../chunk-7-0.bin.cnt.lock'
#566 closed
Jun 6, 2025 -
Add pytest fixture to limit max time a test can take
#475 closed
Jun 3, 2025
1 Issue opened by 1 person
-
Explore Optimizing and Running Tests in Parallel for Faster CI in `litdata`
#612 opened
Jun 4, 2025
9 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Add batch sampler for StreamDataloader to enable flexiable training strategy.
#509 commented on
Jun 3, 2025 • 0 new comments -
CI error: `All chunks should've been deleted` keeps coming back
#437 commented on
Jun 3, 2025 • 0 new comments -
`OutOfBoundsError` when streaming parquet files with `low_memory=True`
#553 commented on
Jun 3, 2025 • 0 new comments -
Clear Examples of use with different dataset types and code changes.
#409 commented on
Jun 3, 2025 • 0 new comments -
Investigate keeping the content of the downloaded chunks in RAM instead of writing it to file.
#291 commented on
Jun 4, 2025 • 0 new comments -
Add training mode compression for zstd
#283 commented on
Jun 4, 2025 • 0 new comments -
RuntimeError: Can't start new thread
#280 commented on
Jun 4, 2025 • 0 new comments -
Optimize fails with StreamingDataloader as inputs for >=5 workers while optimizing hf dataset
#599 commented on
Jun 8, 2025 • 0 new comments -
Add support for multi sample item in optimize and yielding from the _getitem_ of the StreamingDataset
#317 commented on
Jun 8, 2025 • 0 new comments