-
Notifications
You must be signed in to change notification settings - Fork 279
Insights: dlt-hub/dlt
Overview
Could not load contribution data
Please try again later
1 Release published by 1 person
-
1.11.0
published
May 15, 2025
56 Pull requests merged by 14 people
-
dlt.transformation implementation
#2528 merged
May 30, 2025 -
dlt marimo app pre-release version
#2662 merged
May 30, 2025 -
Add support for creating custom integer-range partition table in BigQuery
#2676 merged
May 30, 2025 -
docs: fix invalid bigquery reference in athena destination
#2700 merged
May 30, 2025 -
Simplify pipeline test utils
#2566 merged
May 30, 2025 -
fix: incrementally watch files
#2697 merged
May 30, 2025 -
QoL: improved
__repr__()for public interface#2630 merged
May 29, 2025 -
Fix/2527-transformations: snowflake case sensitivity workaround
#2694 merged
May 28, 2025 -
removes standalone resources, fixes transformation function wrapping
#2684 merged
May 28, 2025 -
docs: dlt+ iceberg destination partitioning
#2686 merged
May 27, 2025 -
fix/2677: remove recursive filewatching
#2678 merged
May 26, 2025 -
Simplify workflow files
#2663 merged
May 25, 2025 -
Prevent unecessary preliminary connection in dataset
#2645 merged
May 22, 2025 -
warn when resolving configs or secrets with placeholder values
#2636 merged
May 21, 2025 -
changes contrib and README
#2666 merged
May 21, 2025 -
feat: 2540 - SQLGlot type mapping
#2587 merged
May 20, 2025 -
fix: broken info tables fallback test
#2668 merged
May 20, 2025 -
Feat: Add configuration propagation to deltalake.write_deltalake (#2629)
#2640 merged
May 20, 2025 -
Feat: Support clustered tables with custom column order in BigQuery destination
#2638 merged
May 19, 2025 -
feat: Expand sql table resource config
#2396 merged
May 19, 2025 -
disables synapse and databricks ibis connector
#2650 merged
May 16, 2025 -
2529-INFO_TABLES_QUERY_THRESHOLD-as-paramterer-from-config
#2600 merged
May 15, 2025 -
fixes wrong docs links that came from nowhere
#2646 merged
May 15, 2025 -
Normalize model files
#2507 merged
May 15, 2025 -
master merge 1.11.0 release
#2644 merged
May 15, 2025 -
Docs: addition of normalizer behaviour to transformations docs
#2639 merged
May 15, 2025 -
fixes fsspec instantiation in fs source
#2634 merged
May 14, 2025 -
[doc/dlt+] renames sidebar and adds intro snippet for snowflake+
#2642 merged
May 14, 2025 -
cli: fix 404 in the "ai" command output
#2643 merged
May 14, 2025 -
Added Transform data with add_map documentation
#2500 merged
May 14, 2025 -
Added section using xmin for Change Data Capture (CDC) to pg_replication docs
#2535 merged
May 14, 2025 -
Added info about dlt's internal tables
#2525 merged
May 14, 2025 -
docs: split incremental loading page
#2592 merged
May 14, 2025 -
removes airflow Airflow DummyOperator import
#2628 merged
May 13, 2025 -
Feat/2609-clickhouse-precision-integer-mapping
#2627 merged
May 13, 2025 -
docs: add advanced project tutorial
#2338 merged
May 12, 2025 -
Added dedup sort example
#2235 merged
May 12, 2025 -
bumps pendulum and docs
#2624 merged
May 12, 2025 -
enables fsspec per-thread instance cache and updates documentation
#2621 merged
May 12, 2025 -
fixes parquet data writer settings docs & rewrites configuration docs
#2583 merged
May 11, 2025 -
docs: Fix incorrect nesting in secrets.toml
#2614 merged
May 7, 2025 -
Docs/changes to advanced tutorial
#2465 merged
May 7, 2025 -
refactor init-command for use in dlt project
#2568 merged
May 7, 2025 -
fix some typos in cursor-restapi docs
#2608 merged
May 7, 2025 -
Enabling 'model' loader_file_format for athena, synapse and dremio
#2556 merged
May 6, 2025 -
Extract dataset code snippets into tests snippets system
#2598 merged
May 6, 2025 -
slightly clarify clickhouse docs
#2594 merged
May 5, 2025 -
list secrets in vault config provider to avoid calls to backend
#2597 merged
May 5, 2025 -
athena: fix a typo in the athena_adapter docstring
#2599 merged
May 5, 2025 -
explicit snowflake autocommit
#2593 merged
May 3, 2025 -
fix: update placeholder values in TOML writer tests
#2589 merged
May 2, 2025 -
normalize_py_arrow_item now replaces load id column with the right one
#2526 merged
May 2, 2025 -
added marimo to index
#2590 merged
May 2, 2025 -
Fix: drop corresponding staging table when original table is dropped
#2567 merged
May 2, 2025 -
feat: 2540 lineage
allow_unknown_columnsandallow_anonymous_columns#2577 merged
May 2, 2025 -
docs: marimo docs page added
#2584 merged
May 2, 2025
13 Pull requests opened by 9 people
-
Add linter step to prevent large files being merged
#2588 opened
May 2, 2025 -
feat: 2540 - incremental datasets
#2612 opened
May 7, 2025 -
Detect wether query just filters rows or is more complex with sqlglot
#2619 opened
May 9, 2025 -
QoL: warning with hint to provide data types for columns with exclusively None values
#2633 opened
May 13, 2025 -
feat: top-level `dlt.dataset()`
#2654 opened
May 16, 2025 -
Psycopg2SqlClient: accept extra options
#2656 opened
May 17, 2025 -
Fixing docs broken link
#2657 opened
May 17, 2025 -
Upsert merge strategy for iceberg
#2671 opened
May 22, 2025 -
Docs: updated on API rate-limit handling & incremental cursor errors
#2682 opened
May 26, 2025 -
adds parquet support to postgres via adbc
#2685 opened
May 26, 2025 -
Replace def _limit_clause_sql with sqlglot
#2689 opened
May 27, 2025 -
motherduck destination config improvement: uppercase env var
#2703 opened
May 30, 2025
24 Issues closed by 8 people
-
Transformations
#2527 closed
May 30, 2025 -
Add better support for BigQuery partitions
#2516 closed
May 30, 2025 -
Credentials/configs with placeholder values should emit warnings during resolution
#2605 closed
May 26, 2025 -
Ensure factory functions of core sources produce nice default values
#2547 closed
May 22, 2025 -
Sane defaults in config and secrets
#2531 closed
May 21, 2025 -
Expand sql star queries to explicitly list all columns in transformations
#2660 closed
May 21, 2025 -
Make delta destination configurable (pass more parameters to underlying write_deltalake)
#2629 closed
May 20, 2025 -
BigQuery destination does not respect column clustering order
#2545 closed
May 19, 2025 -
Google Sheets Problem
#2652 closed
May 16, 2025 -
AWS Athena Information Schema Error with Large Table Lists in dlt Pipeline
#2529 closed
May 15, 2025 -
extract and normalize Model data item
#2493 closed
May 15, 2025 -
Dynamic table name hints does not create the correct tables in the destination
#2626 closed
May 15, 2025 -
support postgres xmin replication
#2376 closed
May 14, 2025 -
ClickHouse: Support precision-based integer type mapping
#2609 closed
May 13, 2025 -
Create a tutorial on how to create a Python package of dlt+ Project for data access
#2323 closed
May 12, 2025 -
SQL: `reflection_level` defaults to `full` despite documentation stating `minimal`
#2613 closed
May 12, 2025 -
Evaluate python-pendulum 3.1.0 for Python 3.13 support
#2602 closed
May 12, 2025 -
Increased memory usage with dlt > 1.3.0 and filesystem module during extract phase
#2221 closed
May 12, 2025 -
Defaults are inconsistent for json_normalizer and parquet_normalizer
#2615 closed
May 12, 2025 -
Parquet configuration docs misleading
#2579 closed
May 11, 2025 -
Enable 'model' loader_file_format for athena, synapse and dremio
#2554 closed
May 6, 2025 -
HTTPS (port) not being used when specified in the clickhouse db
#2585 closed
May 5, 2025 -
Resetting a pipeline resource should also drop staging table
#2534 closed
8000May 2, 2025 -
Heterogeneous columns in Pandas data frames fail to extract
#2536 closed
May 2, 2025
45 Issues opened by 33 people
-
bug: `ReadableIbisRelation` mutates dataset `Schema`
#2704 opened
May 30, 2025 -
Allow loading `load_info` and `pipeline.last_trace` as single tables
#2702 opened
May 30, 2025 -
Marimo App Release ToDos
#2701 opened
May 30, 2025 -
Cannot extract MySQL datetime value 0000-00-00 00:00:00 with pyarrow or connectorx
#2699 opened
May 30, 2025 -
Declarative api config for resource should have table_name property
#2698 opened
May 28, 2025 -
Add Support for Additional BigQuery Partition Expressions
#2696 opened
May 28, 2025 -
Use sqlglot to create partition by expressions in BigQuery
#2695 opened
May 28, 2025 -
Databricks: Add support for layout in Volumes
#2693 opened
May 28, 2025 -
pkg_resources is deprecated as an API.
#2690 opened
May 28, 2025 -
title: Bug: Missing columns when using table prefix with MSSQL in dlt
#2688 opened
May 27, 2025 -
Pipeline state updates don't work when running concurrent pipelines towards the same dataset in athena
#2687 opened
May 27, 2025 -
Add support for lakeformation tags
#2683 opened
May 26, 2025 -
Propagate delta destination configuration through table hints
#2680 opened
May 25, 2025 -
Unhelpful error using Motherduck destination
#2679 opened
May 24, 2025 -
docs: failure to launch local dev server
#2677 opened
May 23, 2025 -
Trino Destination
#2675 opened
May 23, 2025 -
Avoid table downtime in staging-optimized replace strategy
#2673 opened
May 23, 2025 -
Motherduck Default Ignored
#2670 opened
May 22, 2025 -
ConnectorX not supporting decimals/numeric
#2669 opened
May 22, 2025 -
Add option to add the `file_name` to the `read_csv_duckdb` transformer of `filesystem` source
#2667 opened
May 20, 2025 -
ConnectorX 'arrow2' ValueError when running SQL database pipeline
#2661 opened
May 19, 2025 -
Change in write_disposition not treated as a schema change
#2659 opened
May 18, 2025 -
Timezone problem after upgrading from 1.10 to 1.11
#2658 opened
May 17, 2025 -
Enable dataset ibis connector for databricks and synapse
#2651 opened
May 16, 2025 -
Proactive Disk Space Management for Constrained Runtimes (e.g., AWS Glue) via Mid-Extract Processing
#2649 opened
May 16, 2025 -
Inconsistent progress updates
#2648 opened
May 15, 2025 -
Normalize configuration doesn't support `loader_file_format` anymore
#2641 opened
May 14, 2025 -
sql_database schema configuration conflict
#2635 opened
May 14, 2025 -
Raise an appropriate warning when a column has exclusively None values and is essentially dropped
#2632 opened
May 13, 2025 -
Prevent creation of _dlt folders
#2631 opened
May 13, 2025 -
[Databricks] Add comments and tags hints for table and column
#2625 opened
May 12, 2025 -
Incorrect `default_schema_name` in state.json
#2622 opened
May 12, 2025 -
Research: Hackable Data App with Marimo
#2620 opened
May 10, 2025 -
Empty init file in Fabric when running pipeline
#2618 opened
May 9, 2025 -
ClickHouse: Consider overriding additional `to_db_` methods for ClickHouse-specific type mapping
#2617 opened
May 8, 2025 -
chore: refactor `dataset` to be top level
#2611 opened
May 7, 2025 -
I never know which part of API is stable so it is hard to build upon
#2610 opened
May 7, 2025 -
MSSQL -> Postgres pipeline causes destination database in Azure to crash
#2606 opened
May 6, 2025 -
Batch-wise or per-file extract, normalize, and load during a pipeline run
#2604 opened
May 6, 2025 -
Improve "is_same_physical_destination" check for dataset
#2603 opened
May 6, 2025 -
Incompatibility Airflow 3.0.0
#2601 opened
May 5, 2025 -
Process Hanging on pool.shutdown
#2595 opened
May 3, 2025 -
RESTAPI: paginator defined at client level not inherited by resources
#2586 opened
May 1, 2025
23 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Feat/2200 add clickhouse distributed support
#2573 commented on
May 29, 2025 • 3 new comments -
feat: add dbt seed and snapshot methods to runner.py
#2582 commented on
May 5, 2025 • 0 new comments -
Fix/2486 fixes mssql datetime precision
#2570 commented on
May 5, 2025 • 0 new comments -
Starrocks
#2518 commented on
May 27, 2025 • 0 new comments -
Feat/2432 pagination sqltable
#2477 commented on
May 23, 2025 • 0 new comments -
support bulk copy for mssql and synapse
#1234 commented on
May 29, 2025 • 0 new comments -
Pagination not being detected for rest_api_source
#2505 commented on
May 26, 2025 • 0 new comments -
[data access] implement high performance arrow cursors for Athena, Clickhouse and Postgres
#2548 commented on
May 26, 2025 • 0 new comments -
rest_api: Nested resources with incremental parameter are not able to differentiate the incremental value per resource
#2429 commented on
May 26, 2025 • 0 new comments -
Transformation and Lineage follow-up work
#2540 commented on
May 21, 2025 • 0 new comments -
enable upsert for filesystem / iceberg destination
#2549 commented on
May 21, 2025 • 0 new comments -
`sql_database` throwing exception on nullable JSONB column from CockroachDB
#2665 commented on
May 19, 2025 • 0 new comments -
dlt.destinations.exceptions.DatabaseUndefinedRelation sql server destination
#2088 commented on
May 19, 2025 • 0 new comments -
user friendly `PipelineStepFailed` message
#2564 commented on
May 19, 2025 • 0 new comments -
Show offending item in logs when schema_contract is set to "freeze"
#1772 commented on
May 19, 2025 • 0 new comments -
remove click
#1658 commented on
May 18, 2025 • 0 new comments -
`IncrementalCursorInvalidCoercion` when trying to specify an initial value in incremental column
#2460 commented on
May 16, 2025 • 0 new comments -
`log_period` argument in `dlt.progress.log` seems to have no effect in version 1.9
#2532 commented on
May 15, 2025 • 0 new comments -
Large entries to `_dlt_pipeline_state` can bring down the entire environment
#2580 commented on
May 15, 2025 • 0 new comments -
pyarrow/pandas: add load id and dlt id in the extract phase and unify the behavior
#1317 commented on
May 15, 2025 • 0 new comments -
Allow partitioning on computed columns in Delta tables written to filesystem
#2062 commented on
May 14, 2025 • 0 new comments -
Save compressed load files with `.gz` extension
#925 commented on
May 13, 2025 • 0 new comments -
feat: Add column description support for BigQuery adapter
#2179 commented on
May 13, 2025 • 0 new comments