1 Release published by 1 person

• 1.1.0

  published Sep 26, 2024

17 Pull requests merged by 8 people

• incremental scd2 with merge_key

  #1818 merged Sep 29, 2024

• fix: corrects test suite

  #1893 merged Sep 29, 2024

• refactors Session mocking in RESTClient tests

  #1891 merged Sep 27, 2024

• Fix config sections for synching destinations and accessing destination clients

  #1887 merged Sep 27, 2024

• master merge for 1.1.0 release

  #1875 merged Sep 26, 2024

• Fix the paginator's doc heading

  #1869 merged Sep 25, 2024

• Docs: rest_api: document processing_steps

  #1872 merged Sep 25, 2024

• Fix/1858 make all connection string credentials optional

  #1867 merged Sep 25, 2024

• docs: fixing grammar files 60-80

  #1864 merged Sep 25, 2024

• supports adding DltResource in RESTAPIConfig dict

  #1865 merged Sep 25, 2024

• Update basic.md

  #1868 merged Sep 25, 2024

• feat: filesystem delete old pipeline state files

  #1838 merged Sep 25, 2024

• Update basic.md

  #1866 merged Sep 24, 2024

• Fix/1849 Do Not Parse Ignored Empty Responses

  #1851 merged Sep 24, 2024

• Allows any duckdb version, fixes databricks az credentials

  #1854 merged Sep 24, 2024

• Update staging.md

  #1863 merged Sep 24, 2024

• Docs grammar, pages 40-60

  #1856 merged Sep 23, 2024

7 Pull requests opened by 4 people

• Feat/557 rest api add oauth2clientcredentials to built in auth methods

  #1871 opened Sep 25, 2024

• logs warning if deduplication state is large

  #1877 opened Sep 26, 2024

• move default pipelines of cores sources into source folders

  #1888 opened Sep 27, 2024

• Feat/1331 disables deduplication for incremental

  #1892 opened Sep 28, 2024

• adds registries and plugins

  #1894 opened Sep 28, 2024

• show full HTTP response on failure (Feat/1605)

  #1895 opened Sep 28, 2024

• Update weaviate reference

  #1896 opened Sep 29, 2024

12 Issues closed by 5 people

• Support incremental loading for scd2

  #1789 closed Sep 29, 2024

• refactor Session mocking in RESTClient test suite

  #1890 closed Sep 27, 2024

• Issue in resolving destination client credentials

  #1886 closed Sep 27, 2024

• Docs: rest_api: add documentation for `map` and `filter` processing steps

  #1704 closed Sep 25, 2024

• DB2 sql_database source | dlt queries wrong system tables for iseries

  #1858 closed Sep 25, 2024

• rest_api: accept `DltResource` instances in resource list

  #1837 closed Sep 25, 2024

• compact dlt pipeline state table in filesystem destination

  #1657 closed Sep 25, 2024

• LanceDB Orphan Removal via Staging and Deletion Inserts.

  #1705 closed Sep 24, 2024

• Empty Response (e.g. HTTP 204) causes ignore response_actions to fail

  #1849 closed Sep 24, 2024

• Feature: report missing "parent" in schema yaml

  #1839 closed Sep 24, 2024

• Can't use AzureServicePrincipalCredentials with Databricks destination and Azure staging

  #1853 closed Sep 24, 2024

• Support for DuckDB 1.1.0

  #1828 closed Sep 24, 2024

5 Issues opened by 5 people

• Incorrect S3 url when using Digital Ocean Spaces as staging and Clickhouse as destination

  #1897 opened Sep 29, 2024

• Bug in duckdb credentials resolution

  #1885 opened Sep 26, 2024

• Unable to do an initial load into "bigquery" with any other write_disposition then "append"

  #1876 opened Sep 25, 2024

• Error loading data from MSSQL when using a compound merge key

  #1874 opened Sep 25, 2024

• rest_api: Suggest renaming `resolve` to `reference` in dependent resources

  #1873 opened Sep 25, 2024

22 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• data pond: expose readable datasets as dataframes and arrow tables

  #1507 commented on Sep 30, 2024 • 27 new comments

• Replace AuthBase with AuthConfigBase in example

  #1738 commented on Sep 27, 2024 • 3 new comments

• LanceDB - Remove Orphaned Chunks

  #1620 commented on Sep 25, 2024 • 2 new comments

• Add demo Colab notebook using magic CLI commands for setup and execution

  #1860 commented on Sep 27, 2024 • 0 new comments

• Added deploy with modal.

  #1805 commented on Sep 30, 2024 • 0 new comments

• `dlt.secrets.get(...)` returns None loading configuration from `.env`

  #1768 commented on Sep 30, 2024 • 0 new comments

• allow to model table and column references in dlt schema

  #1713 commented on Sep 30, 2024 • 0 new comments

• show full response when printing failed api calls

  #1605 commented on Sep 28, 2024 • 0 new comments

• disable rows deduplication if Incremental is attached to a resource with `merge` write disposition

  #1131 commented on Sep 28, 2024 • 0 new comments

• Add 'retry' response action for generic rest api source

  #1786 commented on Sep 27, 2024 • 0 new comments

• Support spatial / geo types

  #696 commented on Sep 26, 2024 • 0 new comments

• rest_api: declutter the `rest_api` module to improve the the editor completion.

  #1884 commented on Sep 26, 2024 • 0 new comments

• rest_api: use @defer decorator on transformer loop for parallel execution

  #1883 commented on Sep 26, 2024 • 0 new comments

• rest_api: passing value for path parameters not working as expected

  #1882 commented on Sep 26, 2024 • 0 new comments

• rest_api: Clarify how we specify incremental loading

  #1881 commented on Sep 26, 2024 • 0 new comments

• Extend generic API source to allow for incremental path parameters

  #1880 commented on Sep 26, 2024 • 0 new comments

• rest_api: Allow multiple resolve params in an endpoint config

  #1879 commented on Sep 26, 2024 • 0 new comments

• rest_api: extend the endpoint configuration allowing to pass `data` for the POST requests

  #1878 commented on Sep 26, 2024 • 0 new comments

• rest_api: Raise error if auth config is incorrect

  #1736 commented on Sep 26, 2024 • 0 new comments

• rest_api: Add `OAuth2ClientCredentials` to the list of built-in auth methods

  #1870 commented on Sep 25, 2024 • 0 new comments

• Links in Tip boxes while in dark mode are hard/impossible to read

  #1857 commented on Sep 24, 2024 • 0 new comments

• Followup Work for dataset dataacess

  #1859 commented on Sep 23, 2024 • 0 new comments