- Fixed
merge,delete-insert, andrefresh="drop_resources"crashing on CrateDB (GH-14): the datetime type mapper no longer mutates the live schema (which trippedDestinationSchemaTampered), and deleting a schema now tolerates an already-dropped_dlt_versiontable instead of aborting the load. - Fixed importing from MongoDB: columns that collide with CrateDB's reserved
system column names (most notably MongoDB's
_id) are now renamed with a leading underscore (e.g._id->__id) via a dedicated naming convention, instead of failing with"_id" conflicts with system column.
- Fixed CrateDB crashes by configuring
caps.max_query_lengthto 4MB
-
Removed
SystemColumnWorkaroundfor_-prefixed column names. The package now requires CrateDB 6.2 or higher.At the same time, the update will invalidate existing
dltbookkeeping columns starting with two underscores, like__dlt_idor__dlt_load_id. Going forward, originaldltbookkeeping columns will be used, like_dlt_idor_dlt_load_id.After installing v0.1.0, the next load cannot use prior incremental bookkeeping and will fall back to a full load once. Subsequent loads will use the new
_dlt_*bookkeeping. If you want to avoid this transition behavior, we recommend to continue using the previous release v0.0.2.If you continue with the update and have validated successful loads on v0.1.0, you can drop deprecated bookkeeping columns starting with
__dlt_from your target tables. -
Fixed truncating tables by adding
CrateDbSqlClient._truncate_table_sql
- ingestr: Fixed importing from Kafka per
SystemColumnWorkaround
- Fixed mypy error
missing library stubs or py.typed marker - Satisfied
mypytype checker
- Started the project, derived from dlt-hub/dlt#2733