Column extraction getting skipped if all the column data is having NULL values [Mysql to Duck db]

[SunilGembali]

dlt version

1.5.0

Describe the problem

I am trying to build an extractor from mysql data source to duck db destination. In the mysql data source table if all the data in any particular column is NULL, that column is getting skipped and not being extracted to the destination duck db.

Lets say my column in source is "name" in mysql source and all the values in that column is NULL then that column is not being extracted to the destination duck db file.

If the column is a bit type in if all the values in that column is '0' then that column also getting skipped.

I am using the packages which came with the initialization of dlt init mysql duckdb . To bring the table resources i have sql_table function .

Expected behavior

It should not skip the columns if the data is having NULL values or '0' (for bit type column)

Steps to reproduce

1. Use sql_table method for extraction.
2. Create a source table, have a column with all the values as NULL in it.
3. Take mysql as the source, and duck db as the destination and run the pipeline.

Operating system

Linux, macOS

Runtime environment

Local

Python version

3.11

dlt data source

No response

dlt destination

No response

Other deployment details

No response

Additional information

No response