does anyone have examples of meltano project with

target-clickhouse

? I'm having some difficulties in setting mine up, e.g. I want new tables to be deduplicated on

id

with sorting by a non-nullable

updated_at

. But the target-clickhouse module always casts dates as Nullable: https://github.com/shaped-ai/target-clickhouse/blob/a04758cff46b429bab6615a15d662e25c5a96db9/target_clickhouse/connectors.py#L120 Since this is my first meltano ETL pipeline, I'm getting confused between layers of abstraction here and how to properly configure my target clickhouse tables.

I want new tables to be deduplicated on

id

with sorting by a non-nullable

updated_at

.

I presume those are fields in your source tap?

> I presume those are fields in your source tap? Yes. My current approach is have

target-clickhouse

create the tables with default engine and nullable types, and then manually "force"

id

and

updated_at

columns as non-nullable, and a new engine directly via running this SQL: