Hello everyone, I'm trying to launch Meltano like...
# troubleshooting
a
Hello everyone, I'm trying to launch Meltano like this :
Copy code
RUN meltano config tap-postgres set _metadata 'public-metric_value' replication-key date_modified
It works perfectly, but the thing is that
date_modified
is not the only column I should check. Basically, I would like to run this :
Copy code
RUN meltano config tap-postgres set _metadata 'public-metric_value' replication-key coalesce(date_modified, date_created)
Is there a way to do it ? I've also tried
Copy code
RUN meltano config tap-postgres set _metadata 'public-metric_value' replication-key date_modified if date_modified else date_created
v
The easiest way to maintain meltano imo is to have your meltano.yml be setup with what you want, then run that meltano.yml file in production. It seems like you're running
meltano config etc
every run, while you can do that it's really not needed. In regards to how to set multiple replication keys that's not a thing I think any tap I know of supports.
You could create a view with that coalesce condition in place in your source db, then point the tap to use that column as the replication_key
1
1
a
Yeah, but the problem is that our meltano.yml file is autogenerated in production... I will have to do a lot of cleaning, this project is kind of a mess.
But yeah, the views are a good idea, while I try to figure out how to do it better