I have a question about the new <Allow stream-leve...
# plugins-general
m
I have a question about the new Allow stream-level and property-level transformations to be defined in `meltano.yml` feature. Will it support conditional transformations (assuming the mapper supports it)? e.g. pipelinewise-transform-field
a
What kind of conditions do you mean?
Nevermind. I see the related section in the link you shared
Yes. Since the config is sent directly along to the mapper, and we are supporting the Pipelinewise plug-in at launch, this should be fully compatible with the conditional feature.
m
Awesome. Am I correct that the mapper should have access to the
_sdc_deleted_at
operational column (via binlog replication)? I’m trying to test it but I’m used to meltano handling the bookmarks for me 🤣
a
Good question. I don't know actually off the top of my head if
_sdc_deleted_at
is transmitted as a stream property or a metadata/message property. If passed as a stream property (like other columns), then yes, I would expect so. Otherwise, probably not.
m
FWIW, it does appear to work 🙂
assuming this is how it’s going to be implemented:
Copy code
meltano invoke tap | transform-field
a
Awesome! And yeah, that's the equivalent basically.