I took a closer look at the docs for pipelinewise-target-snowflake today, and found the add_metadata_columns option which populates some “standardized” _sdc columns for load timestamps etc. Would it be an idea to add a feature like that on the sdk? Bosses love to hear the words “standardized” and “metadata”. This would be equally relevant for taps and targets. https://github.com/transferwise/pipelinewise-target-snowflake

These are critical for us, and I imagine that's true for most anyone using an RDBMS target, so... I vote strongly in favor. 😉

The SDK does support

add_record_metadata

that conditions adding metadata here and here. Documentation may be improved, though. https://sdk.meltano.com/en/latest/implementation/record_metadata.html

Oh wow! This should perhaps be surfaced in the tap/target settings?

Yup,

append_builtin_config

should be implemented for the

Target

class: https://github.com/meltano/sdk/issues/1199