hello all, how do i convince `meltano` to emit the...
# troubleshooting
d
hello all, how do i convince
meltano
to emit the SCHEMA messages coming from a tap for debugging purposes? i tried
meltano --log-level=debug ...
but it didn't seem to work
v
debug does work so that's curious it isn't working, but for that purpose I almost always do
meltano invoke tap-name > outfile
d
thanks,
invoke
works 👍
this is actually related to an issue i'm seeing where i'm sending records to
target-redshift
which uses the schema records to construct a table if one doesn't exist already these schema records need to include all available fields and not just the ones that are being selected so that it can construct a table capable of fitting fields that might be added later however, i've created a custom tap using the Meltano SDK and noticed that it's only emitting a schema that includes records that happen to be selected on a specific run, which is not good for the reason above is there some way that i can force Meltano to emit a full schema in a tap generated using the SDK?