Hi guys, I was wondering if it is possible to coe...
# troubleshooting
c
Hi guys, I was wondering if it is possible to coerce the type of fields to certain values without knowing what the field will be beforehand (don't want to have to specify the schema up front). More concretely, I would like to set the type of all discovered fields to
["null", "string"]
. I'm dealing w/ some messy sources that aren't playing to nicely with the inferencing. I suppose I could dump a catalog and programmatically coerce it to what I need before passing back to the elt command as a param. However that seems a bit hacky. Is there a way to selectively disable type inference during a taps discovery for certain runs? Is it possible to coerce types using the new mappers functionality? Looking to implement this for
tap-s3-csv
->
pipelinewise-tap-postgres
.