<@U06BXNUEVE3> and <@U06D0S605TJ> - There’s an iss...
# troubleshooting
a
@vladyslav_zavalykhatko and @michael_harris - There’s an issue open on pipelinewise-tap-postgres related to
sdc_recursive_string_array
https://github.com/transferwise/pipelinewise-tap-postgres/issues/94
I’ve posted a comment and will share also to
#pipelinewise
in the main Singer slack. Please post back if you find a workaround which may help others.
m
Posting current (non-elegant) workaround here incase anyone is interested
Best idea I have for a workaround is to just avoid that table entirely in the select and use another method for EL (such as extract from source, load to storage bucket in flat file format to force an unnest of arrays, then load from storage bucket to warehouse)
a
Another option would be to override the schema definition in catalog, for instance to use the simpler
{"type": ["null", "array"], "items": {"type": "string"}}
in place of
{"type": ["null", "array"], "items": {"$ref": "#/definitions/sdc_recursive_string_array"}}
. In theory, overriding the schema should remove this ref - assuming the postgres tap uses it as provided.
v
@aaronsteers yeah, I know this issue - I opened it 😄
thanks for suggestions 👍