Hello, I setup a pipeline with 1. tap-shopify 2. t...
# troubleshooting
j
Hello, I setup a pipeline with 1. tap-shopify 2. target-csv I believe I set the shopify tap correctly as I got data coming into csv output files. The csv target is set to default values. However, the outputted data is not in an expected format and looks mixed up with some weird HTML type flags. I am curious if the tap-shopify is out of date with Shopify or if there are areas I should look at with my setup first. Please let me know if I can provide more info. Screenshot is attached of an output csv opened in Google Sheets with Comma delimiter
message has been deleted
v
Target csv struggles sometimes with embded commas (ie Json values) . It should work, and you can get an issue in with that example Most of the time it's better to just go with a json format instead of csv to bypass these issues To each their own!
e
There seem to be some json columns in the shopify output. Those can be problematic for csv because they have commas and maybe even newline characters that would break naive csv readers. One option is to flatten the output of tap-shopify with https://docs.meltano.com/concepts/plugins#mappers and https://sdk.meltano.com/en/latest/stream_maps.html#schema-flattening-applications
j
Thanks both, I'll try flattening the data or just skipping CSV altogether.