I’m extracting data from mysql via `tap-mysql` (tr...
# troubleshooting
b
I’m extracting data from mysql via
tap-mysql
(transferwise variant) and loading it into postgres via
target-postgres
(also transferwise). I’ve observed that varchar column values containing newlines get mangled, such that they’re turned into regular “\” and “n” characters. I’m guessing there’s an issue with escaping/quoting, but couldn’t find any way to control the behavior of either plugin. Has anyone experienced this before? Did you find a solution?
aha, i just found an earlier message reporting this same behavior: https://meltano.slack.com/archives/C01TCRBBJD7/p1668543976322399 @thomas_briggs did you happen to find an easy/robust solution to this problem?
fwiw my co-worker submitted a patch to the
pipelinewise-target-postgres
repo: https://github.com/transferwise/pipelinewise-target-postgres/pull/126 not 100% sure this is the right solution, but it did fix our particular problem
t
@burton_dewilde I don't recall what I did to solve this, unfortunately. I don't see any transforms in our pipeline or bug reports filed against the tap, though my comments in the earlier thread indicate I thought it was a tap issue. 🤔 There's a decent chance I changed the data to make the problem go away, for better or worse. Sorry!
b
no worries, thomas! appreciate the update.