Meltano csv load is eating up new line character . I am loading data from mysql to redshift. I have a varchar column in mysql that has new line character and i want it in the same way in redshift too. But it is omitting new line character and repacing it with 'n' for ex: 'abc def' ==>'abcndef' What copy_options do i need to pass . I have already removed trimblanks option but still it is behaving in same way.

Can you confirm which variant of target-csv you are using? Is that the MeltanoLabs variant?

@aaronsteers sorry if i have caused confusion . But I am not using target-csv . I am using target-redshift and tap-mysql. Both of transferwise variant. There is a csv copy command that is being run to load data to redshift. and issue is happening there.

Thanks for confirming. I would suggest opening an issue in their issue tracker as a first step: https://github.com/transferwise/pipelinewise-target-redshift/issues You can also try another target-redshift variant but generally their (Wise's) connector quality is very high. I'm surprised to hear this is an issue, as they generally have high quality connectors, this seems like pretty core functionality, and I didn't see a similar bug report in their tracker. If you do find the issue, I'm sure they'd appreciate a PR as well.

@aaronsteers , i found a similar issue and yes this is the only reason i can also think of . https://github.com/transferwise/pipelinewise-target-redshift/issues/45

@atif_imam - Great find. I've replied to that issue: https://github.com/transferwise/pipelinewise-target-redshift/issues/45#issuecomment-954439189

@aaronsteers . Thank you . I am following the issue now.

👋 @atif_imam, @aaronsteers You will have noticed I responded to AJs comment in the ticket mentionned above. This is still an issue for us and when someone finds an appropriate solution, we’d love to know about it!

@maxime_lavoie, Yes I read the thread. Thank you .