hitesh
01/31/2023, 11:23 AMtap-google-analytics
and target-athena.
I have created required data-stream with desired fields and metrics. However, when I am running the pipeline my data columns are coming up in jumbled up manner. Does anyone know why and how I can solve this issue?pat_nadolny
01/31/2023, 2:56 PMpat_nadolny
01/31/2023, 3:00 PMoutput_format
? If I remember my issue correctly there was a bug where the ordering of the CSV columns were changing so the data got all jumbled like you mentioned, using JSONL looks like it fixed it. Also I see that I had flatten_records: false
for a few data sources so I wonder if flattening was causing issue 🤔hitesh
01/31/2023, 3:00 PMhitesh
01/31/2023, 3:01 PMflatten records
are truepat_nadolny
01/31/2023, 3:01 PMhitesh
01/31/2023, 3:01 PMpat_nadolny
01/31/2023, 3:05 PMbump-sdk-to-0_4x
that looks like its still an open PR. It only bumps the SDK version so I'm not sure why I did that but maybe there was a bug fix or something, so we can try that next if neededhitesh
02/01/2023, 7:20 PM