for a tap built from SDK (like 'tap-jira') if the ...
# troubleshootingp
prakhar_srivastava
08/03/2023, 2:53 PMfor a tap built from SDK (like 'tap-jira') if the mapper/flatter fails, is there a way to ignore these failures and move on to next record. Right now if the mapper/transform fails the pipeline breaks.
prakhar_srivastava
08/03/2023, 3:23 PMthe problem here is, I'm trying to flatten the records from issue stream in tap-jira. While some records are parsed and flatten, some are not and if I exclude the stream for those, the pipeline works again. I'd like to somehow place null in place of these errored records
prakhar_srivastava
08/03/2023, 3:25 PMtap-jira > issues.fields.description
e
edgar_ramirez_mondragon
08/03/2023, 10:44 PMHi! 👋
Gotcha. Currently there's no way to handle errors during mapping/flattening, but maybe other folks are interested or have some thought about it. Would you mind logging an feature request? https://github.com/meltano/sdk/issues/new/choose
p
prakhar_srivastava
08/04/2023, 8:25 AMawesome thanks @edgar_ramirez_mondragon
I'll log a new request.
2 Views