How do I prevent Meltano to query deleted objects I am runni Meltano #announcements

How do I prevent Meltano to query ‘deleted’ object...

rahul_anand

07/14/2020, 2:42 PM

How do I prevent Meltano to query ‘deleted’ objects? I am running tap-zuora and got this error:

Copy code

CRITICAL Objects included in the queries do not support the querying of deleted records. Remove Deleted section in the JSON request and retry the request

I do see meltano has added a ‘deleted’ column to all objects in its

tap.properties.json

. Setting

"selected": false

in metadata did not help.

douwe_maan

07/14/2020, 3:19 PM

@rahul_anand Is that with a newly generated/discovered catalog file without any modifications made by Meltano or you yourself? That

Deleted

column appears to be coming from here: https://github.com/singer-io/tap-zuora/blob/master/tap_zuora/discover.py#L140 And the error here: https://github.com/singer-io/tap-zuora/blob/master/tap_zuora/apis.py#L8

douwe_maan

07/14/2020, 3:20 PM

The "deleted" field is added to the query here: https://github.com/singer-io/tap-zuora/blob/master/tap_zuora/apis.py#L104

douwe_maan

07/14/2020, 3:21 PM

I'm not familiar enough with Zuora to know what the tap expects us to do here, though... Happy to keep helping you figure this out, of course, but if you're not longer using Meltano's catalog generation logic and still running into this, I'm not sure of how much help my Meltano expertise will be 🙂

rahul_anand

07/14/2020, 4:22 PM

Thank you @douwe_maan for pointing me to the tap-zuora src code. It seems something may be changing at Zuora end because I remember downloading the catalog using --discover few weeks back, and I did not see this ‘deleted’ field. It seems now it may be required to add ‘Tenant’ under the list of objects at https://github.com/singer-io/tap-zuora/blob/b5a27545873ac3fb90257310f9c2d94a126438b8/tap_zuora/apis.py#L66 . I will report this in Singer workspace.

8 Views

Open in Slack

Previous Next