tap-adwords rate limit I was able to run on

ads

and

AD_PERFORMANCE_REPORTS

successfully when the start date is set to

27-Mar

. But anything realistic like 3 months before causes a rate limit failure (daily limit exceeded for Basic account) on just these schema objects. Is there a batch parameter I can tune to reduce the number of overall requests.

that’d have to be something the tap supports

I can't find it documented in Meltano's docs or in the tap repo. Any way to get in touch with the original authors?

@subhash_gopalakrishnan apologies for the delayed response. The Meltano variant of the tap is forked from this Singer repo https://github.com/singer-io/tap-adwords Looking at the issue tracker it seems they’re fairly unresponsive. We’re more than happy to review a contribution though to https://gitlab.com/meltano/tap-adwords to add this functionality

Thanks for the response, @taylor I will certainly consider contributing a fix. To better understand the issue, here are some quick questions. It'll be great to hear your thoughts on the same: 1. The generic entities are being queried at a constant page size. Any specific motivation for this? Any harm in making this configurable? 2. Reports are always queried for one day at a time. Will it make sense to provide the start and end dates as part of a single query instead of making multiple queries for each day? Again, this seems to be intentional - so maybe I am missing something?

Making the page size configurable makes sense to me. As long as the current behavior is the default that should be no problem to add.

👍