Is there anyway to handle rate limits in

tap-facebook

? I am unable to run even part of an import because the rate limits are hit almost instantly.

2022-01-24T10:24:29.189827Z [info     ]   Status:  400                 cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190004Z [info     ]   Response:                    cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190170Z [info     ]     {                          cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190346Z [info     ]       "error": {               cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190518Z [info     ]         "message": "(#17) User request limit reached", cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190688Z [info     ]         "type": "OAuthException", cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.190887Z [info     ]         "is_transient": true,  cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.191074Z [info     ]         "code": 17,            cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.191284Z [info     ]         "error_subcode": 2446079, cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.191518Z [info     ]         "fbtrace_id": "AMK727wIfIfbMCRbro1UFbE" cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.191720Z [info     ]       }                        cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr
2022-01-24T10:24:29.191924Z [info     ]     }                          cmd_type=extractor job_id=facebook_to_bigquery name=tap-facebook run_id=87059e1a-ed36-40cd-be25-f6a203c876ae stdio=stderr

Facebooks own SDK doesn't even try to look at rate-limits - let alone waiting if it is approaching the limit...

@jonas_kalderstam If I remember correctly I had a similar issue in the past. We ended up having to go through a facebook app approval process, then we basically never ran into the rate limiting issue again. The app review process was pretty annoying though so maybe theres an easier way.

Thanks for the info. I'm gonna ask someone to escalate this at Facebook. I suspect we also have way more ads than most..

Hello @pat_nadolny @jonas_kalderstam Hope you are good. I also ran into the same issue. Trying from several days but we instantly hitting the rate limit and not able to load the data. @pat_nadolny Is there any way except

facebook app approval

to resolve this issue? @edward_ryan

I think we ended up talking to Facebook

Thank You @jonas_kalderstam