aditya_penmesta
12/06/2023, 6:17 PMtap-intercom
but am noticing that it's not getting picked up when running my pipeline (instead a full historical sync is being run when I just want a day of data). posted the logs in the thread and am not sure why it's not working, would appreciate any help hereaditya_penmesta
12/06/2023, 6:17 PM2023-12-06T18:11:03.974694Z [info ] INFO URL: POST <https://api.intercom.io/contacts/search>, Params: None, JSON Body: {'pagination': {'per_page': 150, 'starting_after': 'WzE2OTIxOTkwMTMwMDAsIjY0OWQ4MjAzNjc1NjU0MDQ0MGJiZTE0MCIsNV0='}, 'query': {'operator': 'OR', 'value': [{'field': 'updated_at', 'operator': '>', 'value': 1689228111.0}, {'field': 'updated_at', 'operator': '=', 'value': 1689228111.0}]}, 'sort': {'field': 'updated_at', 'order': 'ascending'}} cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
2023-12-06T18:11:04.896574Z [info ] INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.864250898361206, "tags": {"http_status_code": 200, "status": "succeeded"}} cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
2023-12-06T18:11:04.896945Z [info ] INFO Synced: contacts for page: 5, records: 150 cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
2023-12-06T18:11:04.935196Z [info ] INFO URL: POST <https://api.intercom.io/contacts/search>, Params: None, JSON Body: {'pagination': {'per_page': 150, 'starting_after': 'WzE2OTIxOTkwMzIwMDAsIjY0OWQ5YTllMzViYzg2ODI0ZTNjYTIxNCIsNl0='}, 'query': {'operator': 'OR', 'value': [{'field': 'updated_at', 'operator': '>', 'value': 1689228111.0}, {'field': 'updated_at', 'operator': '=', 'value': 1689228111.0}]}, 'sort': {'field': 'updated_at', 'order': 'ascending'}} cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
e2023-12-06T18:11:05.215001Z [info ] time=2023-12-06 13:11:05 name=target_snowflake level=INFO message=Table MELTANO_PROD_INTERCOM."CONTACTS" exists cmd_type=elb consumer=True name=target-snowflake-intercom producer=False stdio=stderr string_id=target-snowflake-intercom
2023-12-06T18:11:05.877786Z [info ] INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.9380438327789307, "tags": {"http_status_code": 200, "status": "succeeded"}} cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
2023-12-06T18:11:05.881379Z [info ] INFO Synced: contacts for page: 6, records: 150 cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
2023-12-06T18:11:06.384304Z [info ] INFO URL: POST <https://api.intercom.io/contacts/search>, Params: None, JSON Body: {'pagination': {'per_page': 150, 'starting_after': 'WzE2OTIxOTkwNTIwMDAsIjY0OTlhYzQ5Y2YwZGE2YWU2YThlODJlZSIsN10='}, 'query': {'operator': 'OR', 'value': [{'field': 'updated_at', 'operator': '>', 'value': 1689228111.0}, {'field': 'updated_at', 'operator': '=', 'value': 1689228111.0}]}, 'sort': {'field': 'updated_at', 'order': 'ascending'}} cmd_type=elb consumer=False name=tap-intercom producer=True stdio=stderr string_id=tap-intercom
aditya_penmesta
12/06/2023, 6:18 PM