https://linen.dev logo
Join Slack
Powered by
Trying to use the `tap-github`, Meltano variant, I...
# getting-started
z
Trying to use the 
tap-github
, Meltano variant, I got the following error:
Copy code
2023-01-12T11:40:22.875196Z [info     ] 2023-01-12 12:40:22,875 Tap has custom mapper. Using 1 provided map(s). cmd_type=elb consumer=False name=tap-github producer=True stdio=stderr string_id=tap-github
2023-01-12T11:40:22.876882Z [info     ] CRITICAL '2023-01-12T12:40:22.874033+00:00' is not a 'date' cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877005Z [info     ] CRITICAL                       cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877075Z [info     ] CRITICAL Failed validating 'format' in schema['properties']['fetched_at']: cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877178Z [info     ] CRITICAL     {'format': 'date', 'type': ['string', 'null']} cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877239Z [info     ] CRITICAL                       cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877320Z [info     ] CRITICAL On instance['fetched_at']: cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.877378Z [info     ] CRITICAL     '2023-01-12T12:40:22.874033+00:00' cmd_type=elb consumer=True name=target-sqlite producer=False stdio=stderr string_id=target-sqlite
2023-01-12T11:40:22.930778Z [error    ] Loader failed
If the target is either SQLite or BigQuery, the same error occurs. It seems as a new user there's an incompatibility between the tap and any target? How do I resolve this?
a
Looks like some field is resporting an incorrect data type in tap-github. If so, this would be a bug in 
tap-github
.
Copy code
CRITICAL '2023-01-12T12:40:22.874033+00:00' is not a 'date' cmd_type=elb consumer=True name=target-sqlite
The 
date
and 
date-time
fields are different types. Some targets will load them as the same type, but technically they are distinct. Often the source API docs aren't very clear, so it's easy for this to happen.
Looking more closely, it looks like 
fetched_at
is the culprit here.
e
a
I have a PR too. I'll open and link to that issue.
fastparrot fastparrot
Merged and released in 
tap-github
`v1.2.0`: https://github.com/MeltanoLabs/tap-github/releases/tag/v1.2.0
@zeger-jan_van_de_weg - Can you take a look and let us know if this addresses your issue?
z
This is amazing, thanks. I'll check right now
The tap thinks there's something wrong, but the data ended up in my target. Seems fixed. Thanks!
a
Glad to hear it's landing! 🙌 If you want to add detail on the odd two behavior, we can dive into that too
Open in Slack
PreviousNext
Powered by