Hi everyone! Hope I am posting in the right channe...
# troubleshooting
j
Hi everyone! Hope I am posting in the right channel. I have an issue with a tap I have developed myself with the Meltano SDK for the Opendota API. I have a parent-child stream where the parent returns a list of match IDs and the child stream fetches details about each match ID in separate API calls. The match ID gets sent to the child stream by overriding the get_child_context function in the parent stream class. When running the tap, it seems to be working fine as the child stream gets invoked once for each match ID in the parent stream and the tap outputs a record for each invocation of the child stream. However, when running the tap in a Meltano pipeline with target-postgres as the loader, only one record returned by the child stream gets loaded into postgres (seems to be the last record returned by the stream). I am using the datamill-co version of target-postgres. Any ideas how I can get this working?
Just tried this with target-jsonl and I don't experience the same issue, meaning that if parent stream returns 5 match IDs, the child stream also generates 5 rows (one per match ID).
r
@john_kaustinen Did you ever figure this out? I’m running into the same problem now