https://linen.dev logo
#singer-tap-development
Title
# singer-tap-development
a

ananya

12/27/2022, 12:58 PM
Hi 👋 I’m working on Greenhouse tap which pulls data from their API where there are child objects nested within. Here’s how entire scenario plays out; • First ever request fetches list of candidates • We iterate over each candidate ID to fetch additional info per candidate • Response to this second request returns an object containing a few array of objects, something like as follows;
Copy code
{
  emails: [
    {...},
    {...}
  ],
  activities: [
    {...},
    {...}
  ]
}
Now, I need to iterate over each item from
emails
array (and similarly for
activities
array) to push it to their respective tables as rows in Redshift, what’s happening now is that entire
emails
array gets dumped into table instead of individual records, which is not correct as it hits the max limit of table leading to trucation. So is there a way to do it correctly? Thanks!