hicham_rahj
09/17/2021, 12:16 PMWriting batch with 2223 records
it stores them somewhere but i couln't find out where. I guess it's documented somewhere so sorry I couldn't find itvisch
09/17/2021, 12:44 PMhicham_rahj
09/17/2021, 12:47 PMvisch
09/17/2021, 2:00 PMmeltano elt tap-abc target-abc
Both the tap and target exist in the containerhicham_rahj
09/17/2021, 2:15 PMmeltano elt
command. I couldn't find documentation on itvisch
09/17/2021, 2:20 PMmeltano invoke tap-abc > out
look at the messages that come from your tap herehicham_rahj
09/17/2021, 2:31 PMmeltano elt tap-google-analytics target-postgres
(I also run meltano invoke) what i'm trying to find is if this json data is added directly to the destination (i'm guessing not) and if not where is it temporarly stored before being pushed to the destination (in memory of the container or in a temporary table or in a file...)visch
09/17/2021, 2:33 PMout
above with invoke is what's sent to STDIN of the target. The target decides what to batch up and when and how to send the data to postgres. Almost always this is done in memoryhicham_rahj
09/17/2021, 2:39 PM