Hi all! I hope this is the right channel to ask with regards to the meltano tutorial/ setup. I have not had any luck on stumbling a similar issue with some solution or workaround. So I'm having some trouble running 'meltano elt tap-postgres target-postgres', Extractor custom installed (It looks like it was installed just fine). Error message seems vague, don't know where else to start debugging. I am currently following the Starter - Carbon Emissions tutorial and just changed tap and loader values Windows user here - Also uses wsl Btw I also tried installing singer tap-postgres separately to see if it can properly extract from my local db, noticed some issues that it requires 'simplejson' and 'backoff' plugins that are a few versions older than what meltano requires. Hoping there's a workaround here. Thanks!

Thansk Jenny, this is the right place to reach out! I have captured this as an issue and assigned it to @yannis_roussos to take a look when he wakes up (in Greece) https://gitlab.com/meltano/meltano/issues/818

Thanks Danielle! Np, I'm pretty new to this and I think what you guys are doing are cool. I hope I can contribute if I get familiar enough. I will be following your linked issue. Still trying to check out if it's just my configuration, I'm pretty lost and just following other similar guides due to lack of postgres tap/target docu on Singer.

Hi @jenny! You got directly into the deep, really tricky part of Meltano! I would suggest that you first try out Meltano with a supported tap to get a feeling of how things work, where the data are loaded, how Meltano UI helps you analyze the extracted data, etc. But if you still want to give

tap-postgres

a try, I have added a HOW TO in the issue linked above by @danielle_morrill

Hi Yannis, thanks a lot for that detailed tutorial under the linked issue 🙂 . I actually already implemented half of the steps based on the existing docs under meltano. I think the important thing that I missed out was the TAP_PG_* config part, as I found no references for it 😞 even on Singer IO docs. I understand that there wouldn't be one in meltano docs since it was not supported. Sorry I went directly to using 'tap-postgres' as that was what we needed at the moment. I pretty much just guessed the required config param for 'tap-postgres' after I custom installed it before. Will try it again in a while. Thanks!

@jenny we have fixed the small bug we had with

meltano select

and you can now follow my HowTo without issues. I can confirm that everything works end-to-end and that you can properly use

tap-postgres

by following the steps in: https://gitlab.com/meltano/meltano/issues/818#note_194763818 We will most probably create a proper tutorial in Meltano's documentation based on this.