Hi, I am new to meltano and I wanted to know if meltano supports mongodb as a destination. Basically I want to have a pipeline that can extract from multiple sources (Zendesk, Salesforce) and store only certain fields into mongodb. TIA
a
aaron_phethean
10/25/2022, 9:24 PM
Hi @naveen_srinivasa in the meltano world the destination is called a Loader. Check out https://hub.meltano.com/loaders/
These Loaders are Singer ‘targets’ with settings that meltano can manage.
I don't see a Mongo target, but I would be surprised if there isn't one on GitHub somewhere. Possibly as a non sql destination there are not that many people trying to load data into Mongo.
I'm intrigued what you will load into Mongo.
n
naveen_srinivasa
10/25/2022, 9:27 PM
So my organization is stores all the data coming from the above mentioned sources in mongodb and till now we have been doing the data extraction process manually. We were looking for ways to automate that process.
a
aaron_phethean
10/25/2022, 9:30 PM
👍 apart from not seeing a Loader on the hub, sounds like a job for Meltano.
n
naveen_srinivasa
10/25/2022, 9:31 PM
I did find a target-mongodb loader online... Experimenting with that. Also, the option of selecting certain fields from targets is exactly what we were looking for! Hope I can build a demo for our team.