If we wanted to check out meltano stack and get our hands dirty in code, would you recommend we use this ext? https://marketplace.visualstudio.com/items?itemName=z3z1ma.meltano-power-user

@taras_novak The Meltano Power user VS Code extension is made by Alex Butler, who is a community member who can be found here on Slack. I'll avoid pinging him unless there's something you'd like to ask about the extension in particular. Personally I find it to be a nice quality-of-life addition to working with Meltano, but I wouldn't call it necessary. No harm in trying it out.

ok. will check it out. Thanks for that info.

No problem! As for a JS API/SDK, there is none (as far as I know). Officially for Meltano the only stable API is the CLI. When making a custom extractor/loader we provide the SDK, and when making a custom utility plugin we provide the EDK, both of which are exclusively Python-based at this time. That said, Meltano runs on the Singer spec, so any Singer-compliant plugins (including custom ones) can work with it. Meltano supports running a Docker container for plugin commands, which you can use to run Singer plugins written in any language. That said, you'll likely have a better time using Python with our SDK rather than trying to implement a Singer plugin in JS without our SDK. Please let us know if you've got any questions, and we'll be happy to help.

I was looking at that 3rd party ext. and your cli provides json outputs. So, probably best way to integrate using cli. will peruse some more next week. do you plan to provide nodejs sdk eventually?

We have no plans at this time to provide a NodeJS SDK. Feel free to open a feature request for it in the SDK GitHub.

yup. I've seen both of those. was looking for something much simpler to set up and run. also, IMO, all of those q's are related for getting started, so I kept them in one thread. Thanks for the links.

Hi @taras_novak did you see the ‘simple projects’ section on this page: https://docs.meltano.com/tutorials/example-projects I can highly recommend the GitHub Analytics project 😁

seen that page too. none of them are simple examples/demos to use for quick starts IMO

Do you have a specific source / target in mind? I’d love to make something simpler!

I usually use public datasets from Chicago data portal. A simple runnable example should be in a gist or a github repo, not require docker container setup, not require cloud services setup, should run local by cloning, running some scripts, maybe installing some py libs via

requirements.txt

To run an example with no credentials could be as simple as: 1. install python 2. git clone project 3. pip install meltano 4. cd project 5. meltano install 6. meltano run tap target 7. .. do something with the data

ok. great list of execution steps. now, do you or meltano team have a simple runnable demo example like it, with the requirements from above & simple docs? 🙂

CC @Sven Balnojan

not trying to give you hard time here. I just don't understand why many data products don't do this and require many cloud services signups, etc.

@taras_novak we have our codespace demo which only relies on github auth https://github.com/codespaces/new/meltano/meltano-codespace-ready

ok. do you have a repo link instead of a link to create new codespace?

Note that this demo uses containers, but can be run locally

right. it does require docker. still looking for a simple example just like it, without docker 🙂 but close enough. Thanks!

The meltano-map-transform repo has a simple meltano project: https://github.com/MeltanoLabs/meltano-map-transform/blob/main/meltano.yml

great. looks like it has decent docs too. will try it. Thanks @edgar_ramirez_mondragon