Also, I can see that you are running a different example than the one on our CSV Tutorial and the files provided there. Does your Meltano project work if you try this with the original files? This is really important so that we are sure that this is not something you have introduced after updating the file.

I have created a new project with name

postgres-import

to test with original files from the tutorial. So right now I have two projects, and when I try to create a project, I do not see any means to specify to which project this pipeline should apply. How does meltano figure out which project a pipleline referrers to?

Hey Raj! Sorry for the delayed response, but we were out on Friday on a Meltano get together. Each project is atomic, behaving as a completely autonomous installation, with its own installed plugins, configuration, etc: Wherever you start

meltano ui

from, it will use that project to start the pipelines for. Same for the cli: just cd to each project and run the pipeline from inside that project and it will use that project to run the pipeline.

In my case, the docker image has the web UI already running. How can I stop that and run the UI from my project?

@micael_bergeron can you please help me with this one?

In my case, the docker image has the web UI already running

Is this a custom built image or

meltano/meltano

? IIRC the official Meltano image on DockerHub doesn't automatically create a project: the user has to mount it using a volume.

docker run … -v /path/to/project:/project -w /project meltano/meltano ui

would run in

/path/to/project

for instance.

Its the official droplet in digital ocean.

Oh, so this is not running of docker then. For digital ocean, we effectively create a "default" project for you to get you started ASAP, which is located at

/var/meltano/project

. You'll have to SSH into your droplet and clone/download your project there.

okay. I had created my project in /root.

To stop meltano, use

systemctl stop meltano

and got the error

ERROR tap-csv: 'extract/files-def.json' file not found

then change the

/var/meltano/project

, then

systemctl start meltano

Should I need to move my existing project to

/var/meltano/project

and try again?

That's probably why

ah!

Cool thanks!

meltano docs

I have been working with meltano for past couple of versions, could not yet get it working for my use case

That's a bummer, you'll get there. Maybe we can help you set it up.

I attempted once more today. Updated to version 1.8.0

Meltano version reloaded to 1.8.0

Just checking if the CSV Postgres tutorial is upto date? Looks like the latest CSV plugin has a different configuration that whats shown in the tutorial.