Hello, just heard about Meltano and seems its solv...
# getting-started
s
Hello, just heard about Meltano and seems its solving the same use-case that I am trying to solve. I understand that it helps to Extract - Transform - Load data from source to destination. Can someone help me with a simple example for loading data from CSV -> write a custom transformation -> load into a custom store?
p
Welcome! Awesome, hope its a good fit for you. Have you checked out the getting started guide https://meltano.com/docs/getting-started.html? It goes through an end to end example that you can customize for your use case.
s
@pat_nadolny: Thanks for the link, will try that out. I basic question I had after browsing through the link - Does the transformation happens only after the data is loaded or we can transform the data before loading ?
p
@sumit_maheshwari the transformation happens after the load step so its ELT vs ETL. What custom store are you loading to? Meltano does support minor inline transformations for things like aliasing, filtering, etc. but right now thats only for SDK based taps and targets. What types of transformations are you looking to do?
s
@pat_nadolny: Yes, I think i got bit confused. We could transform the data once its loaded in the store.
p
@sumit_maheshwari awesome, check out that getting started guide and let us know if you run into any issues!
s
@pat_nadolny: Btw, the standalone setup did not work. I posted the issue in #C01TCRBBJD7. Had to use docker setup.
@pat_nadolny: Can we programmatically run these taps and process the output ? Also in some cases when we have to select items from the catalog how can we achieve that programatically ? Any pointers on the same would be really helpful.