Quick question! I was wondering what data type a Meltano extractor returns! For example, if I use a tap-csv or tab-parquet extractor, what does it send to Meltano? Is it a dictionary?

Hi Taeef 👋 An extractor is a command line application that writes Singer messages to stdout. A loader is a command line application that parses and loads data from Singer messages.

@edgar_ramirez_mondragon Thanks. But

record

is a JSON object right? As stated here -> https://hub.meltano.com/singer/spec/#records

That's correct,

record

is a JSON object

One last question just to confirm that I understood it correctly!

record

contains the data from the csv file when I use

tap-csv

as the extractor, right? I was actually trying to implement the whole thing locally just to understand how it works. I have a

dummydata.csv

file in the working directory. For simplicity, I want to turn the csv file into a JSON object, similar to

record

and then test if I can push

record

into my locally set up data lake. Thanks a lot @edgar_ramirez_mondragon for helping me out. Much appreciated.

record

contains the data from the csv file when I use

tap-csv

as the extractor, right?

Yes,

record

should contain each field in the CSV and there should be one record message for every data line in the file.

For simplicity, I want to turn the csv file into a JSON object, similar to

record

and then test if I can push

record

into my locally set up data lake.

fwiw that sounds very similar to what you'd get from https://hub.meltano.com/loaders/target-singer-jsonl or https://hub.meltano.com/loaders/target-jsonl