Hey, I have to load CSV files (coming from a configuration file) to a NATs queue, applying some transformations like splitting the lines in different keys, applying regexes etc... I was thinking that Meltano could help me in doing so. Would I need only Meltano ? Would need to couple it with dbt for some reason ? Any advices would be much appreciated
e
Edgar Ramírez (Arch.dev)
01/26/2024, 7:12 PM
Hi @C. bon! How would you otherwise process the CSVs? Meltano could help with getting the records from the CSV to a database, and with orchestrating dbt to transform them.
applying regexes
This is something that Meltano probably couldn't help with but SQL/dbt could definitely do
c
C. bon
01/26/2024, 7:19 PM
I don't want to get them to a database but to a NATS or an API. If I can't do some transformations it could be a problem ...