Hi, I am trying to access the auto-discovered tap....
# randomo
or_barda
08/05/2022, 5:48 PMHi, I am trying to access the auto-discovered tap.properties from my loader (That I implemented), Is there a simple way to get it? I see that for every run meltano generates it in some folder inside .meltano with the run_id but I don’t have access to this kind of details to figure out the path.
d
douwe_maan
08/05/2022, 5:50 PMTry
meltano invoke --dump=catalog tap-fooo
or_barda
08/05/2022, 5:52 PMYou mean creating the catalog before running the elt job?
d
douwe_maan
08/05/2022, 5:53 PMAh, I misunderstood, you're trying to access it from the loader! There's no simple way to get it, no, it only gets the SCHEMA messages which don't have all the metadata
douwe_maan
08/05/2022, 5:54 PMBut if you can control the execution environment, you could use that command to generate the file and then explicitly pass it to the loader through config or an env var
o
or_barda
08/05/2022, 5:55 PMBut then it means that first I need to run the catalog command and then pass it as the catalog path and run the elt command right?
d
douwe_maan
08/05/2022, 5:55 PMYes
douwe_maan
08/05/2022, 5:55 PMWhat parts of the catalog/properties file are you hoping to use in the loader?
o
or_barda
08/05/2022, 5:57 PMSo I have a parquet loader and we are using it also to write some metadata provided in the tap.properties into the parquet file metadata section
d
douwe_maan
08/05/2022, 5:57 PMAh makes sense. Yeah there's no way to pass additional metadata like that in the Singer spec currently
o
or_barda
08/05/2022, 5:58 PMAnyway that I can control the path meltano stores the auto-discovered catalog?
d
douwe_maan
08/05/2022, 6:07 PMNo I'm afraid not
o
or_barda
08/05/2022, 6:18 PMGot it, thanks