Hi All, how do i register a catalog.json file for a tap? I’m trying to use tap-shopify but there are issues with the schema as noted in other conversations. Seems the recommendation was to make a tap-shopify.catalog.json file and make overrides there. I created the file, made changes, and thought i set it with an environmental variable:

TAP_SHOPIFY__CATALOG=extract/tap-shopify.catalog.json

but if i run

meltano invoke tap-shopify --discover > test.json

it doesn’t look like test.json is matching what i have in tap-shopify.catalog.json.

Hi @nicholas_degiacomo.

meltano invoke tap-shopify --discover

will always generate a fresh catalog. Where you wanna test if your hand-edited catalog works is during invocation. So you can do something like

meltano elt tap-shopify target-jsonl

and validate that the catalog was used correctly

thanks @edgar_ramirez_mondragon, clarifying my above question. I’m focusing on updating the schema and the catalog file because i currently believe thats causing an issue where I’m having columns shifted for certain rows. After I updated the catalog, i’m still facing similar issues so i want to double check that meltano is reading the right catalog.

@nicholas_degiacomo you can run

meltano config tap-shopify list --extras

to verify that the catalog path is set

thanks! what’s the order precedence meltano follows for env variables/catalog vs the yaml? if i had some overrides in the yml and some in catalog, which will it take?