nehil_jain
06/28/2020, 1:36 AMdouwe_maan
06/28/2020, 5:47 PMmeltano add does not directly support adding dbt hub packages by name.
Rather, since your project's transform directory contains a full-fledged dbt project, you can add a DBT hub package exactly as described on https://hub.getdbt.com/fivetran/github_source/latest/: by adding it to a packages.yml file in that directory 🙂 You'll also probably want to add it to your dbt_project.yml file under models .
When you run meltano add transform <name>, that specifically refers to the "known" transforms listed here: https://gitlab.com/meltano/meltano/blob/master/src/meltano/core/bundle/discovery.yml#L733
When you add one of those using that command, it will be added to your meltano.yml , and it will be added to transform/packages.yml and transform/dbt_project.yml automatically.douwe_maan
06/28/2020, 5:50 PMgithub_source dbt model will work with the tap-github extractor without some (many?) changes, since it was built specifically for the schema output by Fivetran's GitHub extractor(+loader), not tap-githubdouwe_maan
06/28/2020, 5:54 PMmeltano elt , dbt run will automatically be invoked with arguments (profile, models, etc) determined by config settings listed here: https://gitlab.com/meltano/meltano/blob/master/src/meltano/core/bundle/discovery.yml#L710
As mentioned under https://meltano.com/docs/command-line-interface.html#pipeline-environment-variables, the value of models (which models to run, in your case: github_source, or the name of your tap-github-compatible fork) is determined automatically based on the value of that setting, which by default has the value $MELTANO_EXTRACTOR_NAMESPACE my_meltano_model , which expands to tap_github my_meltano_model when the tap-github extractor is used. ``my_meltano_project`` refers to models defined project-locally in your transform/models/my_meltano_project directory.douwe_maan
06/28/2020, 5:56 PMDBT_MODELS environment variable: DBT_MODELS=github_source meltano elt ... , or you can override the setting for all pipeline runs in meltano.yml : meltano config dbt set models github_sourcedouwe_maan
06/28/2020, 6:09 PM