Hi team, is it possible to use the same tap twice?...
# troubleshooting
r
Hi team, is it possible to use the same tap twice? For example, if I want to re-use
tap-zendesk
in the same project, once with a Snowflake target and another time with a CSV target, how can I set up the tap? Can I inherit from tap-zendesk, as we do with targets?
a
Are you connecting to the same zendesk instance? The
state
store considers both tap and target so you should have isolated state between the two targets when using
run
.
h
Absolutely. If you just want to run tap-zendesk to target-csv and target-snowflake, no additional configuration is needed. Just run them as usual:
Copy code
meltano run tap-zendesk target-csv
meltano run tap-zendesk target-snowflake
If you have several zendesk accounts, you can use inherit-from just like with targets.
r
I meant in the meltano.yml how to configure the tap, did not try inheriting yet. Is there a naming convention (like with targets for example, if i inherit from target-snowflake, the name of the next one is target-snowflake--xy)? Do you have some docs I can check on this? I am connecting to the same instance @Andy Carter
a
I think as Henning suggested you can run both targets just fine without any changes to your tap. You don't need another inherited tap. State for your different tap-target combinations will be maintained separately.
r
I actually plan the following: Extract x tables from a tap towards Snowflake, target-snowflake Extract y tables from same tap (same instance, same config) towards GCP, target-gcp How would you configure meltano.yml for this goal? We can assume the tap is tap-zendesk
a
so one set of tables into snowflake, and a different set of tables into gcp? I think you would need to use inheritance, and then alter
select
config to select the streams (tables) you need. https://docs.meltano.com/reference/command-line-interface/#how-to-use-15
r
so one set of tables into snowflake, and a different set of tables into gcp?
Yep!
Thanks, will give it a try! So far have only inherited from targets, happy to see this should work with taps too!