bassel
10/30/2023, 6:38 PMenvironments:
- name: dev
- name: staging
- name: prod
config:
plugins:
extractors:
- name: tap-mysql
config:
host: $DB_HOST
port: $DB_PORT
user: $DB_USER
database: $DB_NAME
password: $DB_PASSWORD
filter_dbs: $DB_NAME
select:
- "*-sessions.*"
metadata:
"*-sessions":
replication-method: INCREMENTAL
replication-key: updated_at
loaders:
- name: target-s3-csv
config:
aws_access_key_id: key
aws_secret_access_key: access_key
s3_bucket: bucket
s3_key_prefix: prefix
Denis I.
10/30/2023, 9:07 PMbassel
10/31/2023, 4:47 AMextractors:
- name: tap-mysql
variant: transferwise
pip_url: git+<https://github.com/B2tGame/pipelinewise-tap-mysql-ONMO.git@master>
- name: tap-mysql-cms
inherit_from: tap-mysql
I guess this section inherit_from: tap-mysql
references the most recent version not the one I forked and referenced in our github, right?Denis I.
10/31/2023, 9:31 AMinherit_from
just declares inheritance from the previously defined plugin. That means you can define any tap and than inherit it, and even re-define it again (https://docs.meltano.com/concepts/project#inheriting-plugin-definitions)
And don’t forget to define custom (forked) plugin’s capabilities and settings (https://docs.meltano.com/guide/plugin-management/#custom-plugins)