Kuanysh Zhaksylyk
02/06/2025, 12:18 PMplugins:
extractors:
- name: tap-mysql
variant: transferwise
pip_url: git+<https://github.com/edgarrmondragon/pipelinewise-tap-mysql.git@patch-1>
config:
database: ***
engine: mysql
session_sqls:
- SET @@session.time_zone='+0:00'
- SET @@session.wait_timeout=86400
- SET @@session.net_read_timeout=86400
- SET @@session.innodb_lock_wait_timeout=3600
select:
- schema-table.*
metadata:
'*':
replication-method: LOG_BASED
loaders:
- name: target-postgres
variant: meltanolabs
pip_url: meltanolabs-target-postgres
config:
batch_size_rows: 50000
hard_delete: true
load_method: upsert
use_copy: true
validate_records: true
sanitize_null_text_characters: true
Edgar Ramírez (Arch.dev)
02/06/2025, 7:31 PMmeltano state list
reveal anything?Kuanysh Zhaksylyk
02/07/2025, 4:51 AMmeltano state clear dev:tap-mysql-to-target-postgres,
but usually it outputs something like
2025-02-07T04:48:59.453082Z [info ] The default environment 'dev' will be ignored for `meltano state`. To configure a specific environment, please use the option `--environment=<environment name>`.
dev:tap-mysql-to-target-postgres