dima_anoshin
04/28/2022, 5:18 AM- name: tap-mysql
variant: transferwise
pip_url: pipelinewise-tap-mysql
config:
database: b5billing
user: root
select:
- account_types.*
- account_type_prices.*
- name: target-jsonl
variant: andyh1203
pip_url: target-jsonl
config:
destination_path: ./local-dev/jsonl
When I run - nothing happened, I don't get the files.
bash-3.2$ meltano elt tap-mysql target-jsonl
2022-04-28T05:17:25.902398Z [info ] Running extract & load... job_id=2022-04-28T051725--tap-mysql--target-jsonl name=meltano run_id=c51130c1-af3d-499e-9691-9bd7868b014c
2022-04-28T05:17:25.942019Z [warning ] No state was found, complete import.
2022-04-28T05:17:26.237926Z [info ] time=2022-04-27 22:17:26 name=tap_mysql level=INFO message=Server Parameters: version: 5.7.37, wait_timeout: 28800, innodb_lock_wait_timeout: 3600, max_allowed_packet: 4194304, interactive_timeout: 28800 cmd_type=extractor job_id=2022-04-28T051725--tap-mysql--target-jsonl name=tap-mysql run_id=c51130c1-af3d-499e-9691-9bd7868b014c stdio=stderr
2022-04-28T05:17:26.245369Z [info ] time=2022-04-27 22:17:26 name=tap_mysql level=INFO message=Server SSL Parameters(blank means SSL is not active): [ssl_version: ], [ssl_cipher: ] cmd_type=extractor job_id=2022-04-28T051725--tap-mysql--target-jsonl name=tap-mysql run_id=c51130c1-af3d-499e-9691-9bd7868b014c stdio=stderr
2022-04-28T05:17:26.313470Z [info ] Incremental state has been updated at 2022-04-28 05:17:26.313383.
2022-04-28T05:17:26.317353Z [info ] Extract & load complete! job_id=2022-04-28T051725--tap-mysql--target-jsonl name=meltano run_id=c51130c1-af3d-499e-9691-9bd7868b014c
2022-04-28T05:17:26.317530Z [info ] Transformation skipped. job_id=2022-04-28T051725--tap-mysql--target-jsonl name=meltano run_id=c51130c1-af3d-499e-9691-9bd7868b014cthomas_briggs
04/28/2022, 1:06 PMselect rules for the tap need to include the schema name in the stream. So it would be something like
select:
- YourSchemaName-account_types.*
- YourSchemaName-account_type_prices.*thomas_briggs
04/28/2022, 1:07 PMmeltano invoke tap-mysql and see what it produces. Once you know what the tap generates it's easier to figure out why things don't work downstream. 😉dima_anoshin
04/28/2022, 2:48 PM