hello_dev
07/07/2022, 2:15 PMextractors:
- name: tap-mysql
config:
host: 127.0.0.1
database: dev
user: root
filter_dbs: dev
session_sqls:
- SET @@session.net_read_timeout=36000
- SET @@session.innodb_lock_wait_timeout=36000
select:
- '*.*'
- '!dev-t_snapshot.*'hello_dev
07/07/2022, 3:37 PMpat_nadolny
07/07/2022, 4:43 PMmeltano select tap-mysql --list it should give you a list of streams. Did you confirm that the stream youre ignoring is in that list and is formatted the same way you listed it? Also just to confirm from our other thread, these select configs should be at the top level until the bug is fixed to respect environment level select/metadata settingshello_dev
07/08/2022, 4:22 AMmeltano select tap-mysql --list ,the output don't have dev-t_snapshot but when I run meltano run tap-mysql target-postgres get error about dev-t_snapshot
2022-07-08T041915.503560Z [info ] time=2022-07-08 121915 name=target_postgres level=CRITICAL message=Primary key is set to mandatory but not defined in the [dev-t_snapshot] stream cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgrespat_nadolny
07/08/2022, 1:46 PMmeltano invoke --dump=catalog tap-mysql > catalog.json Have you tried just selecting 1 or 2 tables to confirm those are working? It might make it easier to understand when the issue is introduced vs using *.* to select everythinghello_dev
07/08/2022, 2:19 PMdev-t_snapshot table is in catalog.jsonhello_dev
07/08/2022, 2:21 PMselect:
- 'dev-snapshot.*'
- '!dev-snapshot.*'
this can work the dev-snapshot excludepat_nadolny
07/08/2022, 2:41 PM"selected": false, attribute so its not synced. Wouldnt that new selection criteria exclude everything?hello_dev
07/09/2022, 3:26 AM"selected": false ,but when run also to synchello_dev
07/09/2022, 3:15 PM