https://linen.dev logo
Join Slack
Powered by
Howdy! I'm working on a new project and I'm stuck ...
# troubleshooting
m
Howdy! I'm working on a new project and I'm stuck on the following error. Does anyone have any idea why would tap-mysql require information_schema for FILES? The Error:
Copy code
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1227, 'Access denied; you need (at least one of) the PROCESS privilege(s) for this operation')
[SQL: SHOW columns from `information_schema`.`FILES`]
(Background on this error at: <https://sqlalche.me/e/14/e3q8>)
The Config:
Copy code
version: 1
default_environment: dev
project_id: 2a9bebb9-6766-49a4-b009-0d4cbb5d25e6
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-mysql
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-mysql.git>
    config:
      host: localhost
      port: 11000
      user: vi_dtw_all
      database: u_dtw_138
      ssh_tunnel:
        host: localhost
        username: root
    select:
    - u_dtw_138-dim_entity.*
    metadata:
      '*':
        replication-method: FULL
  loaders:
  - name: target-jsonl
    variant: andyh1203
    pip_url: target-jsonl
So, looks like I simply don't have privileges to access info schema for FILES. How can I skip it from the catalog discovery?
So, the solution was to add u_dtw_138 to filter_schemas i.e.:
Copy code
- name: tap-mysql
        config:
          filter_schemas:
            - u_dtw_138
          host: localhost
          port: 11000
          user: vi_dtw_all
          database: u_dtw_138
        metadata:
          '*':
            replication-method: INCREMENTAL
            replication-key: AdminUpdated
        select:
        - u_dtw_138-dim_entity.*
        #- u_dtw_138-fact_*.*
        - '!u_dtw_138-dim_date.*'
        - '!u_dtw_138-fact_user_role.*'
👍 1
2 Views
Open in Slack
PreviousNext
Powered by