Hello, I have following tap-mysql configuration. ...
# troubleshooting
r
Hello, I have following tap-mysql configuration. I want to limit rows when it goes to target (e.g. it should extract 10 rows and load to csv). I am able to load to CSV but I want to limit it to 10 rows. Is there any way I can achieve that?
Copy code
- name: tap-mysql_1_xxxxxx
    inherit_from: tap-mysql
    capabilities:
    - catalog
    - discover
    - state
    config:
      database: xxxx
      engine: mysql
      filter_dbs: xxxx
      host: xxxxx
      port: 3306
      session_sqls:
      - SET @@session.time_zone='+0:00'
      - SET @@session.wait_timeout=28800
      - SET @@session.net_read_timeout=3600
      - SET @@session.innodb_lock_wait_timeout=3600
      ssl: false
      use_gtid: false
      user: xxxx
      select:
      - xxxx.*
Thanks
v
you could modify the target to accept 10 rows and then write to a csv file. It's not a standard thing we'd be doing with targets
r
@visch Thanks for your reply. So there is no option to limit on source side? if I want to join to tables and then I want to transfer to target is this possible? Can I add custom queries in it ? There is another option that I create view and then transfer to target. But in case I don't want to use this option so is it possible?