Hi, I have tried tap-redshift, version monad-inc. The issue is that I am unable to make meltano to select tables from Redshift.

db: jme_dev
schema:public
table:d_account

meltano select tap-redshift --list --all | grep d_account

	[excluded ] jme_dev.public.d_account._sys_hash
	[excluded ] jme_dev.public.d_account._sys_is_current
	[excluded ] jme_dev.public.d_account._sys_is_deleted
	[excluded ] jme_dev.public.d_account._sys_updated_at
	[excluded ] jme_dev.public.d_account._sys_valid_from
	[excluded ] jme_dev.public.d_account._sys_valid_to
	[excluded ] jme_dev.public.d_account.a_sys_valid_from
	[excluded ] jme_dev.public.d_account.a_sys_valid_to
	[excluded ] jme_dev.public.d_account.account
	[excluded ] jme_dev.public.d_account.account_id
	[excluded ] jme_dev.public.d_account.account_owner
	[excluded ] jme_dev.public.d_account.account_pk
	[excluded ] jme_dev.public.d_account.account_tier
	[excluded ] jme_dev.public.d_account.platform_edition
	[excluded ] jme_dev.public.d_account.stage
	[excluded ] jme_dev.public.d_account.status

I have tried to select this column

status

from this table for download with various commands

meltano select tap-redshift jme_dev.public.d_account.status
meltano select tap-redshift public.d_account.status
meltano select tap-redshift d_account.status

The issue is that column is still not marked as [selected] and extractor downloads nothing:

meltano select tap-redshift --list --all | grep d_account


	d_account.status
	public.d_account.status
	jme_dev.public.d_account.status
	[excluded ] jme_dev.public.d_account._sys_hash
	[excluded ] jme_dev.public.d_account._sys_is_current
	[excluded ] jme_dev.public.d_account._sys_is_deleted

The only way how to download data is when extractor is installed for the first time when all objects are marked as [selected], than data are downloaded, but it crashes after 2 tables. What do I do wrong ?

To test that theory you could try selecting

*_sys*

and see if that is the issue!

meltano.yml

select:
    - '*d_account.*'

This partially fixes the job. The issue is, that it also downloads tables

wrk_d_account
vw_d_account

So it does seem linked to the selection issue hmm I haven't messed with columns with `.`'s in the name. I wonder if there's an existing ticket in Meltano for this. To fix that issue you could do something like select

*_sys

(or each of your columns you want) and then do

!*wrk_d_account*
!*vw_d_account*

Not that nice but it should work. We should get an issue into Meltano if there isn't one for this as we should have some decent solution available for this (I think 🤷 )

@visch,thanks for your help but I will try to get data from Redshift by using

psql

right now.

@jiri_merunka https://github.com/meltano/meltano/issues/2700 is the github issue that was migrated I went ahead and upvoted, sorry I couldn't help more!