Hello, I'm new to Meltano and thus far I am enjoying the experience! I'm trying to create a

tap-postgres

extractor but all the tables in the DB have a column with data type

bytea

and is excluded from the selection process. I ran the discover command and this is how that

auctionid

column appears. Is there a way I can include that column? Thanks!

{
          "breadcrumb": [
            "properties",
            "auctionid"
          ],
          "metadata": {
            "sql-datatype": "bytea",
            "inclusion": "unsupported",
            "selected-by-default": false
          }
        },

https://github.com/transferwise/pipelinewise-tap-postgres/blob/master/tap_postgres/discovery_utils.py#L167 https://github.com/transferwise/pipelinewise-tap-postgres/blob/11914d48be1fdac604ec0ca6e5c37b58973c50a1/tap_postgres/discovery_utils.py#L286 Looks like an issue and an MR on this tap would be needed to support bytea types. Binary data is a bit shaky spec wise, it can be implemented (base64 the data)it's just not super clear what the standard method is and how you should tell the target what type the data is

I was able to change the column type to 'text' and reload the data. I will revisit this binary data business later. Thanks Derek!

😄 glad that helped