Happy Friday everyone! I have a hopefully quick Friday question. I am trying to use tap-hubspot and loader-postgres, but we are running into an issue where the column name is >64 length. So when we try to extract the following…

property_hs_line_item_global_term_hs_recurring_billing_start_date
property_hs_line_item_global_term_hs_recurring_billing_start_date_enabled

we get an error because there is already a column with a name

property_hs_line_item_global_term_hs_recurring_billing_start_da

It seems like postgresql has a default max limit of 64, so this causes duplicate names. A workaround I am trying is to exclude by using the

select

and

select_filter

in the configuration file, but this does not seem to be working as expected Can someone provide me an example of a select, select_filter that would work with tab-hubspot to get everything, but ``property_hs_line_item_global_term_hs_recurring*` ?

Hi @eric_formo! The syntax for

select

should look something like:

plugins:
  extractors:
  - name: tap-hubspot
    select:
    - "*.*"
    - "!<replace with the name of your stream>.property_hs_line_item_global_term_hs_recurring*"

You can confirm the selection with

meltano select tap-hubspot --list --all

.

ok, thanks.

Oh, if you omit the strings and use e.g.

- *.*

, YAML parsers will think you're trying to create a reference. I think the second element could actually be written without quotes, or maybe not 😅. https://codebeautify.org/yaml-editor-online is a good option to quickly check your yaml.