I was looking at some issues about selecting neste...
# singer-taps
j
I was looking at some issues about selecting nested properties and had a follow up question related to this: https://github.com/meltano/meltano/issues/3024 https://github.com/meltano/meltano/issues/8807 is it not possible to use
select
to specify only the desired nested fields? is it always required to explicitly deselect all other unwanted fields? for
tap-example
, if there were many unwanted attributes, they would all need to be listed as
!entity.attributes.a
,
entity.attributes.b
, etc.,? is there no way to ignore all other nested fields aside from the ones selected?
Copy code
plugins:
  extractors:
    - name: tap-example
      select:
      - entity.id
      # - entity.attributes             # without this, SDK will drop attributes
      # - entity.attributes.*           # without this, no nested properties will be selected
      - entity.attributes.name          # select wanted nested property
      # - "!entity.attributes.unwanted" # without this, all other nested properties will be selected
e
Hey @Jessica Li. I think https://github.com/meltano/sdk/pull/2924 is all that'll be needed. Do you have a tap where you would like to test this?