Hello! encountering this log:

Plugin configuration is invalid
AttributeError: 'NoneType' object has no attribute 'get'

when I run this command:

meltano config <some-name> test

with this yaml (this is an except from the extractor plugin that is erroneous):

- config:
      dbname: postgres
      default_replication_method: INCREMENTAL
      host: valid_host
      password: valid_pass
      port: some_port
      user: valid_user
  inherit_from: valid_tap
  name: <some-name>

Any tips for what might be wrong would be greatly appreciated!

Probably something in the tap. What tap are you using? Running

meltano --log-level debug config <some-name> test

or

meltano invoke <some-name>

might give you some more context.

Hi, thanks for the response- I'm using tap-postgres, and got these additional logs from running invoke:

state = incremental.sync_table(conn_config, stream, state, desired_columns, md_map)
  File "/home/ubuntu/Akkio/apps/meltano-service/integrations/meltano/.meltano/extractors/tap-postgres/venv/lib/python3.8/site-packages/tap_postgres/sync_strategies/incremental.py", line 61, in sync_table
    replication_key_sql_datatype = md_map.get(('properties', replication_key)).get('sql-datatype')
AttributeError: 'NoneType' object has no attribute 'get'

Looks related to this thread: https://meltano.slack.com/archives/C01TCRBBJD7/p1687251271489729?thread_ts=1687156773.783609&cid=C01TCRBBJD7 @sebastian_slanitsch @edgar_ramirez_mondragon did you have any other thoughts on this?

the rest of my meltano file is not very interesting but I will share it anyways if it could help:

default_environment: staging
environments:
- name: staging
- name: production
plugins:
  extractors:
  - name: tap-postgres
    pip_url: pipelinewise-tap-postgres
    variant: transferwise
...
{excerpt from above}
...
project_id: some_id
version: n

That doesn't look correct when I put it together... You have duplicate

name

keys (unless you were purposefully obfuscating it in your original excerpt) and it's inheriting from

valid_tap

, which isn't a plugin?

plugins:
  extractors:
  - name: tap-postgres
    pip_url: pipelinewise-tap-postgres
    variant: transferwise
    config:
      dbname: postgres
      default_replication_method: INCREMENTAL
      host: valid_host
      password: valid_pass
      port: some_port
      user: valid_user
    inherit_from: valid_tap
    name: <some-name>

apologies for the miscommunication, it actually looks like:

plugins:
  extractors:
  - name: tap-postgres
    pip_url: pipelinewise-tap-postgres
    variant: transferwise
  - config:
      dbname: postgres
      default_replication_method: INCREMENTAL
      host: valid_host
      password: valid_pass
      port: some_port
      user: valid_user
    inherit_from: tap-postgres
    name: <some-name>

There an extra

-

before the config key, so it's trying to parse an array

but that's a different extractor, the name is just at the bottom instead of the top

config

is an extractor?

the first is the base extractor and the second <some-name> inherits from tap-postgres with extra settings

I see, the order of keys was a bit confusing

Right, yeah. Same for me! 😅

haha sorry my bad guys

What I don't see is a metadata entry for the tap

- config:
      dbname: postgres
      default_replication_method: INCREMENTAL
      host: valid_host
      password: valid_pass
      port: some_port
      user: valid_user
    inherit_from: tap-postgres
    name: <some-name>
    metadata:
      correct-entity-id:
        replication-key: field-name
        replication-method: INCREMENTAL

updated my yaml to include the metadata field, and still getting the same error when I run invoke:

File "/home/ubuntu/Akkio/apps/meltano-service/integrations/meltano/.meltano/extractors/tap-postgres/venv/lib/python3.8/site-packages/tap_postgres/sync_strategies/incremental.py", line 61, in sync_table
    replication_key_sql_datatype = md_map.get(('properties', replication_key)).get('sql-datatype')
AttributeError: 'NoneType' object has no attribute 'get'

how are you referencing that table in

metadata

?

the entity-id is the schema_name + "-" + table.name + ".*"

yeah

got rid of the suffix, same error 😞

Ok, we can try discarding a selection issue. Can you add a select config?