https://linen.dev logo
#plugins-general
Title
# plugins-general
j

joanna

12/05/2023, 11:13 AM
Hi, Do you understand this below error? I have a mapping to add to the schema, one column with ID, but I keep getting this error and my loader fails to load data to postgres.
2023-12-05T11:09:34.251060Z [info     ]     counter = super()._process_lines(file_input) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.251934Z [info     ]   File "/home/joanna/Documents/mxcd-magic-star/elab/meltano/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/singer_sdk/sinks/core.py", line 324, in _validate_and_parse cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr strin
g_id=target-postgres
2023-12-05T11:09:34.252092Z [info     ]     self._validator.validate(record) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.252262Z [info     ]   File "/home/joanna/Documents/mxcd-magic-star/elab/meltano/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/jsonschema/validators.py", line 435, in validate cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target
-postgres
2023-12-05T11:09:34.252455Z [info     ]     raise error                cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.252625Z [info     ] jsonschema.exceptions.ValidationError: 7181428 is not of type 'string', 'null' cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.252803Z [info     ]                                cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.252917Z [info     ] Failed validating 'type' in schema['properties']['expJournalID']: cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-12-05T11:09:34.253018Z [info     ]     {'type': ['string', 'null']} cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
jsonschema.exceptions.ValidationError: 10000 is not of type 'string', 'null'
Copy code
mappers:
  - name: meltano-map-transformer
    variant: meltano
    pip_url: git+<https://github.com/MeltanoLabs/meltano-map-transform.git>
    executable: meltano-map-transform
    settings:
      - name: stream_maps
        kind: integer
    mappings:
      - name: add_column
        config:
          stream_maps:
            my_stream_name:
              testID: "10000"