Also noticing a lot of validation errors when tryi...
# plugins-general
d
Also noticing a lot of validation errors when trying to select from the other streams and load into
target-jsonl
. Some do not make much sense, like the one below:
Copy code
Traceback (most recent call last):
  File "/meltano/.meltano/loaders/target-jsonl/venv/bin/target-jsonl", line 8, in <module>
    sys.exit(main())
  File "/meltano/.meltano/loaders/target-jsonl/venv/lib/python3.8/site-packages/target_jsonl.py", line 92, in main
    state = persist_messages(
  File "/meltano/.meltano/loaders/target-jsonl/venv/lib/python3.8/site-packages/target_jsonl.py", line 54, in persist_messages
    validators[o['stream']].validate((o['record']))
  File "/meltano/.meltano/loaders/target-jsonl/venv/lib/python3.8/site-packages/jsonschema/validators.py", line 130, in validate
    raise error
jsonschema.exceptions.ValidationError: '120201691532420468' is not of type 'integer', 'null'

Failed validating 'type' in schema['properties']['id']:
    {'type': ['integer', 'null']}

On instance['id']:
    '120201691532420468'
Loader failed
Block run completed.
Any help is much appreciated.
I see this PR, but it seems to have missed some cases (cc @Edgar Ramírez (Arch.dev)): https://github.com/MeltanoLabs/tap-facebook/pull/67
e
Hey @daniel! PRs are always welcome for fixing schema errors. FWIW these would be caught in CI if the offending values are present in the API response, but the repo doesn't have valid credentials anymore 😕.
👀 1
d
@Edgar Ramírez (Arch.dev) quick question: does this tap automatically handle incremental replication wherever applicable? I think it does, but just want to make sure that code like this within the tap is sufficient, and that no other Meltano config is required:
Copy code
replication_keys = ["date_start"]
    replication_method = "incremental"