Hello all, anyone who encountered the same type of...
# troubleshooting
p
Hello all, anyone who encountered the same type of error below ? So remediation_id appeard to have some null value and is use as a key_properties in the meltano configuration yaml script that defines the ingestion pipeline. I tried to solve by filtering the null values but it's still not working. Anyone ? Thanks !
Copy code
psycopg2.errors.NotNullViolation: null value in column "remediation_id" of relation "tmp_852a6ac5_8f49_431e_8f2b_67bd3aea1276" violates not-null constraint cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
    2025-11-23T09:48:59.807756Z [info     ] DETAIL:  Failing row contains (2025-11-23 07:30:19.48459, null, 2025-11-23 07:30:19.217288, 25, prod-mutu, 4939, null, 184). cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
    2025-11-23T09:48:59.807888Z [info     ] CONTEXT:  COPY tmp_852a6ac5_8f49_431e_8f2b_67bd3aea1276, line 120: ""2025-11-23T07:30:19.484590",,"2025-11-23T07:30:19.217288+00:00",25,"prod-mutu",4939,,184" cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
c
Can you show us how you're filtering the problem records out, the error is being reported by your target so if filtered at the source it doesn't appear to be filtering? If filtering at the source try running your tap to the target-jsonl so you can inspect records more quickly understand if your filtering if working as you make changes.
1