Pawel Plaszczak
01/15/2025, 3:13 PMcat input|meltano invoke target-postgres
Where input file has this:
{"type":"SCHEMA","stream":"MYTABLE","schema":{"properties":{"EX_ID":{"multipleOf":1e-38,"type":["null","number"]}, "KW_UPDATE_DATE":{"description":"date","format":"date-time","type":["null","string"]}},"type":"object"},"key_properties":[],"bookmark_properties":["KW_UPDATE_DATE"]}
{"type":"RECORD","stream":"MYTABLE","record":{"EX_ID":1098236,"KW_UPDATE_DATE":"2025-01-14T22:03:49.00+00:00"},"version":1736868956608,"time_extracted":"2025-01-15T13:51:52.393818Z"}
And I receive:
decimal.InvalidOperation: [<class 'decimal.DivisionImpossible'>]
The error disappears if I remove EX_ID":1098236
which is of type number.
Is this a bug?
Is this linked to this issue, which seems to be saying that some numeric types are not supported? feat: Support integer types other than `BIGINT` #484
I believe @edgar_ramirez_mondragon is mentioned in this issue.
If it is, then what is a solution for now? I am pulling data from Oracle so I can't do much about the incoming data type:
meltano run tap-oracle target-postgres
More generally, I am evaluating Meltano for production project and won't be able to proceed if issues like this block me. For data coming from Oracle, can someone recommend some Meltano targets with reasonable level of maturity which require less troubleshooting? Perhaps other postgres variants, or if not, other relational databases?Edgar Ramírez (Arch.dev)
01/15/2025, 4:06 PMPawel Plaszczak
01/17/2025, 3:16 PMEdgar Ramírez (Arch.dev)
01/17/2025, 6:31 PM