Hi everyone, I'm developing a custom tap that extracts jsonlines files. I want to keep the original json object of unspecifiable schema as a json type so I can load it into postgres as JSON or JSONB. How can I achieve that? I'm running into issues were a 'singer_sdk.typing.ObjectType' without any further schema specifications is not accepted by the typing checks..

https://github.com/MeltanoLabs/tap-universal-file might do what you're after

jsonl_type_coercion_strategy

with a type of any I think is what you're saying

Thanks for the suggestion! However, tap-universal-file seems to derive a schema for based only on the first json in the source file. So I think it will fail on my files. tap-spreadsheets-anywhere expects a root-level array of objects where each object is a set of flat key-value pairs. Which is not the case either.. Any ideas?

Did you try

envelope

or

any

?

I'm running into issues were a 'singer_sdk.typing.ObjectType' without any further schema specifications is not accepted by the typing checks

What's the error you're seeing?

I've since fixed the error, it was due to me printing debug statements using print, instead of using a logger.. facepalm