Ruben Vereecken
02/07/2024, 6:56 PMtap-jsonl
doesn’t exist. tap-csv
does. But anyone have any other recommendations for data formats for deeply nested data (CSV not a great fit)?Ruben Vereecken
02/07/2024, 6:57 PMtap-jsonl
or reimplementing the whole client as a tap-custom-api
ptd
02/07/2024, 7:01 PMEdgar Ramírez (Arch.dev)
02/07/2024, 7:32 PMare my options either writing a customFWIW implementing a custom tap-jsonl should be fairly easy, and would have the advantage of letting you decide how to select files and where to pull them from.or reimplementing the whole client as atap-jsonl
tap-custom-api
Matt Menzenski
02/08/2024, 4:08 AMRuben Vereecken
02/08/2024, 8:40 AMRuben Vereecken
02/08/2024, 8:41 AMReuben (Matatika)
02/08/2024, 4:32 PMReuben (Matatika)
02/08/2024, 4:32 PMEdgar Ramírez (Arch.dev)
02/08/2024, 5:34 PMRuben Vereecken
02/08/2024, 6:40 PMEdgar Ramírez (Arch.dev)
02/08/2024, 7:39 PMReuben (Matatika)
02/08/2024, 7:45 PMtap-msaccess
(also using fsspec
under the hood): https://github.com/meltano/hub/pull/1663