André Jerónimo
09/05/2025, 9:02 AMparquet
and compression as zstd
.
I've found these in Meltano Hub, but all seem to lack these specific configs:
• target-athena: no support for parquet
format
• target-parquet: no support for S3
• target-s3-parquet: no support for zstd
compression
Anyone else with the same use case that could help here? Thanks in advance!visch
09/05/2025, 12:30 PMjsonl
avro
csv
parquet
xlsx
singer
etc
Compression: zip
, bz2
, gzip
, lzma
, xz
, then adding zstd
wouldn't be major I would think
Protocols: s3
gcs
local
sftp
ftp
ftps
, etc
We started on this with this tap https://github.com/MeltanoLabs/tap-universal-file , but a target with the same idea would be great
Haven't seen one that goes for this but I haven't dove too deep looking!André Jerónimo
09/05/2025, 4:29 PMtap
! It looks very promising!