https://linen.dev logo
#singer-tap-development
Title
# singer-tap-development
b

blake_blackshear

07/13/2023, 5:52 PM
looking across several taps (
tap-csv
,
tap-s3
,
tap-s3-csv
) and there is quite a bit of duplication related to CSV parsing. i am considering making some improvements to
tap-sftp
, but trying to avoid reinventing that part of the wheel. most taps seem to orient around parsing a file format, but some seem to be more oriented around the transfer mechanism for data files that could be in many different formats. s3, sftp, http are transfer protocols that could all have the same set of file formats that need to be parsed. how is the community thinking about this?