Hello guys, I've just been trying to get to know Meltano, and I was curious if our current case is supported by Meltano's plugins. We want to write an atomic ELT, reading from parquet files in HDFS to write into Clickhouse, is such a use case supported by Meltano out of the box or we should develop our own plugins?

@Farhood Etaati theres a clickhouse target https://hub.meltano.com/loaders/target-clickhouse/ and I'm not sure if it supports parquet yet but theres a spreadsheets anywhere tap https://hub.meltano.com/extractors/tap-spreadsheets-anywhere that I believe can read from HDFS. Otherwise you could write your own tap to do it. I see someone wrote a target to do the opposite of what you want https://hub.meltano.com/loaders/target-hdfs. Theres also been a fair amount of work on https://github.com/MeltanoLabs/tap-universal-file that supports parquet from s3, I'm not sure exactly how it works but I'd think that adding HDFS support wouldnt be too bad