hey all, curious if this is possible or not… Is there functionality around dumping a catalog to an S3 or Azure blob storage destination? Something like:

catalog: <azure://storage-name.blob.core.windows.net/container-name/path/>

meltano invoke tap-name --discover > <azure://storage-name.blob.core.windows.net/container-name/path/>

I think it's a great idea, I think there's some metadata discussion on the issues list somewhere. I just needed something to work kinda like you are suggesting and I added the

SYS.*

(information schema) as a stream to my

tap-oracle

(with some annoying code changes) and that did the trick perfect for our needs as I didnt really care so much about the catalog and more about the data in the catalog was generated from.

awesome, thanks for that! We have been maintaining a catalog that gets updated a little too often and when a new field is added, if its not in our existing catalog, metlano/tap breaks. In order to get it running again we have to create a new PR asap to get things working again. For that purpose along with a UI for selecting tables/fields i am creating is where this blob storage functionality would be huge