I will add to that... are there any benchmarks about performance reading from relational databases? We have some tables with hundreds of gigabytes to a few terabytes and we are wondering how meltano would perform in an scenario like that.
a
alexander_butler
04/14/2023, 4:42 PM
It’s all up to the specific tap and target. Meltano is not moving data. It’s invoking singer taps and targets.
So the question is, what relational db? And to what target?
I built a bigquery target that is pretty fast 🏎️ so it can be done.
l
luis_vicente
04/19/2023, 10:58 AM
Thank you for your response. Yes, that's what I thought