Not sure if this should be here or in `taps` but i...
# announcements
m
Not sure if this should be here or in
taps
but is there plan to support Google BigQuery officially in the future? There are a couple taps already out there, but they seem to be either very fragile or not worked on for the last couple years.
d
To be clear, there's not really such a thing as "officially supported", because we see building and maintaining taps and targets as the shared responsibility of the community rather than that of any particular player (like us). Our focus is on building a great runner to enable the community to build a great library of taps and targets, and not on building or supporting specific taps and targets that the community hasn't so far shown to care enough about to support by itself. A fragile or outdated tap or target will therefore only get better through people like you deciding they care enough to test it, file issues, and fix bugs. 🙂 As for BigQuery, are you looking for an extractor (tap) or loader (target)? A tap (https://github.com/anelendata/tap-bigquery) was announced on the Singer Slack workspace just last week: https://singer-io.slack.com/archives/C2TGFCZEV/p1598034989006700 As for targets, I know that a few people in this Slack workspace have had good results with https://github.com/RealSelf/target-bigquery, and there's also https://github.com/transferwise/pipelinewise-target-bigquery. Did you experience specific issues with either?
a
@michael_cooper are you looking for a bigquery tap (not a target)? Daigo at Anelen Data recently released https://github.com/anelendata/tap-bigquery that you could use in meltano as a custom tap
m
@adam_roderick sorry, I meant a target for BigQuery @douwe_maan I saw the RealSelf target, but that required a config of
table_id
which implies it can only handle one table at a time, which is also assumed since the example they give has one table with one column. There was a fork of RealSelf that was updated recently that was able to produce multiple tables, but it would error out with the Github tap I was using, which worked fine with Snowflake. As for the PiplineWise one, I hadn't heard of that and I'm looking at it now. It looks promising already!