Hi everyone! I'm using a personal project to try out Meltano and having trouble configuring my extractor. Hope this is the right place for this kind of question. I'm collecting and storing my data in a Google Sheet on my personal Google account. I want to pipe this data to the BigQuery instance that's also in my personal Google account. To do this, I am following the Getting Started guide and the Google Search Console Authentication guide from the Sheets Meltano Hub. However, I'm struggling to generate some of the required configuration parameters because I don't have a domain or website for which I can verify site ownership (I'm generating my own data for this project). If I'm reading the documentation correctly, verifying site ownership is the first step to get these parameters. Any advice on what to do?

While I love that you’re trying to use Meltano for this, I think you can natively query google sheets from BigQuery, or at least import them. https://cloud.google.com/blog/products/gcp/how-to-crunch-your-business-data-from-sheets-in-bigquery

I wondered about this... I could also just download the Sheet as a CSV and then use

dbt seed

to get it into BQ. But using Meltano would be more fun! Maybe this isn't the best use case for Meltano, I think I'll use the native integration. Thanks @taylor!

In this case Meltano may be a good choice if the data in the sheet was regularly changing, but for one offs, I’d go with the native integration 👍

Well, the data is regularly changing. I built a mobile app that I use to write data to the Google Sheet. Then I want the data in that Google Sheet to get loaded into BQ on an ongoing basis because I'll be adding data often. I'm running dbt on top of that BQ data and ultimately building some reports in Mode Studio

I’d still honestly recommend using the native integration to start. Focus on getting the value from the data in BQ, see where the native integration breaks down or if you wish it handled things differently and then you can incrementally add Meltano if it makes sense. Basically, build the data pipeline up with small iterations as you figure out what you definitely want capabilities-wise

I'll do that, thanks for the advice Taylor, it is much appreciated!