https://linen.dev logo
Join Slack
Powered by
Trying to use `target-gsheet` and after playing ar...
# getting-started
a
Trying to use 
target-gsheet
and after playing around a bit with Google Cloud UI (the readme instructions need updating to new UI), it almost seems to work, but this error doesn't give me enough details to know what's wrong. ā€¢ I had to give my own email address (app creator) test access to the app. Weird, but worked. ā€¢ First run it prompted to auth the app on browser, which I did and returned a successful approval. Didn't prompt on the next runs. ā€¢ It says 
KeyError: 'spreadsheet_id'
but I double checked the ID and it's correct. ā€¢ Since then I get this new error. My guess it's something to do with the Google App I created. I haven't published the app (do I need to?) because I understood that'd make it public and the instructions didn't say to. Any idea?
e
Hi @axel! Can you check with 
meltano config target-gsheet list
to make sure the 
spreadsheet_id
value is known by Meltano?
a
It returned nothing, so I guess it's not getting it.
Copy code
(.venv) axel@XPS-Axel:~/meltano/clickup$ meltano config target-gsheet list
(.venv) axel@XPS-Axel:~/meltano/clickup$ meltano config target-gsheet -list
Usage: meltano config [OPTIONS] PLUGIN_NAME COMMAND [ARGS]...
Try 'meltano config --help' for help.

Error: Missing argument 'PLUGIN_NAME'.
(.venv) axel@XPS-Axel:~/meltano/clickup$ meltano config target-gsheet list
(.venv) axel@XPS-Axel:~/meltano/clickup$
But I swear, it's here. šŸ˜„
Wait, which folder should it be into? The instructions said "in the working directory", so for me it's /meltano/clickup/. I think that's correct.
v
ahh I think I see. You made a seperate file called config.json That data is actually provided via meltano.yml So if you run 
meltano config --list target-gsheet
you'll see what Edgar is talking about
What you need to run I think is 
meltano config target-gsheet set spreadsheet_id puttheidhere
That will add it to your meltano.yml šŸ˜„
a
Thanks @visch. It worked. I did that because that's what the instructions said. Nothing about the yml. Now IT WORKED! šŸ’Ŗ Now I got slapped by Google 60 write requests per minute. Sucks. I have to find a workaround for this now. šŸ˜‚
v
Hmmm I think clickup send a stupid number of state calls which may be contributing
Not sure how to stop them to test my theory, you could also limit to just one stream to see if that works
a
What do you mean to one stream? This is something I need to limit. I was going to ask, is there some command in meltano to limit the amount of load requests that are sent in a set of time? The limits I'm hitting are "per minute". The total limits are actually unlimited. I just need to slow it down. I need to control this before I can create the pipeline.
v
The target should handle that so in this case. To limit to one stream I mean to do something like change your select to be just
Copy code
select:
- tasks.*
instead of selecting everything
Looks like someone else had the same error https://github.com/singer-io/target-gsheet/pull/7
In your Meltano.yml try changing the pip_url to 
git+<https://github.com/rseabrook/target-gsheet@batch_api_calls>
Then run 
meltano install
to reinstall the target from the new location Then try again
a
This worked @visch! If I don't limit the streams it still reaches the quota, but much later. So then I tried limiting streams and it completed it fine. It didn't got 
task.time_spent
nor 
task.status.*
though. Later I'll pick some more fields and will check which ones fails to get.
4 Views
Open in Slack
PreviousNext
Powered by