Hi - I've been trying to connect to Google Ads through tap-adwords which uses OAUTH - however it seems I am doing something incorrectly as the variables and values are not recognised and I am receiving the following error:

File "/project/.meltano/extractors/tap-adwords/venv/lib/python3.6/site-packages/singer/utils.py", line 153, in check_config
    raise Exception("Config is missing required keys: {}".format(missing_keys))
Exception: Config is missing required keys: ['oauth_client_id', 'oauth_client_secret', 'user_agent', 'developer_token']

I've created a .env in the main project folder with the following variables:

export OAUTH_GOOGLE_ADWORDS_DEVELOPER_TOKEN=<developer_token>
export OAUTH_GOOGLE_ADWORDS_CLIENT_ID=<client_id>
export OAUTH_GOOGLE_ADWORDS_CLIENT_SECRET=<client_secret>

I then run

meltano ui

and install Google Adwords from the GUI, however after adding the Account ID and Refresh-Token the error above appears. I followed the documentation I could find and tried to track down discussions here but couldn't find a solution. I must be doing something wrong, since when I am in the UI, I cannot see the OAUTH fields as shown in the screenshot of this doc: https://meltano.com/plugins/extractors/adwords.html#configuration-with-the-meltano-ui Any assistance would be brilliant!

@ofer_kulka It's expected that you're not seeing those fields in the UI, since we marked them as hidden, since they'll usually be set up by the administrator rather than the UI end user: https://gitlab.com/meltano/meltano/-/blob/master/src/meltano/core/bundle/discovery.yml#L294 It looks like you're setting the environment variables correctly, so the "Config is missing required keys" error is unexpected. Can you run

meltano config tap-adwords

to show the current config that's passed on to the tap when you run

meltano elt

? Do the developer token etc show up there?

@douwe_maan thanks for the prompt response! I've successfully added the extractor ! Seems I was missed running this command,

meltano config tap-adwords

, as you suggested. Thanks a lot! As a follow-up question, where / can I define which schemas the extractors should pull from each platform? For instance if I want it to skip certain tables or choose specific ones and not everything on GA or FB Ads.

@ofer_kulka Did you see https://meltano.com/docs/getting-started.html#select-entities-and-attributes-to-extract and https://meltano.com/docs/integration.html#selecting-entities-and-attributes-for-extraction? 🙂

Thank you again! This is great! I thought I saw documentation about that at some point but couldn't find it again browsing through. My apologies!