https://linen.dev logo
Join Slack
Powered by
Hey guys, after a great struggle with the tap-mssq...
# getting-started
z
Hey guys, after a great struggle with the tap-mssql, it turned out I have no idea how to properly use target-gsheet. Did anyone use it already?
a
I use it! what's your issue?
z
It is not working 😄
It states I need to put the ID of the sheet at the end, which is the end of the URL I suppose. Does it need any kind of authentication or such? I did not find it in the documentation
a
Can you share 
meltano.yaml
For auth, it expects client credentials json in home dir: https://github.com/singer-io/target-gsheet#step-1-activate-the-google-sheets-api
z
Copy code
version: 1
default_environment: dev
project_id: df886f9f-7b0f-4352-9c5d-2787036af31e
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-github
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-github.git>
    config:
      user_agent: SalesLoader
  - name: tap-mssql
    variant: wintersrd
    pip_url: tap-mssql
    config:
      host: 10.10.10.140
      user: pvarga
      database: INNO_LinkedInScraper_SANDBOX
      filter_dbs: dbo-JOBADS_TABLE
      port: '1435'
    select:
    - dbo-JOBADS_TABLE.*
    metadata:
      dbo-JOBADS_TABLE:
        replication-method: FULL_TABLE
  loaders:
  - name: target-gsheet
    variant: singer-io
    pip_url: target-gsheet
    config:
      spreadsheet_id: 13E5yCVK9594dw5mtIQ9-Ojq32P00c24uVlGmeZFckH0/edit#gid=0
  utilities:
  - name: sqlfluff
    namespace: sqlfluff
    pip_url: sqlfluff
    executable: sqlfluff
By the way I'm aware of the bad sheet ID, it was a desperate last resort idea to include the edit part which is totally dumb. Now I'm following the github documentation and have high hopes for that
I achieved a half victory, it does not get an error message but it does not load anything either 😄 How on earth can I get data from a tap-mssql to a gsheet?
a
Can you try going to jsonl first as a starting point?
OH the mssql is the source?
z
yes
At least it should be, but the authentication part had to be done I think
a
I'm assuming that 
meltano run tap-mssql target-jsonl
gives you what you want, and that it's just the writing to the gsheet thats the issue?
and also try with 
meltano --log-level=debug run tap-mssql target-gsheet
if you haven't already
z
I'll run this right now, till this point I got errors all the time
message has been deleted
message has been deleted
a
maybe 
meltano --log-level=debug run tap-mssql target-gsheet --full-refresh
to clear your state too EDIT: As you're doing FULL_TABLE replication not sure this matters.
z
message has been deleted
Still no data in the table tho
Wondering if it is not working due to not setting the exact query (?)...
a
The 
currently_syncing: None
does look a bit odd, if you try with 
target-jsonl
does it definitely work as intended?
z
my new finding was that the target-json was also not set up correctly so I rather left that path. It turns out I can use the discover mode on the tap-mssql to see what it returns. Surprisingly enough if I use it without a db filter it returns an endless amount of column names (I guess all tables?), but filtering it is bad for some reason (empty stream)
a
Hey @zoltan_gatmezei does using 
target-jsonl
work as it should?
Open in Slack
PreviousNext
Powered by