Hello everyone I've been trying out a meltano ext...
# troubleshooting
s
Hello everyone I've been trying out a meltano extractor for mssql by forking a current one and I seem to be facing an issue while connecting to the db
Copy code
2025-04-14T05:40:34.883063Z [debug    ] Meltano 3.6.0, Python 3.10.9, Windows (AMD64)
2025-04-14T05:40:34.887124Z [debug    ] Looking up time zone info from registry
2025-04-14T05:40:34.892488Z [info     ] Environment 'test' is active  
2025-04-14T05:40:34.910936Z [debug    ] Creating DB engine for project at 'C:\\Users\\Lenovo\\Desktop\\GDC\\Tap\\POC' with DB URI 'sqlite:/C:\\Users\\Lenovo\\Desktop\\GDC\\Tap\\POC\\.meltano/meltano.db'
2025-04-14T05:40:35.020965Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.020965Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.020965Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.021974Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.021974Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.021974Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.022965Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.022965Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.103032Z [debug    ] Skipped installing extractor 'poc'
2025-04-14T05:40:35.104023Z [debug    ] Skipped installing 1/1 plugins
2025-04-14T05:40:35.199362Z [debug    ] Created configuration at C:\Users\Lenovo\Desktop\GDC\Tap\POC\.meltano\run\poc\tap.67806009-f627-42b6-af6d-488d63f7a914.config.json
2025-04-14T05:40:35.200261Z [debug    ] Could not find tap.properties.json in C:\Users\Lenovo\Desktop\GDC\POC\.meltano\extractors\poc\tap.properties.json, skipping.
2025-04-14T05:40:35.201309Z [debug    ] Could not find tap.properties.cache_key in C:\Users\Lenovo\Desktop\GDC\POC\.meltano\extractors\poc\tap.properties.cache_key, skipping.
2025-04-14T05:40:35.201309Z [debug    ] Could not find state.json in C:\Users\Lenovo\Desktop\GDC\Tap\POC\.meltano\extractors\poc\state.json, skipping.
2025-04-14T05:40:35.203359Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.203359Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.203359Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.203359Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.204261Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.204261Z [debug    ] Variable '$G' is not set in the provided env dictionary.
2025-04-14T05:40:35.204261Z [debug    ] Variable '$P' is not set in the provided env dictionary.
2025-04-14T05:40:35.204261Z [debug    ] Variable '$G' is not set in the provided env dictionary.
I have added Host, User, Password, DB, Port to the meltano.yml file.
r
Can you share your
meltano.yml
?
s
Here is my meltano.yml file -
Copy code
version: 1
send_anonymous_usage_stats: true
project_id: tap-poc
default_environment: test
environments:
- name: test
plugins:
  extractors:
  - name: tap-poc
    namespace: tap_poc
    pip_url: -e .
    capabilities:
    - state
    - catalog
    - discover
    - about
    - stream-maps

    # TODO: Declare settings and their types here:
    settings:
    - name: server
      kind: string
      label: Server
      description: FQDN of the SQL server
    - name: port
      kind: string
      label: Port
      description: Port for SQL connection
    - name: database
      kind: string
      label: Database
      description: Database name
    - name: user
      kind: string
      label: User
      description: User with SQL access
    - name: password
      env: TAP_POC_PASSWORD
      kind: password
      label: Password
      description: Password for the user
      sensitive: true
    - name: start_date
      kind: date_iso8601
      label: Start Date
      description: Initial date to start extracting data from

    # TODO: Declare default configuration values here:
    config:
      start_date: '2010-01-01T00:00:00Z'
      port: '1433'
      user: <username>
      host: <hostname>
      database: <dbname>
      server: <servername>
  loaders:
  - name: target-jsonl
    variant: andyh1203
    pip_url: target-jsonl
r
Does your password (or any of the values in config) contain
$P
and/or
$G
?
s
No
r
Where do you see an issue connecting to the db then? What command are you running?
1
s
meltano invoke tap-poc --discover
I did try again from scratch still I face the same issue
e
What's the issue, though? Are you seeing an error? Those
Variable '$P' is not set...
messages should be safe to ignore.
s
I get the DB connectivity issue where login fails for DB error 28000: login fails for user pyodbc error 18456. All the credentials are correct it's just when I try with this I face the issue