Sante Allegrini
11/22/2024, 7:36 AMtap-clickhouse
to connect to my ClickHouse Cloud
instance with the following configuration:
version: 1
default_environment: dev
project_id: 9065dc05-743d-4771-bf0b-ef744691eee1
environments:
- name: dev
- name: staging
- name: prod
plugins:
extractors:
- name: tap-clickhouse
variant: akurdyukov
pip_url: git+<https://github.com/akurdyukov/tap-clickhouse.git>
config:
username: default
password: mypassword
driver: http
host: xxxxxxxxxxx.eu-central-1.aws.clickhouse.cloud
port: 8443
database: default
secure: True
verify: False
When I attempt to test the connection with:
meltano config tap-clickhouse test
I get the following message:
❯ meltano config tap-clickhouse test
2024-11-22T07:32:08.218900Z [info ] The default environment 'dev' will be ignored for `meltano config`. To configure a specific environment, please use the option `--environment=<environment name>`.
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.
Plugin configuration is invalid
ValueError: unconverted data remains: 000
What am I doing wrong?Reuben (Matatika)
11/22/2024, 9:22 AMmeltano --log-level debug config tap-clickhouse test
?Sante Allegrini
11/22/2024, 9:46 AMReuben (Matatika)
11/22/2024, 9:50 AM2024-11-22T07:32:08.218900Z [info ] The default environment 'dev' will be ignored for `meltano config`. To configure a specific environment, please use the option `--environment=<environment name>`.
as above.Reuben (Matatika)
11/22/2024, 9:52 AMmeltano config tap-clickhouse test &> test.out
Sante Allegrini
11/22/2024, 9:55 AMReuben (Matatika)
11/22/2024, 10:08 AMdatetime.strptime
is expecting:
Python 3.12.2 (main, Feb 6 2024, 20:19:44) [GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from datetime import datetime
>>>
>>> x = "2024-01-01 00:00:00.000"
>>> datetime.strptime(x, '%Y-%m-%d %H:%M:%S.%f')
datetime.datetime(2024, 1, 1, 0, 0)
>>>
>>> x = "2024-01-01 00:00:00.000000"
>>> datetime.strptime(x, '%Y-%m-%d %H:%M:%S.%f')
datetime.datetime(2024, 1, 1, 0, 0)
>>>
>>> x = "2024-01-01 00:00:00.000000000"
>>> datetime.strptime(x, '%Y-%m-%d %H:%M:%S.%f')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/linuxbrew/.linuxbrew/Cellar/python@3.12/3.12.2_1/lib/python3.12/_strptime.py", line 554, in _strptime_datetime
tt, fraction, gmtoff_fraction = _strptime(data_string, format)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/Cellar/python@3.12/3.12.2_1/lib/python3.12/_strptime.py", line 336, in _strptime
raise ValueError("unconverted data remains: %s" %
ValueError: unconverted data remains: 000
>>>
Reuben (Matatika)
11/22/2024, 10:18 AMSante Allegrini
11/22/2024, 10:21 AMit looks like the error originates from within the ClickHouse SQLAlchemy driver.That's what I was suspecting. I was just following this https://hub.meltano.com/extractors/tap-clickhouse/ Thank you for looking into this! 👋
Reuben (Matatika)
11/22/2024, 10:22 AMReuben (Matatika)
11/22/2024, 10:25 AM