Plugin configuration is invalid: (note: returned ...
# troubleshooting
i
Plugin configuration is invalid: (note: returned sample data value is masked) {"type": "RECORD", "stream": "xxx-testtable", "record": {"CLIENTID": *, "CLIENTLOCATIONID": *, "FLOORID": 30544, "FLOORCODE": "04", "FLOORNAME": "04", "STACKSEQUENCE": 1, "COUNTWORKSPACES": 1.0, "ZONEID": null, "ZONENAME": null, "ISSERVICEELIGIBLE": 1}, "time_extracted": "2023-01-23T145040.375550+00:00"} Exception ignored in: <function BaseSubprocessTransport.del at 0x0000020D1D1C8670> Traceback (most recent call last): File "C:\Python\Python39\lib\asyncio\base_subprocess.py", line 126, in del self.close() File "C:\Python\Python39\lib\asyncio\base_subprocess.py", line 104, in close File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 108, in close self._loop.call_soon(self._call_connection_lost, None) File "C:\Python\Python39\lib\asyncio\base_events.py", line 746, in call_soon self._check_closed() File "C:\Python\Python39\lib\asyncio\base_events.py", line 510, in _check_closed raise RuntimeError('Event loop is closed') RuntimeError: Event loop is closed Exception ignored in: <function _ProactorBasePipeTransport.del at 0x0000020D1D1E2E50> Traceback (most recent call last): File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 115, in del _warn(f"unclosed transport {self!r}", ResourceWarning, source=self) File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 79, in repr info.append(f'fd={self._sock.fileno()}') File "C:\Python\Python39\lib\asyncio\windows_utils.py", line 102, in fileno raise ValueError("I/O operation on closed pipe") ValueError: I/O operation on closed pipe (venv) PS C:\_Wk\_extract\ingest> meltano config tap-mssql test 2023-01-23T145959.190848Z [info ] The default environment 'dev' will be ignored for
meltano config
. To configure a specific environment, please use the option
--environment=<environment name>
. Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to join our friendly Slack community. Plugin configuration is invalid {"type": "RECORD", "stream": "LLSMS-CLIENTFLOOR", "record": {"CLIENTID": 3, "CLIENTLOCATIONID": 10087262, "FLOORID": 30544, "FLOORCODE": "04", "FLOORNAME": "04", "STACKSEQUENCE": 1, "COUNTWORKSPACES": 1.0, "ZONEID": null, "ZONENAME": null, "ISSERVICEELIGIBLE": 1}, "time_extracted": "2023-01-23T150139.817628+00:00"} Exception ignored in: <function BaseSubprocessTransport.del at 0x00000194FF9A9670> Traceback (most recent call last): File "C:\Python\Python39\lib\asyncio\base_subprocess.py", line 126, in del self.close() File "C:\Python\Python39\lib\asyncio\base_subprocess.py", line 104, in close proto.pipe.close() File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 108, in close self._loop.call_soon(self._call_connection_lost, None) File "C:\Python\Python39\lib\asyncio\base_events.py", line 746, in call_soon self._check_closed() File "C:\Python\Python39\lib\asyncio\base_events.py", line 510, in _check_closed raise RuntimeError('Event loop is closed') RuntimeError: Event loop is closed Exception ignored in: <function _ProactorBasePipeTransport.del at 0x00000194FF9C2E50> Traceback (most recent call last): File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 115, in del _warn(f"unclosed transport {self!r}", ResourceWarning, source=self) File "C:\Python\Python39\lib\asyncio\proactor_events.py", line 79, in repr info.append(f'fd={self._sock.fileno()}') File "C:\Python\Python39\lib\asyncio\windows_utils.py", line 102, in fileno raise ValueError("I/O operation on closed pipe") ValueError: I/O operation on closed pipe
r
Plugin configuration is invalid
{"type": "RECORD", "stream": "LLSMS-CLIENTFLOOR", "record": {"CLIENTID": 3, "CLIENTLOCATIONID": 10087262, "FLOORID": 30544, "FLOORCODE": "04", "FLOORNAME": "04", "STACKSEQUENCE": 1, "COUNTWORKSPACES": 1.0, "ZONEID": null, "ZONENAME": null, "ISSERVICEELIGIBLE": 1}, "time_extracted": "2023-01-23T150139.817628+00:00"}
Considering you did in fact get a
RECORD
message returned, this is probably a bug. Can you open a new issue?
I think this is most likely a Windows issue, but if you can provide the steps to replicate I can have a look into it.
i
Hi Rquben, much appreicate your prompt reply. I did a "meltano config tap-mssql test " for my tap, configure as below:
plugins: extractors: - name: tap-mssql variant: buzzcutnorman pip_url: git+https://github.com/BuzzCutNorman/tap-mssql.git config: dialect: mssql host: *** user: XXXXX password: XXXXXX database: ods_realsuite driver_type: pyodbc port: 1433 sqlalchemy_url_query: {driver: ODBC Driver 17 for SQL Server} , actually no reference doc to config tap for mssql; Environment: venv on python 3.9,9 Window 10 enterprise, added extractor tap-mssql --variant buzzcutnorman This is all for my environment. What is the best environment to use malteno on windows, using WSL? Thanks a ton, Ike
Actually, I did not find config item for how to let meltano know the ODBC DSN I want to use, I can only specify host, may be we can specify in item sqlalchemy_url_query but not knowing what kind of format can be.
r
I don't have much experience of Windows development, but I would assume WSL is the way to go. Because I don't have access to any valid credentials, I realise I'm not going to be able to reproduce your error exactly. In fact, I get a different error altogether:
Copy code
reuben@reuben-Inspiron-14-5425:/tmp/project$ meltano config tap-mssql test
2023-01-23T16:11:26.230144Z [info     ] The default environment 'dev' will be ignored for `meltano config`. To configure a specific environment, please use the option `--environment=<environment name>`.
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

[Errno 2] No such file or directory: '/tmp/project/.meltano/run/tap-mssql/tap.2277c0e4-9ab5-4e7c-95dd-eab201be82fd.config.json'
I was focusing on the
RuntimeError: Event loop is closed
and
ValueError: I/O operation on closed pipe
parts, since the command output indicates that you did indeed receive a
RECORD
message and so should have completed successfully. Do you find that you still see that stack trace when running
meltano config <plugin> test
with other plugins? For example, if I run
Copy code
meltano add extractor tap-auth0
TAP_AUTH0_DOMAIN=test TAP_AUTH0_CLIENT_ID=test TAP_AUTH0_CLIENT_SECRET=test meltano config tap-auth0 test
I get the following (no stack track - just an error message):
Copy code
2023-01-23T16:18:24.505816Z [info     ] The default environment 'dev' will be ignored for `meltano config`. To configure a specific environment, please use the option `--environment=<environment name>`.
Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Plugin configuration is invalid
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='test', port=443): Max retries exceeded with url: /oauth/token (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f3da9c5bb90>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
Curious as to what you get...
i
I got: Installing extractor 'tap-auth0'... Installed extractor 'tap-auth0' To learn more about extractor 'tap-auth0', visit https://hub.meltano.com/extractors/tap-auth0--matatika TAP_AUTH0_DOMAIN=test : The term 'TAP_AUTH0_DOMAIN=test' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. At line:2 char:1 + TAP_AUTH0_DOMAIN=test TAP_AUTH0_CLIENT_ID=test TAP_AUTH0_CLIENT_SECRE ... + ~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : ObjectNotFound: (TAP_AUTH0_DOMAIN=test:String) [], CommandNotFoundException + FullyQualifiedErrorId : CommandNotFoundException
ayway, thanks a lot. will try mtno on WSL
r
Ah, of course the syntax is different. Try just
Copy code
meltano config tap-auth0 test
without the environment variables?
s
Hi were you able to fix this? I am facing the same issue
m
I am facing the same issue 🙋‍♀️ Does any one have a fix?
r
m
Thanks! I tried to use WSL, and it solved the problem, but nice with a fix for windows as well