I am using the tap-postgres extractor and I am experiencing an issue with it starting from today. Could someone help me on how to find the root of the problem?

ELT could not be completed: Cannot start extractor: Catalog discovery failed:

This happens only on gitlab-ci with a gitlab-runner with image

python:3.8.10

but not on my local machine where I use the same python version. I tried adding log-level debug, which gives me stack trace that doesn't really help me.

meltano.core.plugin.error.PluginExecutionError: Catalog discovery failed: command ['/builds/<REDACTED>/meltano-dwh-pipeline/data/.meltano/extractors/tap-[MASKED]/venv/bin/tap-[MASKED]', '--config', '/builds/<REDACTED>/meltano-dwh-pipeline/data/.meltano/run/elt/wabia-to-[MASKED]-WABIA-METRICS-PROD/536d0acb-9fc5-4bec-8358-467a2b0261d7/tap.3d87def8-082e-42fa-9a26-2387103c773f.config.json', '--discover'] returned 1
384The above exception was the direct cause of the following exception:
385Traceback (most recent call last):
386  File "/usr/local/lib/python3.8/site-packages/meltano/cli/elt.py", line 248, in _run_elt
387    await _run_extract_load(log, elt_context, output_logger)
388  File "/usr/local/lib/python3.8/site-packages/meltano/cli/elt.py", line 307, in _run_extract_load
389    await singer_runner.run(
390  File "/usr/local/lib/python3.8/site-packages/meltano/core/runner/singer.py", line 224, in run
391    await self.invoke(
392  File "/usr/local/lib/python3.8/site-packages/meltano/core/runner/singer.py", line 70, in invoke
393    raise RunnerError(f"Cannot start extractor: {err}") from err
394meltano.core.runner.RunnerError: Cannot start extractor: Catalog discovery failed: command ['/builds/<REDACTED>/meltano-dwh-pipeline/data/.meltano/extractors/tap-[MASKED]/venv/bin/tap-[MASKED]', '--config', '/builds/<REDACTED>/meltano-dwh-pipeline/data/.meltano/run/elt/wabia-to-[MASKED]-WABIA-METRICS-PROD/536d0acb-9fc5-4bec-8358-467a2b0261d7/tap.3d87def8-082e-42fa-9a26-2387103c773f.config.json', '--discover'] returned 1
395The above exception was the direct cause of the following exception:
396Traceback (most recent call last):
397  File "/usr/local/lib/python3.8/site-packages/meltano/cli/elt.py", line 234, in _redirect_output
398    yield
399  File "/usr/local/lib/python3.8/site-packages/meltano/cli/elt.py", line 255, in _run_elt
400    raise CliError(

Hi @nino_mueller! How are you passing the tap settings in gitlab ci? I think they might be missing

Nino - I had this issue the other day but it was with loader. If I recall, I had something wrong in my yaml - search for my comments here and see if that helps, pretty long chain