```meltano | DEBUG ELT could not...
# troubleshooting
b
```meltano | DEBUG ELT could not be completed: Cannot start extractor: Catalog discovery failed: command ['/meltano-project/.meltano/extractors/tap-s3-csv/venv/bin/tap-s3-csv', '--config', '/meltano-project/.meltano/run/elt/2021-10-01T165951--tap-s3-csv--target-redshift-raw/c2c0d441-7f49-4a04-a4f8-7e0a5d3cca6b/tap.6e664c35-584f-42ef-b969-366b3eef6e68.config.json', '--discover'] returned 1 Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/meltano/core/runner/singer.py", line 67, in invoke stderr=asyncio.subprocess.PIPE, # Log File "/usr/local/lib/python3.6/site-packages/meltano/core/plugin_invoker.py", line 275, in invoke_async async with self._invoke(*args, **kwargs) as ( File "/usr/local/lib/python3.6/site-packages/async_generator/_util.py", line 34, in aenter return await self._agen.asend(None) File "/usr/local/lib/python3.6/site-packages/meltano/core/plugin_invoker.py", line 260, in _invoke async with self.plugin.trigger_hooks("invoke", self, args): File "/usr/local/lib/python3.6/site-packages/async_generator/_util.py", line 34, in aenter return await self._agen.asend(None) File "/usr/local/lib/python3.6/site-packages/meltano/core/behavior/hookable.py", line 87, in trigger_hooks await self.class.trigger(self, f"before_{hook_name}", *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/meltano/core/behavior/hookable.py", line 115, in trigger raise err File "/usr/local/lib/python3.6/site-packages/meltano/core/behavior/hookable.py", line 107, in trigger await hook_func(target, *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/meltano/core/plugin/singer/tap.py", line 251, in discover_catalog_hook await self.discover_catalog(plugin_invoker) File "/usr/local/lib/python3.6/site-packages/meltano/core/plugin/singer/tap.py", line 297, in discover_catalog await self.run_discovery(plugin_invoker, catalog_path) File "/usr/local/lib/python3.6/site-packages/meltano/core/plugin/singer/tap.py", line 358, in run_discovery f"Catalog discovery failed: command {plugin_invoker.exec_args('--discover')} returned {exit_code}" meltano.core.plugin.error.PluginExecutionError: Catalog discovery failed: command ['/meltano-project/.meltano/extractors/tap-s3-csv/venv/bin/tap-s3-csv', '--config', '/meltano-project/.meltano/run/elt/2021-10-01T165951--tap-s3-csv--target-redshift-raw/c2c0d441-7f49-4a04-a4f8-7e0a5d3cca6b/tap.6e664c35-584f-42ef-b969-366b3eef6e68.config.json', '--discover'] returned 1 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/meltano/cli/elt.py", line 239, in _run_elt await _run_extract_load(elt_context, output_logger) File "/usr/local/lib/python3.6/site-packages/meltano/cli/elt.py", line 282, in _run_extract_load loader_out=loader_out_writer, File "/usr/local/lib/python3.6/site-packages/meltano/core/runner/singer.py", line 230, in run loader_out=loader_out, File "/usr/local/lib/python3.6/site-packages/meltano/core/runner/singer.py", line 70, in invoke raise RunnerError(f"Cannot start extractor: {err}") from err meltano.core.runner.RunnerError: Cannot start extractor: Catalog discovery failed: command ['/meltano-project/.meltano/extractors/tap-s3-csv/venv/bin/tap-s3-csv', '--config', '/meltano-project/.meltano/run/elt/2021-10-01T165951--tap-s3-csv--target-redshift-raw/c2c0d441-7f49-4a04-a4f8-7e0a5d3cca6b/tap.6e664c35-584f-42ef-b969-366b3eef6e68.config.json', '--discover'] returned 1 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/meltano/cli/elt.py", line 227, in _redirect_output yield File "/usr/local/lib/python3.6/site-packages/meltano/cli/elt.py", line 248, in _run_elt raise CliError(f"ELT could not be completed: {err}") from err meltano.cli.utils.CliErro…
e
Hi @boggdan_barrientos! This
voluptuous.error.MultipleInvalid: expected a list
makes me think it's an error in one of the config values. Likely
tables
. Does
meltano invoke tap-s3-csv
work? If not, can you run
meltano config tap-s3-csv
and confirm that the config JSON looks good?
a
Fwiw, if you are using
meltano config set
to set variables, the
kind
must be correct in order for this to work properly. the error being raised tells me that a list value is expected but a string value was provided - implying it might have been set via
meltano config set
but meltano CLI may have configured it as a string (the default behavior) rather than as an object or list. @boggdan_barrientos - Can you confirm if you see this might be the root cause? If so, we'd welcome your thoughts on the related issue here.
b
@aaronsteers thanks! I was modifying the .yml directly so the root was not it. I was able to configure it,
meltano invoke tap-s3-csv
got sticky with
name=tap_s3_csv level=INFO message=Attempting to create AWS session
but
meltano select tap-s3-csv --list
shows me the table and headers. The elt doesn't creates any table in the target.