Hi everyone! How to check if a pipeline would be ...
# troubleshooting
f
Hi everyone! How to check if a pipeline would be executed successfully or not with meltano run command? I tried with --dry-run flag but it show me that the this: [info ] Dry run, but would have run block 1/1. and I didn't have any variables defined, so logically the command was supposed to fail. Does someone know another command or flag that really works for this purpose? My target-snowflake:
Copy code
- name: target-snowflake
    variant: meltanolabs
    pip_url: meltanolabs-target-snowflake
    config:
      account: ${SNOWFLAKE_ACCOUNT}
      database: ${SNOWFLAKE_DATABASE}
      default_target_schema: ${SNOWFLAKE_DEFAULT_SCHEMA}
      schema: ${SNOWFLAKE_SCHEMA}
      user: ${SNOWFLAKE_USER}
      warehouse: ${SNOWFLAKE_WAREHOUSE}
The response for meltano run tap-csv target-snowflake --dry-run: ```2023-09-15T145523.540493Z [info ] Environment 'dev' is active 2023-09-15T145525.102589Z [info ] Setting 'console' handler log level to 'debug' for dry run 2023-09-15T145525.693958Z [debug ] Remote
discovery.yml
manifest could not be downloaded. 2023-09-15T145525.694135Z [debug ] 404 Client Error: Not Found for url: https://discovery.meltano.com/discovery.yml?project_id=bf26b5bf-1148-4dd7-beb6-24dce88addd1 2023-09-15T145526.458180Z [debug ] Found plugin parent parent=tap-csv plugin=tap-csv source=<DefinitionSource.DISCOVERY: 1> 2023-09-15T145526.459196Z [debug ] found plugin in cli invocation plugin_name=tap-csv 2023-09-15T145528.497938Z [debug ] Found plugin parent parent=target-snowflake plugin=target-snowflake source=<DefinitionSource.HUB: 2> 2023-09-15T145528.500111Z [debug ] found plugin in cli invocation plugin_name=target-snowflake 2023-09-15T145528.500310Z [debug ] head of set is extractor as expected block=<meltano.core.plugin.project_plugin.ProjectPlugin object at 0x7f8d2f85b550> 2023-09-15T145528.643617Z [debug ] Variable '$variable_for_dev_tests' is not set in the provided env dictionary. 2023-09-15T145528.643699Z [debug ] Variable '$AZURE_CONNECTION_STRING_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.643768Z [debug ] Variable '$AWS_ACCESS_KEY_ID_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.643839Z [debug ] Variable '$AWS_SECRET_KEY_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.731258Z [debug ] found block block_type=loaders index=1 2023-09-15T145528.731393Z [debug ] blocks idx=1 offset=0 2023-09-15T145528.877574Z [debug ] Variable '$variable_for_dev_tests' is not set in the provided env dictionary. 2023-09-15T145528.877658Z [debug ] Variable '$AZURE_CONNECTION_STRING_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.877712Z [debug ] Variable '$AWS_ACCESS_KEY_ID_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.877776Z [debug ] Variable '$AWS_SECRET_KEY_STATE_BACKEND_DEV' is not set in the provided env dictionary. 2023-09-15T145528.904886Z [debug ] Variable '$SNOWFLAKE_DEFAULT_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.916385Z [debug ] Variable '$SNOWFLAKE_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.939637Z [debug ] Variable '$SNOWFLAKE_DEFAULT_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.950039Z [debug ] Variable '$SNOWFLAKE_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.974250Z [debug ] Variable '$SNOWFLAKE_DEFAULT_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.986175Z [debug ] Variable '$SNOWFLAKE_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.998077Z [debug ] Variable '$MELTANO_LOAD_SCHEMA' is not set in the provided env dictionary. 2023-09-15T145528.998939Z [debug ] found ExtractLoadBloc…