https://linen.dev logo
#plugins-general
Title
# plugins-general
b

bassel

12/07/2023, 12:51 AM
@edgar_ramirez_mondragon I tried to fork the
transferwise variant
repo of the tap-s3-csv extractor and I manually moved the changes from s7clarke1 variant to the forked copy .. and I re-installed the plugins and it passed. But, when I ran the pipeline, I'm getting this error .. which I couldn't figure out the reason thinkspin (attached the error log file) ```2023-12-07T004419.537946Z [error ] Loading failed code=1 message=Exception: Line is missing required properties key(s): {} name=meltano run_id=e620a28c-79d0-4f24-9675-48f9dabb6181 state_id=2023-12-07T004405--tap-s3-csv--target-snowflake 2023-12-07T004419.538070Z [debug ] ELT could not be completed: Loader failed. For more detailed log messages re-run the command using 'meltano --log-level=debug ...' CLI flag. Note that you can also check the generated log file at '/Users/baselabdo/meltano-onmopay/test/.meltano/logs/elt/2023-12-07T004405--tap-s3-csv--target-snowflake/e620a28c-79d0-4f24-9675-48f9dabb6181/elt.log'. For more information on debugging and logging: https://docs.meltano.com/reference/command-line-interface#debugging ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/meltano/cli/elt. │ │ py:288 in _run_elt │ │ │ │ 285 │ │ │ if elt_context.only_transform: │ │ 286 │ │ │ │ log.info("Extract & load skipped.") │ │ 287 │ │ │ else: │ │ ❱ 288 │ │ │ │ await _run_extract_load(log, elt_context, output_logger) │ │ 289 │ │ │ │ │ 290 │ │ │ if elt_context.transformer: │ │ 291 │ │ │ │ await _run_transform(log, elt_context, output_logger) │ │ │ │ /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/meltano/cli/elt. │ │ py:357 in _run_extract_load │ │ │ │ 354 │ │ │ with loader_log.line_writer() as loader_log_writer: │ │ 355 │ │ │ │ with extractor_out_writer_ctxmgr() as extractor_out_writer: │ │ 356 │ │ │ │ │ with loader_out_writer_ctxmgr() as loader_out_writer: │ │ ❱ 357 │ │ │ │ │ │ await singer_runner.run( │ │ 358 │ │ │ │ │ │ │ **kwargs, │ │ 359 │ │ │ │ │ │ │ extractor_log=extractor_log_writer, │ │ 360 │ │ │ │ │ │ │ loader_log=loader_log_writer, │ │ │ │ /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/meltano/core/run │ │ ner/singer.py:223 in run │ │ │ │ 220 │ │ async with tap.prepared(self.context.session), target.prepared( │