Hi everyone I am trying to use the custom <https github com Meltano #plugins-general

Hi everyone, I am trying to use the custom <tap-po...

paulo_rijnberg

03/23/2022, 5:44 PM

Hi everyone, I am trying to use the custom tap-postmark, but I stumble upon some problems when using it in combination with

meltano elt

. Please read the thread for more detailed information about the error message and my questions. Just to prevent some spamming 🙂

paulo_rijnberg

03/23/2022, 5:44 PM

The tap is working if you define a state file, like mentioned in the repo, and I run the following:

meltano invoke tap-postmark --state=state.json

. But if I want to use it in combination with a loader, something goes wrong. If I run

meltano elt tap-postmark target-csv --state=state.json

, I obtain the following error message: ```2022-03-23T174105.859733Z [info ] Running extract & load... job_id=2022-03-23T174105--tap-postmark--target-csv name=meltano run_id=698dc318-b3a4-402e-b164-7ce834100b81 2022-03-23T174105.881932Z [info ] Found state in state.json 2022-03-23T174105.992026Z [info ] INFO Sending version information to singer.io. To disable sending anonymous usage data, set the config parameter "disable_collection" to true cmd_type=loader job_id=2022-03-23T174105--tap-postmark--target-csv name=target-csv run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174106.057571Z [info ] INFO >>> Running tap-postmark v0.1.0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174106.063990Z [info ] INFO Sync cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174106.064237Z [info ] INFO Syncing stream: messages_outbound cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174106.702485Z [info ] INFO Date 2022-03-01, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174106.932810Z [info ] INFO Date 2022-03-02, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174107.148895Z [info ] INFO Date 2022-03-03, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174107.365480Z [info ] INFO Date 2022-03-04, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174107.580417Z [info ] INFO Date 2022-03-05, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174107.846368Z [info ] INFO Date 2022-03-06, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174108.054473Z [info ] INFO Date 2022-03-07, batch: 1, messages: 0 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174108.299909Z [info ] INFO Date 2022-03-08, batch: 1, messages: 1 cmd_type=extractor job_id=2022-03-23T174105--tap-postmark--target-csv name=tap-postmark run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174108.300545Z [info ] Traceback (most recent call last): cmd_type=loader job_id=2022-03-23T174105--tap-postmark--target-csv name=target-csv run_id=698dc318-b3a4-402e-b164-7ce834100b81 stdio=stderr 2022-03-23T174108.300781Z [info ] File "/mailing-project/meltano/.meltano/loaders/target-csv/venv/bin/target-csv", line 8, in <module> cmd_type=loader job_id=202…

christoph

03/23/2022, 9:45 PM

Hi @paulo_rijnberg. Reading the error message from

meltano elt

, I don't see any errors from the postmark tap. The only error message that you posted is from the

target-csv

loader. So, I think it's safe to say that the postmark tap works just fine.

Copy code

2022-03-23T17:41:08.318693Z [error    ] Loading failed                 code=1 job_id=2022-03-23T174105--tap-postmark--target-csv message=FileNotFoundError: [Errno 2] No such file or directory: 'output/messages_outbound-20220323T174105.csv' name=meltano run_id=698dc318-b3a4-402e-b164-7ce834100b81

paulo_rijnberg

03/24/2022, 7:16 AM

@christoph, thank you for the response! I totally read over it. It seems to be broken due to not creating the

output

folder. Whereas, when using the loader

target-jsonl

(

meltano elt tap-postmark target-jsonl --state=state.json

). It creates the

output

folder automatically.

Open in Slack

Previous Next