Hey all! I have added the S3 State Backend to my ...
# troubleshooting
i
Hey all! I have added the S3 State Backend to my pipeline config.
tap-mysql target-s3
I managed to get it to run successfully, once, and state was stored in a
meltano-state
folder. Unfortunately I ended up with my files in
<s3://my-test-bucket/meltano-state/meltano-state/><state files>
because I had set the S3 Uri to
<s3://my-test-bucket/meltano-state/>
After I'd cleaned this up I reran the pipeline but received this message which must be related to the fact there are no state files but I'd expect the pipeline to start from scratch gracefully:
[info     ] Reading state from AWS S3
[info     ] Found credentials in environment variables.
[error    ] Cannot start plugin tap-mysql: argument of type 'int' is not iterable
[error    ] Block run completed.
I tried running again with
--full-refresh
but it also failed - I assumed this would not require State intially.
Copy code
[info     ] Writing state to AWS S3
[info     ] Found credentials in environment variables.
[warning  ] Unable to persist state, or received state is invalid, incremental state has not been updated
[info     ] Block run completed.
Can anyone suggest how to resolve this?