ian_lewis
07/20/2023, 3:58 PMtap-mysql target-s3
I managed to get it to run successfully, once, and state was stored in a meltano-state
folder.
Unfortunately I ended up with my files in <s3://my-test-bucket/meltano-state/meltano-state/><state files>
because I had set the S3 Uri to <s3://my-test-bucket/meltano-state/>
After I'd cleaned this up I reran the pipeline but received this message which must be related to the fact there are no state files but I'd expect the pipeline to start from scratch gracefully:
[info ] Reading state from AWS S3
[info ] Found credentials in environment variables.
[error ] Cannot start plugin tap-mysql: argument of type 'int' is not iterable
[error ] Block run completed.
I tried running again with --full-refresh
but it also failed - I assumed this would not require State intially.
[info ] Writing state to AWS S3
[info ] Found credentials in environment variables.
[warning ] Unable to persist state, or received state is invalid, incremental state has not been updated
[info ] Block run completed.
Can anyone suggest how to resolve this?