Strange issues when using S3 State Backend. 1. When I set

MELTANO_STATE_BACKEND_URI='<s3://my-data-lake/state/>'

the files are saved to

<s3://my-data-lake/state/state/><env>:<pipeline name>/

so whatever subdirectory I use in my key is captured and reused as part of the key. 2. If I delete the files to start again the boto3 delete object/retry code seems to b0rk and stops any state being saved.

@ian_lewis that sounds like a bug. Would you be willing to log an issue? https://github.com/meltano/meltano/issues/new/choose

Thanks @edgar_ramirez_mondragon I will do that.