i noticed the default s3 target will write files s...
# plugins-general
c
i noticed the default s3 target will write files such as s3://dev-dataplatform-airbyte-testing/gong/calls/year=2024/month=01/day=30/20240130.json.gz - so all the data i generated today gets the same name. i can change the level of detail. can i change the name pattern?
e
Hi @Chris. Have you tried change the value of the
append_date_to_filename_grain
setting? https://github.com/crowemi/target-s3/blob/24d451a9c1b38910b247fdaf478960f5a8084b27/target_s3/target.py#L166-L170
c
i can change it to minutes and seconds. curious if there are other options
e