#2420 Automatically clean up old ELT logs
Issue created by
MeltyBot
Migrated from GitLab:
https://gitlab.com/meltano/meltano/-/issues/2465
Originally created by
@ivanovzlatan2 on 2020-12-01 17
5227
---
Problem to solve
Meltano generates log files in the following directories:
.../.meltano/run/elt/...
.../.meltano/run/airflow/logs
The log files are taking up a lot of space, that's why it would be good to have a solution of regular cleanup of old log files.
Target audience
Target audience is everyone that is using Meltano scheduler and has limited disk space.
Proposal
Introducing a custom config for Meltano
automatic log cleanup and retaining with options for how many days to retain the log files (7d/30d/60d).
Current workaround
One can set up own cron job to automatically delete files with an old creation/modification date
Links / references
meltano/meltano