Hey folks!
I am trying to export my log files off of the EC2 machine, which hosts my Meltano project, preferably into an Amazon S3 bucket!
Does anyone have experience exporting elt log files in this capacity? Thank you in advance!
p
pat_nadolny
07/18/2022, 2:15 PM
I havent used it for exporting logs but I installed the aws cli as a utility plugin and use it to move files around. Check out this `elt` + awscli job. That was implemented before meltano run so its actually easier now by adding it to a run pipeline like
meltano run tap-x target-y awscli:custom_s3_log_mv_command