Meltano

Is there any guidelines regarding Meltano on AWS ? We are using a EC2 and Meltano is taking ages to load and respond.

Hello <@U06C8RP6H6H>. Can you please share more details about your Meltano setup on EC2? What kind of EC2 instance are you on? Are you running Meltano using Docker?

Sorry for the lack of information.
We are having issues while using the UI, displaying the pipelines, tap and targets.
Somehow we are having the following issue for a couple of days:

We are using docker to run the isntance of Meltano

The EC2 instance is a T3 medium. Is that enough?

Thanks. I think a `t3.medium` instance should be good enough. From the error you shared, it seems that an Airflow task is timing out. Can you try increasing the timeout (<https://airflow.apache.org/docs/stable/configurations-ref.html#dagbag-import-timeout>) and see if it helps?

```meltano config airflow set core dagbag_import_timeout 120```
This will set the DagBag import timeout to 120 seconds. If you still get the same error, you can try setting the timeout to a higher value.

Thank you for your answer. I will keep you posted about the change!

It helped. But we are still having an issue where the dag is not triggered at all. And we do not have logs to look into it.
Also for some reason it takes some times to check meltano’s logs through the UI when clicking on the `last run` button.