Hi 👋 I got two questions regarding settings in Meltano: 1. Is it possible to create multiple schedules for same extractor and loader but with different options (catalog / state). I have not seen something like this and overwriting settings in the schedules would be a cool feature I think. a. Why have multiple schedules for the same extractor? In many sources I request data from different endpoints. There are slow chaging dimensions which need to be updated once a day and some data which needs to be updates multiples times a day to have close to live data. 2. Settings like _state and _catalog are not visible in the UI which is a minor pain for data team members (other than data engineer). It would be good to see those as well. Maybe those points are missing and could be added into the backlog? (Prio on first point)

Hi @michel_ebner! 1. The current solution would be to use plugin inheritance with different values of

state

and

catalog

and then reference the different plugin instances in your schedules. Does that work for you? 2. cc @taylor

We’re also looking at updating the

schedules

key to be more expressive. Currently documented in https://gitlab.com/meltano/meltano/-/issues/2079#note_804742477 and your request for multiple schedules is included 🙂

Hey, thanks for the answers! 1. @edgar_ramirez_mondragon that's what I am currently doing 2. @taylor Thanks, hope to see it soon (March 2022 if it still stands?). But this has nothing to do with

_state

and

_catalog

not beeing visible in the UI, right? This problem still stands if i read correctly.

@michel_ebner quite right - would you mind opening an issue in the Meltano project for this? cc @alexmarple

@taylor Just created the issue. Maybe I should split it into 2 issues. Not sure how related it is, as both are problems regarding settings visibility.

Great - I’ll take a look. Thanks!

@michel_ebner thank you! your second question falls in my lap and i’ll add it to my queue. i might have some follow up questions for you down the road!