When running Meltano with a Postgres state backend...
# getting-started
m
When running Meltano with a Postgres state backend (setting
MELTANO_DATABASE_URI
to a SQLAlchemy Postgres URI), meltano writes to a number of Postgres tables - not just
state
, but also
runs
(and others, but
runs
is valuable). When running Meltano with an S3 state backend (setting
MELTANO_STATE_BACKEND_URI
to an AWS S3 URI), meltano only writes
state
-
runs
data is not persisted to S3 at all. My question - is it possible to configure Meltano to write
runs
data to S3 when using S3 as a state backend? We’d like to switch over from Postgres to S3 so we can sunset this particular Postgres database but if that means we lose the
runs
records we may need to reconsider, that is valuable data.
👀 1
I have found https://docs.meltano.com/concepts/project#support-for-other-database-types in the docs now which tells me this is not possible
e
Thanks @Matt Menzenski! I've responded in the issue.