Hello! Totally rookie here. I am using the

tap-postgres

and struggling to get meltano to update the state file. Even when I specifically pass a path to a state file, it does not update. This means I have to load the entire table each time even though my meltano.yml config is set to

incremental

. Can someone help me?

Hi @Nathan Meek! With Meltano you don't need to manually manage the state file. If you run for, example

meltano run tap-postgres target-snowflake

will generate a state ID automatically for you. You can verify the existing state IDs and their values with the

meltano state

command. Also not that for sources like Postgres, you need to specify which tables you want to be synced incrementally and which columns are used to incrementally select and extract data. There's an example of that in https://docs.meltano.com/concepts/plugins/#metadata-extra. Let me know if you have questions 🙂

Thank you!