Hi all, I just wanted to know that in transformation while create models can we specify a composite primary key or not and if yes can anyone tell me how?

Meltano uses dbt for the Transformations. You can check their documentation on that subject https://docs.getdbt.com/docs/introduction

Hey one more thing does meltano supports incremental extraction and loading? or it just load the whole data?

Meltano supports incremental extraction for all extractors that have that feature. This is done behind the scenes as long as you run the same pipeline or schedule a pipeline to run in regular intervals

So, what is the method on the backend does it store the timestamp or by the primary key?

1. Check whether the postgres extractor you are using is supporting STATEs 2. If it supporting STATEs. set your postgres extractor to have a

state

capability Check how we define extractors in our

discovery.yml

file https://www.meltano.com/discovery.yml

Thanks for the help.

You are welcome 🙂