Hello. We have managed to sync between Postgres Ta...
# troubleshooting
r
Hello. We have managed to sync between Postgres Tap to BigQuery Target successfully. We have partitioned tables in the Postgres with hash on id. We have 20 partitioned tables i.e. _mytable_00_ to _mytable_19_. The goal is to have a single table in BigQuery with the name mytable and partition on date. Is it possible to achieve this?
d
With only a tap and a target, Meltano can only do a simple "extract tables from here and create tables in there". If you'd like to combine those tables and change the partitioning, that would require transformation using (e.g.) dbt, which Meltano supports out of the box. Do you have experience with dbt?
r
@douwe_maan Thanks for the response. I had gone through DBT documentation a couple of years back. I will try to create DBT models.