Hi all, i'm currently trying to run a pipeline tap...
# troubleshooting
j
Hi all, i'm currently trying to run a pipeline tap-postgres -> target-bigquery. I'm using the transferwise variants on both. I'm using the LOG_BASED replication. The source table that i'm trying to replicate has an index with 6 fields. When i run the pipeline, the process creates the table on BigQuery, but then throws an error "...6 clustering fields specified, exceeding the limit of 4...". The table created on BQ does not have any partition or cluster... I think this is happening because of the index that the source table on postgres sql has, but was not able to find a solution for it so far. I'm not interested in replicating the index, only the data. Any has an idea how to solve this? Thanks in advance.
Still on this topic, i'm using meltano version 2.2.0. I've seen that there was a fix regarding the issue i've reported above, that is described here: https://github.com/jmriego/pipelinewise-target-bigquery but i'm not sure if there's a way to install the version with the fix on my current meltano installation. Any help would be much appreciated