hey there! had a question about using partitioning in target-bigquery with meltano, i followed the instructions here - https://github.com/adswerve/target-bigquery#setting-up-partitioning-and-clustering and have

"table_config": "load/target-tables-config.json"

in the target-bigquery config in my

meltano.yml

, but when I ran an elt, the resulting table still wasn't partitioned, any ideas?

@joy_yu What version of

target-bigquery

are you using? It's possible that your

pip_url

in

meltano.yml

points at a specific tag that didn't support the

table_config

feature yet.

the pip_url is

git+<https://github.com/adswerve/target-bigquery.git@hotfix/issue9>

Ah, that's probably it. That branch doesn't contain https://github.com/adswerve/target-bigquery/commit/6d6349b272adca9256b778a3003e10436831f14c

ah i see, should I just change

hotfix/issue9

to

master

or remove it or something?

You can remove

@...

, and run

meltano install loader target-bigquery

to reinstall the latest version

I'm guessing you are using that branch because of this issue, which isn't fixed in master yet

ahh yeah, i remember a teammate had this issue

@dan_ladd Good point! @joy_yu You can point your

pip_url

at the

development

branch that has all of the hotfixes: https://github.com/adswerve/target-bigquery/commits/development

I spoke to Ruslan last week and he said the development branch is on track to get released by the end of the month. The dev branch contains the hotfix and the ability to partition tables through the config argument if you want go with that.

@prratek_ramchandani FYI

Follow up here, Adswerve just released the latest version for target-bigquery that should solve all these issues.

nice, thanks for the update!