Any advice on how to specify previous versions of adswerve b Meltano #troubleshooting

Any advice on how to specify previous versions of ...

k_s

01/13/2022, 4:35 PM

Any advice on how to specify previous versions of adswerve bigquery target in meltano.yml file, tried git+https://github.com/adswerve/target-bigquery.git@v0.10.2 and didnt work

k_s

01/13/2022, 4:36 PM

Running command git clone --filter=blob:none -q https://github.com/adswerve/target-bigquery.git /tmp/pip-req-build-7mt2kwyh WARNING: Did not find branch or tag 'v0.11.3', assuming revision or ref. Running command git checkout -q v0.11.3 error: pathspec 'v0.11.3' did not match any file(s) known to git

k_s

01/13/2022, 4:39 PM

ok, removing the v and this works

k_s

01/13/2022, 4:40 PM

however pipeline fails at [error ] Loading failed code=1 job_id=postgres-to-bigquery-postgres message=pkg_resources.DistributionNotFound: The 'target-bigquery' distribution was not found and is required by the application name=meltano

jonas_kalderstam

01/13/2022, 7:41 PM

The reason is probably because of the

in your version string. The tags on https://github.com/adswerve/target-bigquery/tags do not have a

prefix in them. so try

git+<https://github.com/adswerve/target-bigquery.git@0.10.2>

without the

jonas_kalderstam

01/13/2022, 7:42 PM

or strangely

0.10.2

exists but also

v0.10.2

but they point at different commits

jonas_kalderstam

01/13/2022, 7:43 PM

did you try

meltano install --clean

k_s

01/14/2022, 2:47 PM

Indeed it runs a meltano install --clean but still wasnt working. This issue wasnt solved but for us it was solved by switching to meltano python 3.8 for our docker image and using the latest bigquery target.

3 Views

Open in Slack

Previous Next