pranit__warehows.io_
04/06/2022, 9:07 AMSpecify the plugin's namespace, which will serve as the:
- identifier to find related/compatible plugins
- default target database dialect (`dialect` extra),
for use by transformers that connect with the database
Hit Return to accept the default: plugin name with underscores instead of dashes
(namespace) [target_bigquery]:
Specify the plugin's `pip install` argument, for example:
- PyPI package name:
target-bigquery
- Git repository URL:
git+<https://gitlab.com/meltano/target-bigquery.git>
- local directory, in editable/development mode:
-e extract/target-bigquery
- 'n' if using a local executable (nothing to install)
Default: plugin name as PyPI package name
(pip_url) [target-bigquery]:
Specify the plugin's executable name
Default: name derived from `pip_url`
(executable) [target-bigquery]:
Specify the target's supported settings (`config.json` keys)
Multiple setting names (keys) can be separated using commas.
A setting kind can be specified alongside the name (key) by using the `:` delimiter,
e.g. `port:integer` to set the kind `integer` for the name `port`
Supported setting kinds:
string | integer | boolean | date_iso8601 | email | password | oauth | options | file | array | object | hidden
- Credentials and other sensitive setting types should use the password kind.
- If not specified, setting kind defaults to string.
- Nested properties can be represented using the `.` separator, e.g. `auth.username` for `{ "auth": { "username": value } }`.
- To find out what settings a target supports, reference its documentation.
Default: no settings
(settings) [[]]: port:integer
Loader 'target-bigquery' already exists in your Meltano project
To add it to your project another time so that each can be configured differently,
add a new plugin inheriting from the existing one with its own unique name:
meltano add loader target-bigquery--new --inherit-from target-bigquery
Installing loader 'target-bigquery'...
Loader 'target-bigquery' could not be installed: failed to install plugin 'target-bigquery'.
Running command git clone --filter=blob:none --quiet <https://github.com/adswerve/target-bigquery.git> /tmp/pip-req-build-_qz6v1w9
Running command git checkout -q 837c140cdbc017c32939371e2a374877523853cb
ERROR: Cannot install setuptools==57.5.0 and target-bigquery==0.11.0 because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts>
cody_hanson
04/07/2022, 2:55 PMmeltano.yml
file
3. The output of pip3 freeze
pranit__warehows.io_
04/08/2022, 4:31 AMpranit__warehows.io_
04/08/2022, 4:33 AMbigquery/venv/lib/python3.8/site-packages/target_bigquery/schema.py", line 359, in format_record_to_schema\n record[k] = conversion_dict[bq_schema[k]["type"]](v)\n', "KeyError: 'RECORD'\n"] name=meltano run_id=fcd0ba3f-39f5-4b11-a099-539497ef1018
I have created taps catalog file using discover command.pranit__warehows.io_
04/08/2022, 7:21 AMtable_config
file , how do we generate that?cody_hanson
04/08/2022, 5:36 PMtarget-bigquery
variant that you're using? If I read your initial message correctly, it seems like you installed it as a custom plugin, is that correct?pranit__warehows.io_
04/08/2022, 5:42 PM