Thanks to some tips from AJ, I've started to get m...
# troubleshooting
e
Thanks to some tips from AJ, I've started to get my Tap back into working order... I seem to have hit some error which makes me wonder if I've upgraded too quickly.. log is in thread but the gist is
AttributeError: module 'collections' has no attribute 'MutableMapping'
I will need to look if also the target has changed somehow.. seems the error is perhaps coming out of
target-postgres
EDIT: seems it's a target not being compatible with python 3.10 .. i guess there's perhaps a way to tell meltano to use an older python ?? for a specific loader ?
```2022-08-27T182752.473171Z [info ] time=2022-08-27 202752 name=tap-ibkr level=INFO message=Properties ('alphabet_partition',) were present in the 'ib_tickers' stream but not found in catalog schema. Ignoring. cmd_type=elb consumer=False name=tap-ibkr-tickers producer=True stdio=stderr string_id=tap-ibkr-tickers 2022-08-27T182752.473841Z [info ] Traceback (most recent call last): cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.474183Z [info ] File "/home/ubuntu/meltano_proj_repo/.meltano/loaders/target-postgres/venv/bin/target-postgres", line 8, in <module> cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.474704Z [info ] sys.exit(main()) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.475007Z [info ] File "/home/ubuntu/meltano_proj_repo/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/target_postgres/__init__.py", line 373, in main cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.475226Z [info ] persist_lines(config, singer_messages) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.475450Z [info ] File "/home/ubuntu/meltano_proj_repo/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/target_postgres/__init__.py", line 133, in persist_lines cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.475657Z [info ] primary_key_string = stream_to_sync[stream].record_primary_key_string(o['record']) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.475884Z [info ] File "/home/ubuntu/meltano_proj_repo/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/target_postgres/db_sync.py", line 337, in record_primary_key_string cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.476100Z [info ] flatten = flatten_record(record, self.flatten_schema, max_level=self.data_flattening_max_level) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.476384Z [info ] File "/home/ubuntu/meltano_proj_repo/.meltano/loaders/target-postgres/venv/lib/python3.10/site-packages/target_postgres/db_sync.py", line 150, in flatten_record cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.476606Z [info ] if isinstance(v, collections.MutableMapping) and level < max_level: cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.476849Z [info ] AttributeError: module 'collections' has no attribute 'MutableMapping' cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres 2022-08-27T182752.542610Z [error ] Traceback (most recent call last): File "/home/ubuntu/.local/pipx/venvs/meltano/lib/python3.10/site-packages/meltano/core/logging/output_logger.py", line 138, in redirect_logging yield File "/home/ubuntu/.local/pipx/venvs/meltano/lib/python3.10/site-packages/meltano/core/block/extract_load.py", line 438, in run await self.run_with_job() File "/home/ubuntu/.local/pipx/venvs/meltano/lib/python3.10/site-packages/meltano/core/block/extract_load.py", line 464, in run_with_job await self.execute() File "/home/ubuntu/.local/pipx/venvs/meltano/lib/python3.10/site-packages/meltano/core/block/extract_load.py", line 430, in execute await manager.run() File …
Copy code
Meltano V2.5.0
ah ... I think the Target-Postgres is not working for python 3.10 .. https://stackoverflow.com/a/71902541/389976 This SO outlines a change in python behavior
I will try to track down where the right place to report this
I think I gotta start switching to outputting parquet files at this point
while this gets sorted