Jun Pei Liang
01/29/2025, 10:57 PM2025-01-29T22:52:29.272860Z [debug ] Skipping node at '.streams[0].metadata[3].metadata.sql-datatype'
2025-01-29T22:52:29.272993Z [debug ] Skipping node at '.streams[0].metadata[3].metadata.inclusion'
2025-01-29T22:52:29.273059Z [debug ] Skipping node at '.streams[0].metadata[3].metadata.selected-by-default'
2025-01-29T22:52:29.273121Z [debug ] Skipping node at '.streams[0].metadata[3].metadata.selected'
2025-01-29T22:52:29.273186Z [debug ] Visiting CatalogNode.METADATA at '.streams[0].metadata[4]'.
2025-01-29T22:52:29.273255Z [debug ] Visiting metadata node for tap_stream_id 'IFSAPP-ABC_CLASS', breadcrumb '['properties', 'OBJVERSION']'
2025-01-29T22:52:29.273387Z [debug ] Setting '.streams[0].metadata[4].metadata.selected' to 'False'
2025-01-29T22:52:29.273480Z [debug ] Setting '.streams[0].metadata[4].metadata.selected' to 'True'
2025-01-29T22:52:29.273555Z [debug ] Skipping node at '.streams[0].metadata[4].breadcrumb[0]'
2025-01-29T22:52:29.273627Z [debug ] Skipping node at '.streams[0].metadata[4].breadcrumb[1]'
2025-01-29T22:52:29.273746Z [debug ] Skipping node at '.streams[0].metadata[4].metadata.sql-datatype'
2025-01-29T22:52:29.273844Z [debug ] Skipping node at '.streams[0].metadata[4].metadata.inclusion'
2025-01-29T22:52:29.273953Z [debug ] Skipping node at '.streams[0].metadata[4].metadata.selected-by-default'
2025-01-29T22:52:29.274038Z [debug ] Skipping node at '.streams[0].metadata[4].metadata.selected'
2025-01-29T22:52:29.274184Z [debug ] Visiting CatalogNode.METADATA at '.streams[0].metadata[5]'.
2025-01-29T22:52:29.274307Z [debug ] Visiting metadata node for tap_stream_id 'IFSAPP-ABC_CLASS', breadcrumb '['properties', 'OBJID']'
2025-01-29T22:52:29.274423Z [debug ] Setting '.streams[0].metadata[5].metadata.selected' to 'False'
2025-01-29T22:52:29.274583Z [debug ] Skipping node at '.streams[0].metadata[5].breadcrumb[0]'
2025-01-29T22:52:29.274689Z [debug ] Skipping node at '.streams[0].metadata[5].breadcrumb[1]'
2025-01-29T22:52:29.274776Z [debug ] Skipping node at '.streams[0].metadata[5].metadata.sql-datatype'
2025-01-29T22:52:29.274856Z [debug ] Skipping node at '.streams[0].metadata[5].metadata.inclusion'
2025-01-29T22:52:29.274920Z [debug ] Skipping node at '.streams[0].metadata[5].metadata.selected-by-default'
2025-01-29T22:52:29.274980Z [debug ] Skipping node at '.streams[0].metadata[5].metadata.selected'
2025-01-29T22:52:29.275045Z [debug ] Skipping node at '.streams[0].selected'
2025-01-29T22:52:29.275103Z [debug ] Skipping node at '.streams[0].replication_method'
2025-01-29T22:52:29.275161Z [debug ] Skipping node at '.streams[0].replication_key'
2025-01-29T22:52:29.276766Z [debug ] Invoking: ['/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/bin/tap-oracle', '--config', '/projects/my-meltano-project/.meltano/run/tap-oracle/tap.e8454e4e-b596-4b5a-a3e1-7072a967ecb4.config.json', '--catalog', '/projects/my-meltano-project/.meltano/run/tap-oracle/tap.properties.json']
time=2025-01-29 14:52:29 name=singer level=INFO message=Running in cx mode
time=2025-01-29 14:52:29 name=singer level=WARNING message=cx_oracle is no longer maintained, use python-oracledb
To switch to python-oracledb set the environment variable ORA_PYTHON_DRIVER_TYPE=thin or thick.
Documentation for python-oracledb can be found here: <https://oracle.github.io/python-oracledb/>
time=2025-01-29 14:52:29 name=singer level=INFO message=Selected streams: ['IFSAPP-ABC_CLASS']
time=2025-01-29 14:52:29 name=singer level=INFO message=No currently_syncing found
time=2025-01-29 14:52:29 name=singer level=INFO message=Beginning sync of stream(IFSAPP-ABC_CLASS) with sync method(incremental)
time=2025-01-29 14:52:29 name=singer level=INFO message=Stream IFSAPP-ABC_CLASS is using incremental replication with replication key ROWVERSION
{"type":"SCHEMA","stream":"IFSAPP-ABC_CLASS","schema":{"properties":{"ABC_CLASS":{"maxLength":1,"type":["null","string"]},"ABC_PERCENT":{"type":["null","integer"]},"OBJKEY":{"maxLength":50,"type":["null","string"]},"OBJVERSION":{"maxLength":14,"type":["null","string"]},"OBJID":{}},"type":"object"},"key_properties":[],"bookmark_properties":["ROWVERSION"]}
time=2025-01-29 14:52:29 name=singer level=INFO message=dsn: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.10.131.67)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=<http://TEST10PDB.ifs10devdb.vcn10sj.oraclevcn.com|TEST10PDB.ifs10devdb.vcn10sj.oraclevcn.com>)))
{"type":"STATE","value":{"bookmarks":{"IFSAPP-ABC_CLASS":{"last_replication_method":"INCREMENTAL","replication_key":"ROWVERSION","version":1738191149591}},"currently_syncing":"IFSAPP-ABC_CLASS"}}
{"type":"ACTIVATE_VERSION","stream":"IFSAPP-ABC_CLASS","version":1738191149591}
time=2025-01-29 14:52:29 name=singer level=CRITICAL message='NoneType' object has no attribute 'get'
Traceback (most recent call last):
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/bin/tap-oracle", line 8, in <module>
sys.exit(main())
^^^^^^
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 686, in main
raise exc
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 683, in main
main_impl()
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 677, in main_impl
do_sync(conn_config, args.catalog, args.config.get('default_replication_method'), state)
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 619, in do_sync
state = sync_traditional_stream(conn_config, stream, state, sync_method_lookup[stream.tap_stream_id], end_scn)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 574, in sync_traditional_stream
state = do_sync_incremental(conn_config, stream, state, desired_columns)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/__init__.py", line 460, in do_sync_incremental
state = incremental.sync_table(conn_config, stream, state, desired_columns)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/projects/my-meltano-project/.meltano/extractors/tap-oracle/venv/lib/python3.12/site-packages/tap_oracle/sync_strategies/incremental.py", line 63, in sync_table
replication_key_sql_datatype = md.get(('properties', replication_key)).get('sql-datatype')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2025-01-29T22:52:29.621253Z [debug ] Deleted configuration at /projects/my-meltano-project/.meltano/run/tap-oracle/tap.e8454e4e-b596-4b5a-a3e1-7072a967ecb4.config.json