https://linen.dev logo
Join Slack
Powered by
for those who have succesfully got oracle set up, ...
# plugins-general
d
for those who have succesfully got oracle set up, is this not the right name to use for pip_url and executable? Getting an executable could not be found after installing pip_url: git+https://github.com/transferwise/pipelinewise-tap-oracle.git executable: pipelinewise-tap-oracle
d
@devon_seitz I think the executable name is just 
tap-oracle
d
thank you! that was it
v
https://gitlab.com/vischous/oracle2mssql/-/blob/master/oracle2mssql/meltano.yml may be helpful as well this is a base oracle setup for a docker install
d
that was extreamly helpful, thank you Derek
@visch out of curiousity have you ever run into this issue?
Copy code
Cannot list the selected attributes: Catalog discovery failed: command ['/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/bin/tap-oracle', '--config', '/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/run/tap-oracle/tap.12165e1b-1fb4-4add-8324-839aa366f54c.config.json', '--discover'] returned 1
happens anytime i attempt to connect to it (select, etl, etc)
d
@devon_seitz Can you run 
meltano invoke tap-oracle --discover
and see if it prints an error?
d
ahh you know what is happening
Copy code
(.venv) Devons-GeniusRx-Laptop:grx_meltano devon.seitz$ meltano invoke tap-oracle --discover
INFO starting discovery
INFO dsn: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=206.227.246.65)(PORT=5056))(CONNECT_DATA=(SID=dwmmpp01)))
INFO fetching row counts
INFO fetching tables:
   SELECT owner, table_name
   FROM all_tables
   WHERE owner != 'SYS' []
INFO fetching views
INFO fetching column info
INFO fetching pk constraints
CRITICAL ORA-00942: table or view does not exist
Traceback (most recent call last):
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/bin/tap-oracle", line 8, in <module>
    sys.exit(main())
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 565, in main
    raise exc
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 562, in main
    main_impl()
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 552, in main_impl
    do_discovery(conn_config, filter_schemas)
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 346, in do_discovery
    catalog = discover_columns(connection, table_info, filter_schemas)
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 283, in discover_columns
    cols)
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 200, in produce_column_metadata
    database_name = get_database_name(connection)
  File "/Users/devon.seitz/Desktop/datascience_repo/grx_meltano/.meltano/extractors/tap-oracle/venv/lib/python3.7/site-packages/tap_oracle/__init__.py", line 189, in get_database_name
    rows = cur.execute("SELECT name FROM v$database").fetchall()
cx_Oracle.DatabaseError: ORA-00942: table or view does not exist
im reading that as it can’t get into all tables
and thats most likely cause im filtering schema
hmm i guess not
v
Yes I had that as well
Copy code
SELECT name FROM v$database
You need access to the v$database table I did a cheeky thing in tap_oracle here https://gitlab.com/autoidm/tap-oracle/-/blob/main/tap_oracle/__init__.py#L232 to get around this as if you are filtering by schemas you don't really need to query that table
If you can just get access to the v$database table that'd be the easier way to go
d
thank you! unfortuantly don’t own the source so would be difficult to get elevated access
but i bet this will work!
it did 🙂 youre the best
v
Glad to help @douwe_maan hopping in is the real hero, I'm only at this point because of his help early!
d
Hardly, all I did was help with the executable name, you actually helped debug the tap 😄
Open in Slack
PreviousNext
Powered by