GitHub
08/04/2025, 4:31 AMcol1,col2,col3 (out of 10 columns in total) from a table tableA in schema PROD.
The following doesn't work.
plugins:
extractors:
- name: tap-oracle--adhoc
inherit_from: tap-oracle
select:
- PROD-TABLEA.COL1
- PROD-TABLEA.COL2
- PROD-TABLEA.COL3
config:
default_replication_method: FULL_TABLE
filter_schemas: PROD
metadata:
PROD-TABLEA:
replication-key: COL3
replication-method: INCREMENTAL
When I try to list (using meltano select tap-oracle--adhoc --list --all) it doesn't return anything in selected stream
2025-08-01T07:03:04.713546Z [info ] No Meltano environment was selected
2025-08-01T07:03:13.150718Z [warning ] Stream `PROD-TABLEA` was not found in the catalog
Legend:
selected
excluded
automatic
unsupported
Enabled patterns:
PROD-TABLEA.COL1
PROD-TABLEA.COL2
PROD-TABLEA.COL3
Selected attributes:
The following does work and appropriately only selects column col1, col2, col3
plugins:
extractors:
- name: tap-oracle--adhoc
inherit_from: tap-oracle
select:
- PROD-TABLEA.*
- "!PROD-TABLEA.COL4"
- "!PROD-TABLEA.COL5"
- "!PROD-TABLEA.COL6"
- "!PROD-TABLEA.COL7"
- "!PROD-TABLEA.COL8"
- "!PROD-TABLEA.COL9"
- "!PROD-TABLEA.COL10"
config:
default_replication_method: FULL_TABLE
filter_schemas: PROD
metadata:
PROD-TABLEA:
replication-key: COL3
replication-method: INCREMENTAL
2025-08-01T07:52:20.252177Z [info ] No Meltano environment was selected
Legend:
selected
excluded
automatic
unsupported
Enabled patterns:
PROD-TABLEA.*
"!PROD-TABLEA.COL4"
"!PROD-TABLEA.COL5"
"!PROD-TABLEA.COL6"
"!PROD-TABLEA.COL7"
"!PROD-TABLEA.COL8"
"!PROD-TABLEA.COL9"
"!PROD-TABLEA.COL10"
Selected attributes:
[automatic ] PROD-TABLEA.COL1
[selected ] PROD-TABLEA.COL2
[selected ] PROD-TABLEA.COL3
[excluded ] PROD-TABLEA.COL4
[excluded ] PROD-TABLEA.COL5
[excluded ] PROD-TABLEA.COL6
[excluded ] PROD-TABLEA.COL7
[excluded ] PROD-TABLEA.COL8
[excluded ] PROD-TABLEA.COL9
[excluded ] PROD-TABLEA.COL10
I am not sure if this is an issue with tap-oracle or meltano but I did confirm that the tap supports discovery so it shouldn't be limitation of tap itself.
### Code
include_paths:
- ./config/*.yml
plugins:
extractors:
- name: tap-oracle
variant: s7clarke10
pip_url: git+https://github.com/s7clarke10/pipelinewise-tap-oracle.git@v2.0.1
config:
ora_python_driver_type: thick
cursor_array_size: 50000
loaders:
- name: target-snowflake
variant: meltanolabs
pip_url: meltanolabs-target-snowflake==0.17.6
config:
batch_size_rows: 200000
### Link to Slack/Linen
No response
meltano/meltanoGitHub
08/25/2025, 6:48 PM