I am testing stream_map filters with the tap-postg...
# troubleshooting
d
I am testing stream_map filters with the tap-postgres meltanolabs variant with the following configuration. I am not getting any records filtered out. Any ideas what is wrong with my configuration? https://sdk.meltano.com/en/latest/stream_maps.html#filtering-out-records-from-a-stream-using-filter-operation
version: 1
default_environment: dev
project_id: 019a03c3-03c4-71fc-871e-bf515fe8f915
environments:
- name: dev
- name: staging
- name: prod
plugins:
extractors:
- name: tap-postgres
variant: meltanolabs
pip_url: meltanolabs-tap-postgres
config:
sqlalchemy_url: postgresql:///meltano
filter_schemas:
- public
select:
- public-runs.*
metadata:
public-runs:
replication-method: INCREMENTAL
replication-key: started_at
stream_maps:
public-runs:
__filter__: job_name.startswith('dev:tap-mssql-to-target-jsonl')
loaders:
- name: target-jsonl
variant: andyh1203
pip_url: target-jsonl
config:
do_timestamp_file: true
Output in screenshot. Command:
meltano run tap-postgres --full-refresh target-jsonl
1