Hello , I am working with tap Postgres transferwis...
# troubleshooting
m
Hello , I am working with tap Postgres transferwise on the source, there is one column which in Postgres schema is defined like below :
Copy code
module_dates              | timestamp without time zone[]
and currently, all rows’ value for this column is {} when I filter this column it works fine but when removing filter my pipeline fails my pipeline
Copy code
- name: tap-postgres--xxx
      inherit_from: tap-postgres
      select:
        - public-bre.*
and here is what I can find from the logs anyone had such an issue? any suggestion? whether I can cast this column as text in my pipeline?
Copy code
SELECT  "closing_reason" ,CASE WHEN  "created_at"  < '0001-01-01 00:00:00.000' OR  "created_at"  > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE  "created_at"  END AS  "created_at" ,CASE WHEN  "end_date"  < '0001-01-01 00:00:00.000' OR  "end_date"  > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE  "end_date"  END AS  "end_date" , "error" , "id"  ,CASE WHEN  "module_dates"  < '0001-01-01 00:00:00.000' OR  "module_dates"  > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE  "module_dates"  END AS  "module_dates" , "phase_type",CASE WHEN  "updated_at"  < '0001-01-01 00:00:00.000' OR  "updated_at"  > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE  "updated_at"  END AS  "updated_at" , xmin::text::bigint cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.390185Z [info     ]                                       FROM "public"."bre" cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.390419Z [info     ]                                      ORDER BY xmin::text ASC with itersize 20000 cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396401Z [info     ] time=2023-06-02 09:42:42 name=singer level=INFO message=METRIC: {"type": "counter", "metric": "record_count", "value": 0, "tags": {}} cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396712Z [info     ] time=2023-06-02 09:42:42 name=tap-postgres--xxx level=CRITICAL message=malformed array literal: "0001-01-01 00:00:00.000" cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396944Z [info     ] LINE 1: ..._per_therapy_field" ,CASE WHEN  "module_dates"  < '0001-01-0... cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397221Z [info     ]                                                              ^ cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397437Z [info     ] DETAIL:  Array value must start with "{" or dimension information. cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397652Z [info     ]                                cmd_type=extractor name=tap-postgres--xxx