mari_n
06/15/2023, 8:42 AMmodule_dates | timestamp without time zone[]
and currently, all rows’ value for this column is {}
when I filter this column it works fine
but when removing filter
my pipeline fails
my pipeline
- name: tap-postgres--xxx
inherit_from: tap-postgres
select:
- public-bre.*
and here is what I can find from the logs
anyone had such an issue? any suggestion?
whether I can cast this column as text in my pipeline?
SELECT "closing_reason" ,CASE WHEN "created_at" < '0001-01-01 00:00:00.000' OR "created_at" > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE "created_at" END AS "created_at" ,CASE WHEN "end_date" < '0001-01-01 00:00:00.000' OR "end_date" > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE "end_date" END AS "end_date" , "error" , "id" ,CASE WHEN "module_dates" < '0001-01-01 00:00:00.000' OR "module_dates" > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE "module_dates" END AS "module_dates" , "phase_type",CASE WHEN "updated_at" < '0001-01-01 00:00:00.000' OR "updated_at" > '9999-12-31 23:59:59.999' THEN '9999-12-31 23:59:59.999' ELSE "updated_at" END AS "updated_at" , xmin::text::bigint cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.390185Z [info ] FROM "public"."bre" cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.390419Z [info ] ORDER BY xmin::text ASC with itersize 20000 cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396401Z [info ] time=2023-06-02 09:42:42 name=singer level=INFO message=METRIC: {"type": "counter", "metric": "record_count", "value": 0, "tags": {}} cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396712Z [info ] time=2023-06-02 09:42:42 name=tap-postgres--xxx level=CRITICAL message=malformed array literal: "0001-01-01 00:00:00.000" cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.396944Z [info ] LINE 1: ..._per_therapy_field" ,CASE WHEN "module_dates" < '0001-01-0... cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397221Z [info ] ^ cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397437Z [info ] DETAIL: Array value must start with "{" or dimension information. cmd_type=extractor name=tap-postgres--xxx run_id=29015bb0-fafc-455e-be23-e19f59695562 state_id=postgres--xxx-to-snowflake_v2 stdio=stderr
2023-06-02T09:42:42.397652Z [info ] cmd_type=extractor name=tap-postgres--xxx