Hello, I have a custom mapper using which i make s...
# singer-target-development
m
Hello, I have a custom mapper using which i make some changes in schema, record and state messages of tap-mysql. Specifically, I'm attempting to change the stream value, ensuring it remains case-sensitive. However, despite providing the tablename as "ABc", it's being converted to lowercase ("abc") and loaded into the database using target-postgres. I attempted to address this by adding extra double quotes, but unfortunately, this resulted in an error. Removing the extra double quotes resolves the error, but it also leads to the name being converted to lowercase. can someone help me with this? Logs:
Copy code
2024-03-28T09:32:13.284781Z [info     ] 2024-03-28 09:32:13,284 | INFO     | root                 | tablename: "TableName_a3", shortname: A3 cmd_type=elb consumer=True name=mapper-companyspecifcmapper producer=True stdio=stderr string_id=mapper-companyspecifcmapper
2024-03-28T09:32:13.293916Z [info     ] time=2024-03-28 09:32:13 name=target_postgres level=INFO message=Table '""tablename_a3""' does not exist. Creating... CREATE TABLE IF NOT EXISTS schema1.""tablename_a3"" ("_sdc_batched_at" timestamp without time zone, "_sdc_deleted_at" character varying, "_sdc_extracted_at" timestamp without time zone, "id" bigint, PRIMARY KEY ("id")) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.301023Z [info     ] Traceback (most recent call last): cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.301288Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/bin/target-postgres", line 8, in <module> cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.301545Z [info     ]     sys.exit(main())           cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.301735Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/target_postgres/__init__.py", line 373, in main cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.301914Z [info     ]     persist_lines(config, singer_messages) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.302092Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/target_postgres/__init__.py", line 219, in persist_lines cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.302279Z [info     ]     stream_to_sync[stream].sync_table() cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.302451Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/target_postgres/db_sync.py", line 589, in sync_table cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.307815Z [info     ]     self.query(query)          cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.308244Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/target_postgres/db_sync.py", line 311, in query cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.308603Z [info     ]     cur.execute(               cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.308826Z [info     ]   File "/home/meltano/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/psycopg2/extras.py", line 146, in execute cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.309039Z [info     ]     return super().execute(query, vars) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.309251Z [info     ] psycopg2.errors.SyntaxError: zero-length delimited identifier at or near """" cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.309467Z [info     ] LINE 1: CREATE TABLE IF NOT EXISTS schema1.""tablename_a3""... cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.309692Z [info     ]                                             ^ cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.309902Z [info     ]                                cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2024-03-28T09:32:13.359303Z [error    ] Loader failed