sorry one more question - why is my tap-spreadsheets-anywhere or target-postgres suddenly appending a date to one of my column names? Not seeing a configuration setting to turn that on or off in either config.

2022-04-28T21:50:10.418709Z [info     ] time=2022-04-28 17:50:10 name=target_postgres level=INFO message=Versioning column: ALTER TABLE ledger."accounts" RENAME COLUMN "acct_number" TO "acct_number_20220428_1750" cmd_type=loader job_id=2022-04-28T215005--tap-spreadsheets-anywhere--target-postgres name=target-postgres run_id=397cf961-3ad8-47bb-8697-4be20f0f5ec3 stdio=stderr

that one may be because target-postgres detected a data type change

Interesting - it is a number but it's set as a varchar because it's really an account number with no math on it. Is there a way to override?

At least in the pipelinewise variant I don't think there is. I assume the tap auto detects the data type and that's how it drifted at this point. I think there's a way to feed the data types to the tap instead of letting it infer them with

schema_overrides

Hi @edgar_ramirez_mondragon - thanks for the suggestion, I think you are right. I am using a test sample of 7 lines and when I converted them all to words it did not do this change anymore. I wish the target would infer the acct_numbers as text since I set the columns in the database to be varchars. Maybe real data engineers and dbas need this but I would never want a column changed for any reason without me explicitly telling it. Thanks for the tip!!