If I delete a column from the tap “select list”, i...
# plugins-general
m
If I delete a column from the tap “select list”, is there any way to have that drop propagate to the target. For example, if I remove:
Copy code
select:
    - table_name.last_name
from the tap. I want it to drop
users.last_name
from the target.
d
@matt_cooley Targets typically only create new columns and don't delete existing ones to prevent data loss, so you'll have to delete the column manually. If the column keeps being recreated in the target, you're likely experiencing https://gitlab.com/meltano/meltano/-/issues/2475, where the tap erroneously includes deselected properties in its
SCHEMA
messages anyway, with no way for the target to know that that column will never get a value and doesn't need to be created.
m
That totally makes sense! On a related note. Is there any way to namespace the target tables. By default they have the same name. For Example: • source table =
table_name
• target table =
src_table_name
d
That will become really easy to do once we have https://gitlab.com/meltano/meltano/-/issues/2299, but right now you'd need to write your own dbt models to perform the renames
m
got it. thanks!