Hi ALL - I am using meltano for EL process - I am ...
# troubleshooting
s
Hi ALL • I am using meltano for EL process • I am fetching data from mysql table and adding it to snowflake • I am facing an issue , I had one table which I had loaded in snowflake from mysql. • Now in mysql new columns are that able,due to this my EL process is failing. Please help me out! 🙏
a
It's the responsibility of the target to handle schema evolution. Sounds like the target does not do that. If you run meltano select tap-mysql and look at the output, it might be possible to deselect the new column. Alternatively you can manually dispatch the ddl to add the needed column. Lastly and most difficult, you could fork the target and add the capability.
s
Thank you for reply! Can you please share some docs for this so that I can refer them
a
https://docs.meltano.com/reference/command-line-interface.html#select Please see docs on select. Other 2 options were direct in snowflake (easy but not very scalable or automated) or in target-snowflake code so I have no docs to share but just to do your own research on what it would take.
s
Thank You! I will go through it.