Hi! Has anyone a successful pipeline to Azure Syna...
# random
b
Hi! Has anyone a successful pipeline to Azure Synapse Analytics? I'm triying to connect with target-mssql of @visch
c
I only use Synapse Dedicated SQL Pool (fka Azure SQL DW) as a tap, not a target. There are some issues with SQL DW (or PDW as it is called for when it used to be on-prem ... not that many people would have been able to afford it ...) when using the existing tap though. https://github.com/wintersrd/pipelinewise-tap-mssql/issues/28
v
the target wasn't really designed to make it work with every setup (it's not a great target honestly but it got the job done for me!). I'd look at https://github.com/AutoIDM/autoidm-target-mssql/blob/main/target_mssql/target.py#L21 And then I'd look here https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/connect-overview#odbc-connection-string-example to get the right conneciton string. Probably starting here https://learn.microsoft.com/en-us/sql/connect/python/pyodbc/step-3-proof-of-concept-connecting-to-sql-using-pyodbc?view=sql-server-ver16#connect to get connected, then mapping whatever works there to the target. Note that target doesn't support incremental loads it only does full table loads 😮