The new `BATCH` message type isn't compatible with...
# troubleshooting
j
The new
BATCH
message type isn't compatible with any random target is it? You need to have a BATCH-aware target to use it?
c
Yes. This topic of how various targets are going to behave when they receive a BATCH message was also just discussed during this weeks Office Hours. I suppose now that the BATCH feature is released in the SDK, we will found out soon what the general experience in the wild is going to be like.
This also closely relates to having SDK-based targets available in the future for the 4(?) major DWs (Snowflake, Redshift, Postgres and probably BigQuery)
j
indeed. we are currently using a fork of pipelinewise-target-bigquery but i think the batch feature would be very beneficial for our jobs which ingest data from csv files