Hi, do you have any advice to choose an reverse EL...
# best-practices
a
Hi, do you have any advice to choose an reverse ELT tool according to Meltano stack ? We are thinking to use grouparoo but the application stack seems to be large (webserver, redis, postgres, ...). We just want to get data from redshift to braze (marketing automation platform)
c
I think Meltano somewhat officially includes a "P" for Publish after ELT .... https://meltano.slack.com/archives/C01RKUVUG4S/p1638811320010000 The Redshift tap already exists. You would need to figure out what you would want to do for a "Braze" target.
a
Nice, so the idea is to use tap/target in the reverse order than EL task. But, currently I see anything in meltano docs about Publish, that's normal?
t
There’s nothing currently in the docs about Publishing / Reverse ETL / Operational Analytics / Data Activation per se. At it’s core it’s still data replication, just the targets can be wonkier because it’s usually some API. There are fewer SaaS targets currently out there, but the SDK has some basic features to help. and we have a few community members doing reverse etl with Meltano 🙂
v
@alexandre_brehelin
meltano run tap-toggl target-postgres dbt:run tap-postgres target-apprise
Is how I do it today,
target-apprise
would be your "publish" step I just think about it as a specialized target
a
Thanks Derek, it's very clear. Now, I have to developp a braze Target 🙂
v
The cookiecutter for a target on the sdk website is great, https://github.com/AutoIDM/target-apprise/blob/main/target_apprise/sinks.py if you want to steal some ideas, generally they're pretty easy. We have some work to do on resiliency like retrys warnings, etc but fairly easy to bake in yourself right now!