Hi all,
Has anyone tried loading into a redis list...
# plugins-generalc
christoph
08/05/2022, 9:31 AMHi all,
Has anyone tried loading into a redis list from a meltano tap? I don't want to necessarily write a target for redis at the moment ... 😉 Could I make
redis-cli -x lpush mylistv
visch
08/05/2022, 12:59 PMYou could do that without writing the whole target!
But a target is pretty easy check out https://github.com/AutoIDM/target-apprise/blob/main/target_apprise/sinks.py#L20
😄
visch
08/05/2022, 12:59 PMSaaS target and things you don't need to mess with the target system much (like redis 😄 )
a
aaronsteers
08/05/2022, 6:07 PMAnother idea could be to use target-jsonl and have a post-process that loads the files to redis afterwards...
aaronsteers
08/05/2022, 6:08 PMThe direct stdout from the tap will be a stream of messages, and might be harder to consume directly.
c
christoph
08/05/2022, 10:48 PMAnother idea could be to use target-jsonl and have a post-process that loads the files to redis afterwards...Yeah. That's a pattern I'm already quite comfortable with and which works well for me. I was just wondering if I could avoid it in this particular case.
christoph
08/05/2022, 10:49 PMThe direct stdout from the tap will be a stream of messages, and might be harder to consume directly.That's what I was wondering about. Time to start tinkering a bit and see what happens 😄