An update on Redis Streams development
antirez.com
An update on Redis Streams development
1–10 of 48 posts
Re: An update on Redis Streams development
#2Could someone ELI5 what's a redis stream ? I thought that pub/sub mecanisms were some kind of a stream already.
Re: An update on Redis Streams development
#3Could someone ELI5 what's a redis stream ? I thought that pub/sub mecanisms were some kind of a stream already.
Found the rationale for this:
https://github.com/redis/redis-rcp/blob/master/RCP11.md#rati...
Re: An update on Redis Streams development
#4Could someone ELI5 what's a redis stream ? I thought that pub/sub mecanisms were some kind of a stream already.
Redis streams will allow for direct modeling of time series data. For example,
redis-cli>XADD AAPL 1516899637000.0 open 221.25 high 222.1 low 220.90 close 221.50 volume 1121223234234
Re: An update on Redis Streams development
#5I wonder if this impacts the plan of releasing Disque as a plugin in Redis 4.2. I always thought that Disque could have a great impact in the field of job queues.
Re: An update on Redis Streams development
#6Could someone ELI5 what's a redis stream ? I thought that pub/sub mecanisms were some kind of a stream already.
Redis Pubsub is fire-and-forget, so if you aren't listening when a message is fired, you'll never receive it. Redis Streams store messages, so you can connect and read all the messages since you last checked. It's a similar model to Kafka.
Re: An update on Redis Streams development
#7Could someone ELI5 what's a redis stream ? I thought that pub/sub mecanisms were some kind of a stream already.
Redis Pubsub is fire-and-forget, so if you aren't listening when a message is fired, you'll never receive it. Redis Streams store messages, so you can connect and read all the messages since you last checked. It's a similar model to Kafka.
I've not been following Redis a lot, so this one is new to me. I read antirez's original Streams blog post[0] but it feels like it's missing some stuff--is it known out there how this interacts with Redis Sentinel or, separately, Redis Cluster?
Re: An update on Redis Streams development
#8Earlier quoted context omitted.
Redis Pubsub is fire-and-forget, so if you aren't listening when a message is fired, you'll never receive it. Redis Streams store messages, so you can connect and read all the messages since you last checked. It's a similar model to Kafka.
I've not been following Redis a lot, so this one is new to me. I read antirez's original Streams blog post[0] but it feels like it's missing some stuff--is it known out there how this interacts with Redis Sentinel or, separately, Redis Cluster? [0] - http://antirez.com/news/114
In the Redis sense, streams are just a new data structure (value type of a key), so there shouldn't be any special concerns with regards to Sentinel, partitioning and/or clustering in that sense.
Re: An update on Redis Streams development
#9Earlier quoted context omitted.
I've not been following Redis a lot, so this one is new to me. I read antirez's original Streams blog post[0] but it feels like it's missing some stuff--is it known out there how this interacts with Redis Sentinel or, separately, Redis Cluster? [0] - http://antirez.com/news/114
In the Redis sense, streams are just a new data structure (value type of a key), so there shouldn't be any special concerns with regards to Sentinel, partitioning and/or clustering in that sense.
That is my intuition, yeah, but that makes me pretty worried about hammering hot keys and the like with regards to Cluster.
I also don't mind running Kafka, though, so I may not be the target audience.
Re: An update on Redis Streams development
#10I wonder if this impacts the plan of releasing Disque as a plugin in Redis 4.2. I always thought that Disque could have a great impact in the field of job queues.
My feeling is that Redis itself is good enough for job queues so that there is not a huge pressure to improve it with Disque.
I actually implemented yet another job framework[0] for fun in Python with Redis and it was a pleasure. Lua, pub/sub and atomic operations really go a long way!