Live data from Hacker News

To Be Continuous

pipelinedb.com

11–20 of 54 posts

Re: To Be Continuous

#11
Do Continuous Views work with table-table joins, or must there always be at least one stream present? The documentation[1] doesn't specify.

If so, this could be an interesting alternative to RethinkDB's changefeeds, as RethinkDB doesn't support joins on the change stream.

[1] http://docs.pipelinedb.com/joins.html

Re: To Be Continuous

#13
post #11

Do Continuous Views work with table-table joins, or must there always be at least one stream present? The documentation[1] doesn't specify. If so, this could be an interesting alternative to RethinkDB's changefeeds, as RethinkDB doesn't support joins on the change stream. [1] http://docs.pipelinedb.com/joins.html

Founder @ RethinkDB here.

Our next release (2.1) is due in about three weeks and includes automatic failover/high availability. Feeds on table joins (and other greatly expanded feed functionality) will be in 2.2, which should happen ~6-8 weeks after 2.1.

(Sorry to jump in with a shameless plug; what PipelineDB is doing is super-cool; I also met the founders a few times, and they're awesome, smart, and very driven people -- I'm really excited about what PipelineDB has to offer!)

Re: To Be Continuous

#15
It looks like PipelineDB is implemented as a fork of PostgreSQL. I would be interested to understand what is different about the architecture of PipelineDB that it couldn't be integrated into upstream PostgreSQL.

Re: To Be Continuous

#16
post #11

Do Continuous Views work with table-table joins, or must there always be at least one stream present? The documentation[1] doesn't specify. If so, this could be an interesting alternative to RethinkDB's changefeeds, as RethinkDB doesn't support joins on the change stream. [1] http://docs.pipelinedb.com/joins.html

Founder @ PipelineDB here (hi Slava!)

Currently continuous views must read from a stream. However, in the very near future it will possible to write to streams from triggers, which would probably give you enough flexibility to model the behavior you want if you could conceptualize a table as a stream of changes.

Re: To Be Continuous

#17
This is awesome, thanks for making it open source!

Would it be possible to set triggers or something on the continuous views? Lets say I want to take action (immediately) when a value calculated over sliding window goes above a limit.

It's a bit late here but I'll definitely play with PipelineDB tomorrow.

Re: To Be Continuous

#18

It looks like PipelineDB is implemented as a fork of PostgreSQL. I would be interested to understand what is different about the architecture of PipelineDB that it couldn't be integrated into upstream PostgreSQL.

It's not so much as how different it is from an architectural standpoint as it is about the sheer magnitude of such a feature. All open-source communities have processes which help maintain high quality, but also add a bit of red tape. I don't think we'd be able to operate at the pace we want if we were pushing every change upstream.

However, we love Postgres and plan on actively merging upstream releases!

Re: To Be Continuous

#19

This is awesome, thanks for making it open source! Would it be possible to set triggers or something on the continuous views? Lets say I want to take action (immediately) when a value calculated over sliding window goes above a limit. It's a bit late here but I'll definitely play with PipelineDB tomorrow.

Not right now, but it's definitely a feature we're thinking about.

Awesome--let us know what you think about it!

Re: To Be Continuous

#20
How does the PipelineDB differ or build on the ideas from Aurora/Borealis/StreamBase? At least at a high level, something like LiveView[1] seems to provide similar functionality to PipelineDB's concept of a Continuous View.

I was under the impression that the academic projects had proposed StreamSQL as a general language, though since StreamBase's acquisition it now seems to have been branded as TIBCO StreamSQL[2]. Have you guys been part of any efforts to make sure that there is an open language standard?

[1] http://streambase.typepad.com/streambase_stream_process/2013...

[2] http://www.streambase.com/developers/docs/latest/streamsql/

Post reply on HN