Datafuse – Modern Real-Time Data Processing in Rust
1–10 of 15 posts
Re: Datafuse – Modern Real-Time Data Processing in Rust
#2Impressive and bold claims. I wish the team well. But I won’t tinker with it until it’s been jepsen tested and many core features on the roadmap have been finished.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#3Impressive and bold claims. I wish the team well. But I won’t tinker with it until it’s been jepsen tested and many core features on the roadmap have been finished.
I'll complete jepsen test ASAP:)
Re: Datafuse – Modern Real-Time Data Processing in Rust
#4Would be good to know the background of this project, team etc.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#5Would be good to know the background of this project, team etc.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#6Anyone can optimize a database for trivial queries. Would be nice to at least see TPCH results or any other more complex benchmark.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#7Would be good to know the background of this project, team etc.
Datafuse team mainly from the ClickHouse community, but more focused on the cloud database.
Datafuse Labs team: https://github.com/orgs/datafuselabs/people
Re: Datafuse – Modern Real-Time Data Processing in Rust
#8Would be good to know the background of this project, team etc.
Datafuse team mainly from the ClickHouse community, but more focused on the cloud database. Datafuse Labs team: https://github.com/orgs/datafuselabs/people
Suddenly things got a lot more interesting. The Clickhouse guys are really talented & have good taste.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#9Anyone can optimize a database for trivial queries. Would be nice to at least see TPCH results or any other more complex benchmark.
Sure, datafuse is still working in progress.
TPCH (mainly for JOIN) will be fully supported in Beta version.
Datafuse team are mainly working on the Alpha version.
Re: Datafuse – Modern Real-Time Data Processing in Rust
#10The problem with these queries is that they just aren't realistic in a production system. Over time the queries become more complex, include more edge-cases and cruft, and your main goal is that they complete with accuracy rather than if it was 5s or 50s.