DuckDB – An in-process SQL OLAP database management system • Hacker News Board

Re: DuckDB – An in-process SQL OLAP database management system

#101

Post by brunoqc » Mon, Feb 13, 2023, 4:37 PM UTC

wenc wrote: post #94

brunoqc wrote: post #61

Anyone both tried duckdb and clickhouse-local?

I use duckdb and looked into clickhouse-local. The dealbreaker for me was that clickhouse-local supported only a subset of SQL (that most people would probably be ok with, but not sufficient for a lot of complex analytics work). For instance, clickhouse doesn't support lead/lag functions natively (though it does propose workarounds). Here's clickhouse's SQL support: https://clickhouse.com/docs/en/sql-reference/ Compa…

> The dealbreaker for me was that clickhouse-local supported only a subset of SQL

Yeah, I think there was some advanced psql stuff that I wanted to do with duckdb but wasn't able, so I can imagine that with clickhouse-local it would be even worse. Not that duckdb isn't enough for me.

Now I need to make my mind about duckdb vs nushell. Both are greats. Well I can use both, maybe.

Thank you very much!

Re: DuckDB – An in-process SQL OLAP database management system

#102

Post by 89vision » Mon, Feb 13, 2023, 6:29 PM UTC

je42 wrote: post #88

jammycrisp wrote: post #81

Earlier quoted context omitted.

You might be interested in checking out Ibis ( https://ibis-project.org/ ). It provides a dataframe-like API, abstracting over many common execution engines (duckdb, postgres, bigquery, spark, ...). Ibis wrapping duckdb has pretty much replaced pandas as my tool of choice for local data analysis. All the performance of duckdb with all the ergonomics of a dataframe API. (disclaimer: I contribute to Ibis for work).

Interesting ! One newbie question, how does ibis differ from sqlalchemy ?

sql alchemy is an orm, where ibis looks to be a dataframe api that is sort of a dsl over sql. It doesn't try to map relational domains to an object oriented paradigm like sql alchemy does

Re: DuckDB – An in-process SQL OLAP database management system

#103

Post by krimpenrik » Mon, Feb 13, 2023, 7:13 PM UTC

antonycourtney wrote: post #97

krimpenrik wrote: post #47

Earlier quoted context omitted.

Recently tried the GUI tool for ducks, forgot what's it called, something like 'Tab' and was quite disappointed. I feel duckdb needs a good tool like sqliteviewer to really take off.

I think you're referring to Tad ( https://www.tadviewer.com ), which I developed. Tad isn't "the GUI tool for DuckDb"; it's a desktop app that provides a pivot table based viewer for tabular data files (CSV, Parquet, and DuckDb/SQLite database files). It uses DuckDb as its engine, but pre-dates DuckDb and was developed independently. It's listed in the DuckDb docs along with several others tools that work with or use…

Then I think I used it wrong, happens often. Thank you for your work. I was/am new to duckdb and since it was listed in the docs I assumed it was something like SQL viewer

Re: DuckDB – An in-process SQL OLAP database management system

#104

Post by intrasight » Tue, Feb 14, 2023, 11:01 AM UTC

slt2021 wrote: post #49

intrasight wrote: post #31

I see no MDX query support. How is this an OLAP database? Or do I misunderstand what it is?

MDX is microsoft proptech, OLAP is more generic term to define analytical processing (in contrast to transaction processing as in CRUD). OLAP cube is microsoft's take on OLAP using 90s technologies for tech stacks from 1990s (Windows Server + SQL Server + SSAS). DuckDB is a modern take on OLAP

Every OLAP database that I've used supports MDX

MDX == OLAP

SQL == relational