Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

github.com

Post reply on HN
Print view View original

21–30 of 84 posts

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#21

Post by maxloh »

prasoonds wrote: post #9
DannyPage wrote: post #7

I was recently searching for something like this - the ability to write PRQL queries on mobile is my ideal usecase. As you note, PRQL is perfect for putting together queries with drop-downs, so I'm a huge fan of the UI that you've put together. Feature request: Exposing the PRQL would be great, and using tabs to switch between the query and results would make it possible to work on mobile. Lastly, bookmarking those q…

Yes! I'm heartened to see people realize the the benefits of PRQL and chained transforms over vanilla SQL (with some caveats!). We'll definitely add a PRQL/SQL block to the UI soon (you will be able to toggle to select which one you'd like). On that point - PRQL doesn't natively support PIVOT statements. As a hack, we made our own flavor of PRQL with a PIVOT statement and we parse that to SQL CTEs to make it work for…

It would be good to have EdgeQL too.

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#22

Post by thawab »

This is really promising, please look into embedded analytics. We are struggling with building our embedding for SAAS. Now we are doing it with cube and superset. All the alternatives are expensive or hard to implement.Being able to offload the analytics to the browser is a plus.

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#23

Post by mritchie712 »

thawab wrote: post #22

This is really promising, please look into embedded analytics. We are struggling with building our embedding for SAAS. Now we are doing it with cube and superset. All the alternatives are expensive or hard to implement.Being able to offload the analytics to the browser is a plus.

What database are you using?

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#24

Post by dndn1 »

Looks great and thanks for sharing!

You mentioned that you went to some length to implement pivots. How far do you think you will take the pivot feature and UI?

For financial type usecases it's pretty much a requirement to be able to map many fields on X/Y, be able to collapse them in the the browser, and also show/control aggregations.

Asking because many apps stop at the simplest level of pivot features and go to great lengths in other areas like more advanced visualization. For mapping many fields though, I think a good pivot table UI is like a secret weapon.

I get that this isn't what you would focus on so much in week 1.

Nice work + love the local-first and direct UI.

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#25

Post by prasoonds »

maxloh wrote: post #21
prasoonds wrote: post #9

Earlier quoted context omitted.

Yes! I'm heartened to see people realize the the benefits of PRQL and chained transforms over vanilla SQL (with some caveats!). We'll definitely add a PRQL/SQL block to the UI soon (you will be able to toggle to select which one you'd like). On that point - PRQL doesn't natively support PIVOT statements. As a hack, we made our own flavor of PRQL with a PIVOT statement and we parse that to SQL CTEs to make it work for…

It would be good to have EdgeQL too.

Oh this looks really interesting! I hadn't heard of EdgeDB/EdgeQL - I'll have to do a deeper read but at first brush, it looks like EdgeQL can be compiled down to SQL based on this HN comment: https://news.ycombinator.com/item?id=30296669

I'll take a look and if it's simply a matter of changing from the PRQL compiler to EdgeQL compiler, then, we should be able to have land in main in short order. It's not the highest priority thing right now though.

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#26

Post by tobilg »

The DuckDB WASM space is really heating up! I released https://sql-workbench.com a few weeks ago, which can be used to query and visualize Parquet, CSV, JSON and Arrow data.

There’s also a accompanying tutorial blog post at https://tobilg.com/using-duckdb-wasm-for-in-browser-data-eng...

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#28

Post by prasoonds »

antman wrote: post #20

Can we bookmark or localstorage our etl?

We're going to build this over the next week - it's a high priority item for us. Once done, you should be able to do two things: - Save existing workdflows to localStorage (a little drawer on the left side of the screen) - Export workflows as a JSON file so you can share workflows with other by simply sending them the JSON file however you like

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#29

Post by d1sxeyes »

prasoonds wrote: post #9
DannyPage wrote: post #7

I was recently searching for something like this - the ability to write PRQL queries on mobile is my ideal usecase. As you note, PRQL is perfect for putting together queries with drop-downs, so I'm a huge fan of the UI that you've put together. Feature request: Exposing the PRQL would be great, and using tabs to switch between the query and results would make it possible to work on mobile. Lastly, bookmarking those q…

Yes! I'm heartened to see people realize the the benefits of PRQL and chained transforms over vanilla SQL (with some caveats!). We'll definitely add a PRQL/SQL block to the UI soon (you will be able to toggle to select which one you'd like). On that point - PRQL doesn't natively support PIVOT statements. As a hack, we made our own flavor of PRQL with a PIVOT statement and we parse that to SQL CTEs to make it work for…

For folks looking for a workaround in the meantime, you can add an AI block and it will give you the returned SQL to edit.

Not ideal because it’s just wasting credits, but it worked for me.

Re: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL

#30

Post by thawab »

mritchie712 wrote: post #23
thawab wrote: post #22

This is really promising, please look into embedded analytics. We are struggling with building our embedding for SAAS. Now we are doing it with cube and superset. All the alternatives are expensive or hard to implement.Being able to offload the analytics to the browser is a plus.

What database are you using?

now we use postgres, testing duckdb/md for analytics.
Post reply on HN