61–70 of 84 posts
The DuckDB WASM space is really heating up! I released https://sql-workbench.com a few weeks ago, which can be used to query and visualize Parquet, CSV, JSON and Arrow data. There’s also a accompanying tutorial blog post at https://tobilg.com/using-duckdb-wasm-for-in-browser-data-eng...
Hey congrats on the Show HN. Local, browser based data exploration works for a lot of uses cases and is so much faster thancloud based tools. We've implemented something similar at https://addmaple.com/ - but with a graphical interface designed for rapid exploratory data analysis of large datasets. Memory per tab can be an issue for really big files (1gb+) but we're exploring a transform to CBOR which allows us to fr…
200mb of data is not a large file, and chromium tabs have a memory limit of something ridiculously low so actual large 20-100gb datasets render this useless.
Earlier quoted context omitted.
Right - I used to work in GS and they had this really great internal table display tool where you could simply drag a column from the top to the left side and it would Pivot + Collapse all fields on it (plus allow multi level pivots). Then, you could look at the Pivot table OR do a drill-down to see the root-cause why a value was so high. I really liked that interface and haven't really found anything near as useable…
Very impressive project and vision! Love the demo! I am also ex-GS and worked on what I am fairly sure is the table display tool you're describing. I tried to carry the essential aspects of that work (multi-level pivots, with drill-down to the leaf level, and all interactive events and analytics supported by db queries) to Tad ( https://www.tadviewer.com/ , https://github.com/antonycourtney/tad ), another open source…
Tad viewer looks perfect for embedding in Pretzel! Is it easy to embed it in web apps? I’m on mobile right now and did a quick search and didn’t find anything. I’ll definitely be in touch!
Looks great and thanks for sharing! You mentioned that you went to some length to implement pivots. How far do you think you will take the pivot feature and UI? For financial type usecases it's pretty much a requirement to be able to map many fields on X/Y, be able to collapse them in the the browser, and also show/control aggregations. Asking because many apps stop at the simplest level of pivot features and go to g…
Right - I used to work in GS and they had this really great internal table display tool where you could simply drag a column from the top to the left side and it would Pivot + Collapse all fields on it (plus allow multi level pivots). Then, you could look at the Pivot table OR do a drill-down to see the root-cause why a value was so high. I really liked that interface and haven't really found anything near as useable…
You can just do the data manipulations in DuckDB WASM and pipe the Arrow data to Perspective...
Can we bookmark or localstorage our etl?
We're going to build this over the next week - it's a high priority item for us. Once done, you should be able to do two things: - Save existing workdflows to localStorage (a little drawer on the left side of the screen) - Export workflows as a JSON file so you can share workflows with other by simply sending them the JSON file however you like
Earlier quoted context omitted.
Right - I used to work in GS and they had this really great internal table display tool where you could simply drag a column from the top to the left side and it would Pivot + Collapse all fields on it (plus allow multi level pivots). Then, you could look at the Pivot table OR do a drill-down to see the root-cause why a value was so high. I really liked that interface and haven't really found anything near as useable…
One that I'm watching is the Table mark in Graphic Walker [1]. There is a license thing about logos to note if you do use it in Pretzel [2]. On GW [1], Create Dataset -> Public Datasets -> Student Performance then change the Mark Type to Table you can play around. It hits the things that I mentioned pretty good! You might have similar issues as you have with Perspective though. I make calculang [3] and I'm getting re…
Earlier quoted context omitted.
Very impressive project and vision! Love the demo! I am also ex-GS and worked on what I am fairly sure is the table display tool you're describing. I tried to carry the essential aspects of that work (multi-level pivots, with drill-down to the leaf level, and all interactive events and analytics supported by db queries) to Tad ( https://www.tadviewer.com/ , https://github.com/antonycourtney/tad ), another open source…
Yes! I think it was TDS viewer or something like it - I loved using it so thank you for building it :) Tad viewer looks perfect for embedding in Pretzel! Is it easy to embed it in web apps? I’m on mobile right now and did a quick search and didn’t find anything. I’ll definitely be in touch!