Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

apps.microsoft.com

Post reply on HN
Print view View original

21–29 of 29 posts

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#21

Post by olllo »

paddy_m wrote: post #11

Do you have a demo video? What are you using for processing (polars)? Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". As an implementation note, I would make it simple to operate on just the first 1000 (10k or 100k) rows so responses are super quick,…

Thanks for the thoughtful feedback!

Yes, Data.olllo uses including Polars under the hood for fast and efficient processing. A demo video is in the works and should be up soon.

Good point about the "P Core/V Core" naming—I'll simplify that to focus more on the user benefit, like scaling from small to large files smoothly.

I also like your idea of running transformations on a sample first with a one-click full run—very aligned with the vision. And subset reproduction for errors is a great suggestion, especially for things like deduping. Appreciate it!

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#22

Post by olllo »

marcellus23 wrote: post #19
paddy_m wrote: post #11

Do you have a demo video? What are you using for processing (polars)? Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". As an implementation note, I would make it simple to operate on just the first 1000 (10k or 100k) rows so responses are super quick,…

> Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". Speaking personally, "intelligent execution that scales from small files to large files" sounds like marketing buzz that could mean absolutely nothing. I like that it mentions specifically switching b…

Thanks for the thoughtful take—really appreciate both perspectives.

You're right that terms like "intelligent execution" can feel vague without concrete backing. My goal with mentioning P Core/V Core was to hint at the underlying design—switching between in-memory and disk-based engines like Polars and Vaex—without overwhelming with technical detail.

I’ll look for a better way to explain the idea clearly and briefly. Thanks again!

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#23

Post by olllo »

xnx wrote: post #3

Is this better than the free Tad ( https://www.tadviewer.com/ ) which seems to do similar things for free?

Tad is a great tool—very clean and useful for quick exploration.

Data.olllo is focused more on local data processing, not just viewing—things like filtering, transforming, merging, and even running Python code (with AI assistance coming). It’s built for both small and large files with performance in mind, using many cores including Polars under the hood.

Also, good news: the macOS version is in the works and will be submitted to the Mac App Store soon!

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#24

Post by olllo »

dangerlibrary wrote: post #6

It is 2025 and CSVs still dominate data interchange between organizations. https://graydon2.dreamwidth.org/193447.html

Absolutely—CSVs are still everywhere, especially for simple interchange between teams and tools. I designed Data.olllo with that in mind.

That said, I also plan to add support for Parquet and other formats soon—definitely agree it's gaining traction for larger, structured datasets.

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#25

Post by olllo »

geodel wrote: post #4
esafak wrote: post #2

[flagged]

I don't know if for Desktop App (most likely electron based) people expect any better.

Thanks for the feedback! Data.olllo isn't Electron-based—it's built in Python with tkinter and custom tkinter, so the size mainly comes from the data libraries and embedded Python environment. I agree that keeping things lean is important, and I’m actively working on optimizing the package size further.

Appreciate the DuckDB comparison—great tool and definitely a benchmark worth learning from!

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#27

Post by paddy_m »

olllo wrote: post #21
paddy_m wrote: post #11

Do you have a demo video? What are you using for processing (polars)? Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". As an implementation note, I would make it simple to operate on just the first 1000 (10k or 100k) rows so responses are super quick,…

Thanks for the thoughtful feedback! Yes, Data.olllo uses including Polars under the hood for fast and efficient processing. A demo video is in the works and should be up soon. Good point about the "P Core/V Core" naming—I'll simplify that to focus more on the user benefit, like scaling from small to large files smoothly. I also like your idea of running transformations on a sample first with a one-click full run—very…

Feel free to get in touch. We are building similar tools

Re: Show HN: CSV GB+ by Data.olllo – Open and Process CSVs Locally

#28

Post by gopher_space »

marcellus23 wrote: post #19
paddy_m wrote: post #11

Do you have a demo video? What are you using for processing (polars)? Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". As an implementation note, I would make it simple to operate on just the first 1000 (10k or 100k) rows so responses are super quick,…

> Marketing note: I'm sure you're proud of P Core/V Core, but that doesn't matter to your users, it's an implementation detail. At a maximum I'd write "intelligent execution that scales from small files to large files". Speaking personally, "intelligent execution that scales from small files to large files" sounds like marketing buzz that could mean absolutely nothing. I like that it mentions specifically switching b…

I wish every product had an engineer-only landing page I could set as a default in my browser. The number of companies that assume I'm familiar with their offering is astounding, and I'm usually looking for implementation docs just to figure out what it actually does.

I'm not saying we need a morlock/eloi toggle.

Post reply on HN