Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

trymito.io

Post reply on HN
Print view View original

41–50 of 101 posts

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#41

Post by kite_and_code »

narush wrote: post #17

Hey everyone. Mito cofounder here. Thanks to whoever posted this - was a real surprise to find it here :-) Mito (pronounced my-toe) was born out of our personal experience with spreadsheets, and a previous (failed) spreadsheet version control product. Spreadsheets were the original killer app for computers, and are the most popular programming language used worldwide today. That being said, spreadsheets have some gro…

If you are a large company trying to migrate to Python, you might also want to have a look at bamboolib.com which was acquired by Databricks.

bamboolib is very similar to mito (hard to tell who was first).

The advantage is that it runs within Databricks which gives you the ability to scale to any amount of data easily and Databricks has many (and growing) security certifications e.g. HIPAA compliance.

bamboolib can be used in plain Jupyter. Also, bamboolib private preview within Databricks is about to start within the next days.

Full disclosure: I am a co-founder of bamboolib and employed by Databricks

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#42

Post by kite_and_code »

aarondia wrote: post #19
narush wrote: post #17

Hey everyone. Mito cofounder here. Thanks to whoever posted this - was a real surprise to find it here :-) Mito (pronounced my-toe) was born out of our personal experience with spreadsheets, and a previous (failed) spreadsheet version control product. Spreadsheets were the original killer app for computers, and are the most popular programming language used worldwide today. That being said, spreadsheets have some gro…

Heyo! Another co-founder here. Excited to see Mito on HN :) Thanks @alefnula for posting! +1 to everything @narush said. It's important to us that the software we build is empowering to users and not restrictive. This plays out in two primary ways: 1) Since Mito is open source and generates Python code for every edit, Mito doesn't lock users into a 'Mito ecosystem', instead it help users interact with the powerful &…

Can you please clarify what you mean by "mito is open-source"?

Last time I checked the code was under a proprietary license.

Edit: I found in another comment below that mito is now available under GPL license here: https://github.com/mito-ds/monorepo/blob/dev/LICENSE

Edit2: Just saw your answer now - thanks for the clarification and links!

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#43

Post by kite_and_code »

wenc wrote: post #33
santiagobasulto wrote: post #12

I like this. Is a "friendlier" way to browse data. Said that, I have to add: Exploring large datasets requires a COMPLETELY different mindset. When your data starts growing, it's impossible to keep it all in a visual format (for 2 reasons[0]) and you have to start thinking analytically. You have to start looking at the statistical values of your data to understand what's its shape. That's why the `.describe()` and `.…

I would caution against this approach in general (unless you’re working with unusually uniform data from a deterministic source — in my world that is rarely the case). Summary statistics are useful but taken in isolation they can mislead. One loses the ability to get a feel for interesting non-aggregated phenomenon. I find it’s important to actually “touch” the raw data even if only in a buffered, random sampling sor…

If you want to use open-source Python-based visualizations instead of Tableau, the following tools allow the creation of custom plots - including the ability to export the underlying code.

- bamboolib (proprietary license - acquired by Databricks in order to run within the Databricks notebooks)

- mito (GPL license)

- dtale (MIT license)

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#44

Post by flakiness »

Nice! The page looks more like a SaaS offering or something, which initially scared me away a bit. I hope the emphasis is more on the opensource library and showing paying options as some premium thing.

I didn't realize that the "too nice" landing page makes me anxious for open source software :-/

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#45

Post by aarondia »

pbronez wrote: post #35
aarondia wrote: post #24

Earlier quoted context omitted.

This is a great point and something that we're actively working on improving in Mito. If you have millions of rows of data, its not enough to just scroll through your data, you need tools to build your understanding. Some of the tools that you mentioned exist in Mito today. For example, Mito generates summary information about each column (all of the .describe() info along with a histogram of the data). And we're cre…

It would be super fun to implement an intelligent head() function that shows a representative sample rather than the first X rows. Do the profiling & identify a collection of rows that represent the overall distribution. You could develop some IP around efficient and effective ways to do this. Probably would require an ensemble of unsupervised methods.

That's a cool idea! One helpful .head() function could include the most unique data typed data. It could help you identify which columns have mixed dtypes: mostly numbers, and some cells that are supposed to be numbers but are actually strings because of additional decimals.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#46

Post by kite_and_code »

flakiness wrote: post #44

Nice! The page looks more like a SaaS offering or something, which initially scared me away a bit. I hope the emphasis is more on the opensource library and showing paying options as some premium thing. I didn't realize that the "too nice" landing page makes me anxious for open source software :-/

I am not so sure about the open-source fact. Please see comments and thread below.

Edit: It is GPL by now as seen here https://github.com/mito-ds/monorepo/blob/dev/LICENSE

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#47

Post by kite_and_code »

CJefferson wrote: post #32
santiagobasulto wrote: post #12

I like this. Is a "friendlier" way to browse data. Said that, I have to add: Exploring large datasets requires a COMPLETELY different mindset. When your data starts growing, it's impossible to keep it all in a visual format (for 2 reasons[0]) and you have to start thinking analytically. You have to start looking at the statistical values of your data to understand what's its shape. That's why the `.describe()` and `.…

I find the world is full of datasets with Also, even with huge datasets I tend to always look at a random sample, and the "most extreme" datapoints -- mainly because in my experience there is a good chance some parts of the data are malformed, and need to be recollected/fixed. Of course, if you trust your data collection you don't need this!

+1 - this is also how I operated as a Data Scientist myself

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#48

Post by filmor »

kite_and_code wrote: post #39

Another alternative is bamboolib.com which was acquired by Databricks last September to offer it within Databricks notebooks

Are you affiliated? There are three comments in this comment page by you, and they all manage to mention bamboolib...

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#49

Post by kite_and_code »

harabat wrote: post #18

For those who are going through the thread finding new tools: pandas-profiling[0] is a library for automatic EDA (which bamboolib[1], mentioned elsewhere, also does). [0]: https://github.com/pandas-profiling/pandas-profiling [1]: https://bamboolib.com/

Lux might also be interesting: https://github.com/lux-org/lux

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#50

Post by kite_and_code »

filmor wrote: post #48
kite_and_code wrote: post #39

Another alternative is bamboolib.com which was acquired by Databricks last September to offer it within Databricks notebooks

Are you affiliated? There are three comments in this comment page by you, and they all manage to mention bamboolib...

Yes, I am one of the co-founders of bamboolib and employed by Databricks.

I already added my disclosure to the following answer [0] in this thread but I was hesitant to add it to every answer.

Do you prefer if I explicitly add my affiliation in every comment that mentions bamboolib? If so, I will try to edit them (if the HN UI still allows me to - I observed that it stops allowing this after some time)

[0] https://news.ycombinator.com/item?id=31450910

Post reply on HN