Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

trymito.io

Post reply on HN
Print view View original

81–90 of 101 posts

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#81

Post by aarondia »

santiagobasulto wrote: post #15
mint2 wrote: post #14

Earlier quoted context omitted.

Do you as a rule look at a sample of the individual raw data, non aggregated?

Usually aggregated... then can start looking at "subsets". For example, step 1 is look at the whole dataset. Then you identify that there are a lot of rows with a type of missing value, so you look at the statistical attributes of that subset (all the rows with value X in null). From time to time you can do a `.head()/.title()` or an `.iloc[X:Y]` to check some things visually. But just as a "refresher".

This sort of bouncing back and forth between the aggregate the raw data is something that Mito is really great at. To view aggregate info, users tend to either look at graphs or pivot tables of their data in Mito. They use that aggregate view to identify subsets that need some further investigation/cleaning/transforming. And then they filter down to that subset, make the correction, and use the aggregate view again to see the results.

Practically, this just looks like moving between two tabs in the spreadsheet!

Something that we don't support right now, but would love to support in the future is cross-filtering. It would be a powerful/easy way of supporting that back and forth workflow.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#82

Post by Closi »

kite_and_code wrote: post #50
filmor wrote: post #48

Earlier quoted context omitted.

Are you affiliated? There are three comments in this comment page by you, and they all manage to mention bamboolib...

Yes, I am one of the co-founders of bamboolib and employed by Databricks. I already added my disclosure to the following answer [0] in this thread but I was hesitant to add it to every answer. Do you prefer if I explicitly add my affiliation in every comment that mentions bamboolib? If so, I will try to edit them (if the HN UI still allows me to - I observed that it stops allowing this after some time) [0] https://ne…

> Do you prefer if I explicitly add my affiliation in every comment that mentions bamboolib?

Personally I thought your original post's tone implied that you weren't affiliated to me personally.

You don't have to add a formal 'disclosure', but you could just say "I built x which is..." rather than "Another product is x which is...".

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#83

Post by narush »

learndeeply wrote: post #77
aarondia wrote: post #20

Earlier quoted context omitted.

Thanks for that feedback. Mito's approach to telemetry is that we never log any of your data or metadata about your data. We don't track things like the size, shape, or content of your data. We do collect info about app usage, things like which buttons users click. This allows us to focus development time on improving the features that are used most often. That being said, it's important to us that there is a way to…

I don't get it. What in the license prevents users from removing the telemetry? AGPL just means the user needs to open source that change, right? Edit: To remove telemetry, just call: from mitoinstaller.user_install import go_pro; go_pro(); No licensing or payment required, and doesn't violate the license.

Mito is open source, but using Pro features does actually require a Pro or enterprise license. You can check out this callout in the license [1], as well as the restrictions on Mito Pro features here [2]. We're in the process of fixing up the upgrade to Pro process a bit... as you can tell... :)

You can of course fork Mito and turn off telemetry as long as you open source your changes! Go for it - happy to hop on a call and help you get set up with the codebase, if you want. Yay open source!

[1] https://github.com/mito-ds/monorepo/blob/974091b455950c6c50e... [2] https://github.com/mito-ds/monorepo/blob/dev/mitosheet/mitos...

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#84

Post by santiagobasulto »

wenc wrote: post #75
santiagobasulto wrote: post #37

Earlier quoted context omitted.

Of course that `.head()`, `.tail()`, `iloc` and other mechanisms to visualize the data of subsets is always important. But would you really caution AGAINST this? Like, literally telling someone NOT to use summary statistics to explore a dataset?

No, I’m more cautioning against using summary statistics in isolation without looking at the raw data. I was more responding to the statement that one can “see” the shape of data through them and not needing visual tools. The lens of summary statistics is a very narrow one — it’s a necessary but almost always insufficient one. Even .ilocs are insufficient —- it’s hard to know what to .iloc for. One really needs to br…

Ah, ok. Sorry, I misunderstood. Yes, we’re on the same page. As usual, a good balance is necessary.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#85

Post by teruakohatu »

aarondia wrote: post #51
kite_and_code wrote: post #42

Earlier quoted context omitted.

Can you please clarify what you mean by "mito is open-source"? Last time I checked the code was under a proprietary license. Edit: I found in another comment below that mito is now available under GPL license here: https://github.com/mito-ds/monorepo/blob/dev/LICENSE Edit2: Just saw your answer now - thanks for the clarification and links!

Mito is licensed [1] under the AGPL liscence. The TLDR of the license is that you can use, distribute, and modify Mito for free, but any modifications that you make need to be shared back with the Mito community. There is an additional version of Mito, Mito Pro, that is licensed under a different license that provides access to advanced functionality only if you are paying for a Mito Pro / Enterprise subscription. [1…

Does AGPL mean it can only be used in a notebook for which the notebook itself is open source?

Or does it mean it can only be used with notebook software (eg. Jupyter) that is open source but in a closed source notebook?

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#86

Post by teruakohatu »

narush wrote: post #83
learndeeply wrote: post #77

Earlier quoted context omitted.

I don't get it. What in the license prevents users from removing the telemetry? AGPL just means the user needs to open source that change, right? Edit: To remove telemetry, just call: from mitoinstaller.user_install import go_pro; go_pro(); No licensing or payment required, and doesn't violate the license.

Mito is open source, but using Pro features does actually require a Pro or enterprise license. You can check out this callout in the license [1], as well as the restrictions on Mito Pro features here [2]. We're in the process of fixing up the upgrade to Pro process a bit... as you can tell... :) You can of course fork Mito and turn off telemetry as long as you open source your changes! Go for it - happy to hop on a c…

You should consider using something other than pip to distribute an installer for the Pro version.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#87

Post by nojito »

NoImmatureAdHom wrote: post #79
kite_and_code wrote: post #63

Earlier quoted context omitted.

bamboolib co-founder here: It's correct that bamboolib is (still) closed-source (which might be subject to change but I don't make promises). It's also correct that customers can extend the bamboolib UI in various ways via plugins that they can author themselves. That empowers them to build bamboolib into the kind of tool that they want. Also, all the code is always exported and thus, there is at least no "code locki…

I'm sure you have good intentions, but the fact of the matter is the company may be acquired or the people replaced, and those intentions might change. IMHO investing in a closed-source product like bamboolib as a tool for an important business function is very risky. Imagine you're a small company, and you start using bamboolib for some part of your data analysis pipeline. Bamboolib gets acquired (you have exited ki…

Excel is closed source and it powers the world.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#88

Post by wanderingmind »

nojito wrote: post #87
NoImmatureAdHom wrote: post #79

Earlier quoted context omitted.

I'm sure you have good intentions, but the fact of the matter is the company may be acquired or the people replaced, and those intentions might change. IMHO investing in a closed-source product like bamboolib as a tool for an important business function is very risky. Imagine you're a small company, and you start using bamboolib for some part of your data analysis pipeline. Bamboolib gets acquired (you have exited ki…

Excel is closed source and it powers the world.

If MS shuts down, there are better FOSS tools that can process excel files (Librecalc), or in general the entire office ecosystem. Can't say the same for small startups.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#89

Post by mbreese »

narush wrote: post #67
kite_and_code wrote: post #62

To the founders of mito, regarding the mito GPL license: What is your take on that regarding usage inside cloud provider's notebooks like AWS, GCP, Azure, Databricks? Is it allowed or not allowed by the license? And who should/can control the usage since users can install any kind of Python library in those environments. And, separately from the maybe ambiguous legal answer: What is your personal intention with the l…

Hiya kite_and_code - thanks for the question + good to see you here :) Our understanding of our license is evolving - we're first time open source devs, and as I'm sure you know it can be a tricky process. That being said: we totally support Mito users using Mito from notebooks hosted in the cloud! Currently, we have quite a few users using Mito in notebooks hosted through AWS, GCP, etc. We’re aiming to be good stewa…

> Our understanding of our license is evolving

As a potential user, this is pretty troubling. I can understand your intentions, but if the license doesn’t match your intentions (and if you don’t completely understand the license), how can we be sure our workflows will be supported/possible in the future?

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#90

Post by imcoconut »

narush wrote: post #83
learndeeply wrote: post #77

Earlier quoted context omitted.

I don't get it. What in the license prevents users from removing the telemetry? AGPL just means the user needs to open source that change, right? Edit: To remove telemetry, just call: from mitoinstaller.user_install import go_pro; go_pro(); No licensing or payment required, and doesn't violate the license.

Mito is open source, but using Pro features does actually require a Pro or enterprise license. You can check out this callout in the license [1], as well as the restrictions on Mito Pro features here [2]. We're in the process of fixing up the upgrade to Pro process a bit... as you can tell... :) You can of course fork Mito and turn off telemetry as long as you open source your changes! Go for it - happy to hop on a c…

Mito looks awesome.

Just want to say that I respect the fact that you built this library, are offering it open source, for free, and want the telemetry on. You are up front and open about it.

Sometimes I think people can get a little entitled with all the work someone else puts in to a project they want to use (not accusing GP of this, speaking generally). As you said, under the license anyone is more than welcome to fork, modify and open source. Yay open source indeed :)

Post reply on HN