Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

trymito.io

Post reply on HN
Print view View original

71–80 of 101 posts

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#71

Post by narush »

kite_and_code wrote: post #68
narush wrote: post #67

Earlier quoted context omitted.

Hiya kite_and_code - thanks for the question + good to see you here :) Our understanding of our license is evolving - we're first time open source devs, and as I'm sure you know it can be a tricky process. That being said: we totally support Mito users using Mito from notebooks hosted in the cloud! Currently, we have quite a few users using Mito in notebooks hosted through AWS, GCP, etc. We’re aiming to be good stewa…

I can totally relate that finding a suitable open-source business model is a fuzzy journey. Nevertheless, from the user perspective I would love to hear a more clear answer - at least for e.g. the next 6-12 months. Currently, it seems like you are tolerating usage inside the cloud providers without taking a clear stance. I think this creates fear, uncertainty, doubt and slows down mito adoption within the cloud. I wo…

Oh, sorry I wasn't clear! We totally expect that users will use Mito in notebooks on the cloud cloud, and we are in support of this usage!

Ideally, we will continue to extend our support to these environments over time, as currently there are lots of environments where users want Mito but we don't support it yet (notebooks api differences, etc) - a good example being AWS Sagemaker.

I'll edit my answer above to be more clear about this as well. Thanks for the ask for clarification!

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#72

Post by narush »

punk_ihaq wrote: post #69

Wow love it! It would be cool to see a bidirectional Streamlit custom component for Mito!

This is on the roadmap! Would love to hear a bit more about how you would use this component...

1. Would you want the component to generate code? Or would it just be the editing of a dataframe that is useful to you?

2. What other components would be used in this dashboard? Would love to hear a bit more about the workflow around Mito here.

The more detail you can provide - the more helpful in prioritizing this! I think Mito in streamlit would be ... awesome!

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#73

Post by aarondia »

pea wrote: post #61
kite_and_code wrote: post #43

Earlier quoted context omitted.

If you want to use open-source Python-based visualizations instead of Tableau, the following tools allow the creation of custom plots - including the ability to export the underlying code. - bamboolib (proprietary license - acquired by Databricks in order to run within the Databricks notebooks) - mito (GPL license) - dtale (MIT license)

If you can write visualisations in Python itself, I am a big fan of Altair's syntax ( https://github.com/altair-viz/altair ), which is based on vega-lite. A while back, I wrote a brief guide and comparison of the main plotting libraries: https://datapane.com/reports/87NNEJ7/the-ultimate-guide-to-p... One benefit of having them in actual code is that you can programmatically automate the creation of things like dashbo…

> programmatically automate the creation of things like dashboards and reports.

That's an awesome use case for Python, and that sort of script generation is one of the main reasons that we see people adopting Python/Mito. And specifically, graphing[1] is one of the most popular features in Mito.

Mito generates Plotly [2] graphs, and of course generates the Plotly graph code too, so you can customize the graphs to your perfect liking (Plotly has great documentation and a lot of customizations) or schedule the script to run automatically.

[1] https://docs.trymito.io/how-to/graphing [2] https://plotly.com/

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#74

Post by narush »

pipeline_peak wrote: post #56

The web page needs to be heavier

Super fair, lol. We'll work on optimizing it - just a tiny team and lots of things on our plate rn. The main issue is our images / video, which I have tried compressing but can't do so while maintaining the quality. Any tips are greatly appreciated!

Believe it or not, the last version of this website was even heavier...

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#75

Post by wenc »

santiagobasulto wrote: post #37
wenc wrote: post #33

Earlier quoted context omitted.

I would caution against this approach in general (unless you’re working with unusually uniform data from a deterministic source — in my world that is rarely the case). Summary statistics are useful but taken in isolation they can mislead. One loses the ability to get a feel for interesting non-aggregated phenomenon. I find it’s important to actually “touch” the raw data even if only in a buffered, random sampling sor…

Of course that `.head()`, `.tail()`, `iloc` and other mechanisms to visualize the data of subsets is always important. But would you really caution AGAINST this? Like, literally telling someone NOT to use summary statistics to explore a dataset?

No, I’m more cautioning against using summary statistics in isolation without looking at the raw data.

I was more responding to the statement that one can “see” the shape of data through them and not needing visual tools. The lens of summary statistics is a very narrow one — it’s a necessary but almost always insufficient one. Even .ilocs are insufficient —- it’s hard to know what to .iloc for. One really needs to browse the data interactively to get a good sense of it.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#76

Post by narush »

kite_and_code wrote: post #52
aarondia wrote: post #29

Earlier quoted context omitted.

One of the creators of Mito, here. Thanks for your feedback. I wanted to share a couple of nuggets about Mito that have been helpful in talking about this with other users. 1. The core Mito product is open source. You can see our GitHub here [1]. We also have a pro version that has some additional, code visible, but non-open source features. The way that we think about which features belong in which version of the pr…

I love how mito enables companies to use the power of open-source! You might want to think about enabling companies to create the company specific extensions themselves e.g. via a plugin API. You might still request them to pay for this version of Mito but they are enabled to extend it with their engineering power instead of relying on you. We had good experiences with this at bamboolib (I am one of the co-founders)…

Yeah, we've thought a bit about a plugin API - for the reasons you say, I think it would be an awesome feature to open up to teams!

Any tips on going about it? No need to share the secret sauce, unless you want :P

To be totally honest, we're not architected super well to support plugins currently. The big challenge would be allowing users to specify this plugin in pure Python (seems like we want this) - but we think that hand-coded UIs outperform autogenerated ones for now. We've been thinking about how to do better though... maybe soon.

Of course, if Mito is missing features, we're open source [1] -- all contributions are welcome! Also feel free to open an issue and we can discuss :)

[1] https://github.com/mito-ds/monorepo

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#77

Post by learndeeply »

aarondia wrote: post #20
rcarmo wrote: post #8

The telemetry thing is... weird. So we can use it for free but have no way to turn it off but upgrade to paid?

Thanks for that feedback. Mito's approach to telemetry is that we never log any of your data or metadata about your data. We don't track things like the size, shape, or content of your data. We do collect info about app usage, things like which buttons users click. This allows us to focus development time on improving the features that are used most often. That being said, it's important to us that there is a way to…

I don't get it. What in the license prevents users from removing the telemetry? AGPL just means the user needs to open source that change, right?

Edit: To remove telemetry, just call:

   from mitoinstaller.user_install import go_pro; go_pro();
No licensing or payment required, and doesn't violate the license.

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#78

Post by narush »

santiagobasulto wrote: post #12

I like this. Is a "friendlier" way to browse data. Said that, I have to add: Exploring large datasets requires a COMPLETELY different mindset. When your data starts growing, it's impossible to keep it all in a visual format (for 2 reasons[0]) and you have to start thinking analytically. You have to start looking at the statistical values of your data to understand what's its shape. That's why the `.describe()` and `.…

Good points! I also think that this is an area that Mito could do better in. While we do provide pretty cool summary stats [1] and graphing capabilities [2], there isn't a great view for the summary stats of the entire dataframe. It's def on the roadmap -- but this comment makes me think we should move on it quick.

Thanks for the feedback!

[1] https://docs.trymito.io/how-to/summary-statistics

[2] https://docs.trymito.io/how-to/graphing

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#79

Post by NoImmatureAdHom »

kite_and_code wrote: post #63
NoImmatureAdHom wrote: post #53

Earlier quoted context omitted.

bamboolib appears to be closed-source. You're at their mercy.

bamboolib co-founder here: It's correct that bamboolib is (still) closed-source (which might be subject to change but I don't make promises). It's also correct that customers can extend the bamboolib UI in various ways via plugins that they can author themselves. That empowers them to build bamboolib into the kind of tool that they want. Also, all the code is always exported and thus, there is at least no "code locki…

I'm sure you have good intentions, but the fact of the matter is the company may be acquired or the people replaced, and those intentions might change.

IMHO investing in a closed-source product like bamboolib as a tool for an important business function is very risky. Imagine you're a small company, and you start using bamboolib for some part of your data analysis pipeline. Bamboolib gets acquired (you have exited kite_and_code, congratulations), and the now very large company that controls it decides to stop supporting some feature critical to what you're doing, make an addition that messes everything up, go full-on SaaS somehow, or just shut the product down. What now? You've been growing, so you've got a small team of junior non-experts who were getting the hang of it...switching will be painful (or you could lock yourself in that walled garden and pay the SaaS price...).

Re: Mito – Excel-like interface for Pandas dataframes in Jupyter notebook

#80

Post by aarondia »

ryzvonusef wrote: post #7

https://www.youtube.com/watch?v=T7YkWuTIlTw video of it in use.

Thanks for sharing. There's a few other YouTubers who have made some cool videos about Mito -- The Data Professor [1] and Talk Python to Me [2]

And some cool Medium posts too! Mitosheet: enabling collaboration [3], Mito: One of the Coolest Python Libraries You Have Ever Seen [4] Preparing a dataset for analysis [5]

[1] https://www.youtube.com/watch?v=l2nBO_LkkcQ [2] https://www.youtube.com/watch?v=XAGmSPZsYLU [3] https://medium.com/trymito/mitosheet-empowering-collaboratio... [4] https://towardsdatascience.com/mito-one-of-the-coolest-pytho... [5] https://medium.com/@twelsh37/preparing-a-dataset-for-analysi...

Post reply on HN