Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why Jupyter is data scientists’ computational notebook of choice

nature.com

Post reply on HN
Print view View original

141–150 of 308 posts

Re: Why Jupyter is data scientists’ computational notebook of choice

#141

Post by analog31 »

makmanalp wrote: post #51

The majority of the complaints I hear about notebooks I think come from a misunderstanding of what they're supposed to be. It's a mashup between a scientific paper and a repl. So it's useful for a bit of both: a) Just like with a paper, you can present scientific or mathematical ideas with accompanying visualizations or simulations. From the REPL side, as a bonus, you get interactivity, and the reader can pause and e…

I work in development of scientific equipment. Jupyter is my lab notebook. I think that to make good use of Jupyter for this purpose, you have to be a good programmer and a good scientist. No tool will turn us into these things against our will.

With that said, Jupyter has greatly improved my ability to find my own mistakes, and to reproduce my own results later on.

Re: Why Jupyter is data scientists’ computational notebook of choice

#142

Post by rrmm »

gnulinux wrote: post #80
zimablue wrote: post #22

I kind of find Jupyter an indictment of other coding tools really, it's 2018 and they're normally kind of weak or kind of unprogrammable. Feel like we're waiting for someone to really reinvent Emacs, preferably using web tech. Most editors can't open a terminal that you can use VIM keybindings on to search/navigate history and treate like any other buffer. VSCode -> not currently possible because they wrote it in a r…

I use Jupyter in emacs: ein-mode. The whole concept of programming in a browser sounds bizarre to me. I have a tool that's designed for programming (emacs) and a tool that's designed for streaming cat videos (firefox) and I use the latter for programming? Thanks but no thanks. Ime emacs works pretty perfect with jupyter too, there is no need to use firefox for something it's not designed to do for my full-time job.

I think web browsers just end up being a convenient place to start a user interface that targets a bunch of different platforms. I am 100% on the emacs bandwagon myself, but it's hard to ignore the ubiquity of a browser.

Re: Why Jupyter is data scientists’ computational notebook of choice

#144

Post by rrmm »

jonnycomputer wrote: post #95
ralmidani wrote: post #92

Out of curiosity, what other options are there?

for python, org-mode in emacs will do it. but that ties you down to emacs.

The dreaded emacs lock-in: before you know it, you're browsing the web and editing your photos in emacs.

Re: Why Jupyter is data scientists’ computational notebook of choice

#145

Post by dangirsh »

I've found ob-ipython [1] within Org Mode to be one of the best options for interfacing with Jupyter. If you're sick of the limitations of working in a browser, it's worth checking out.

Scimax version: https://github.com/jkitchin/scimax/blob/master/scimax-ipytho...

Video of Scimax version: https://www.youtube.com/watch?v=dMira3QsUdg

Previous HN discussion highlighting key features: https://news.ycombinator.com/item?id=17839926

Some relevant blog posts:

- https://vxlabs.com/2017/11/24/getting-ob-ipython-to-show-doc...

- https://vxlabs.com/2017/11/30/run-code-on-remote-ipython-ker...

- https://kozikow.com/2016/05/21/very-powerful-data-analysis-e...

[1] https://github.com/gregsexton/ob-ipython

Re: Why Jupyter is data scientists’ computational notebook of choice

#146

Post by kprybol »

solomatov wrote: post #118
amirathi wrote: post #65

Version control for Jupyter notebooks was one of the biggest complaint I had. Specifically, diff and merge with the JSON files (.ipynb) is ugly. I built ReviewNb[1] to solve one of those problems (diff). Note that, there is nbdime[2] which works well for local diff/merge. The idea for ReviewNb is to have much tighter integration with GitHub etc. [1] https://reviewnb.com [2] https://nbdime.readthedocs.io/en/latest/

If you are interested in workbooks which are collaborative and versioned, take a look at http://datalore.io/ Version control is transparent and integrated and it's possible to work with workbooks collaboratively.

Any chance of this being offered for on-prem install in the future? Looks interesting but cloud only makes it a no go for my team.

Re: Why Jupyter is data scientists’ computational notebook of choice

#147

Post by reilly3000 »

SiempreViernes wrote: post #133
reilly3000 wrote: post #127

Does anybody know of a good hosted solution of JupyterHub? I made a neat notebook that I needed to share with my non-technical team, it was using iPyWidgets to do some interactive modeling, but they each needed to be able to use it independently. It has private data so I couldn't use Binder. I've been following Zepl.com for a long time, but couldn't use them here because Zepplin doesn't support iPyWidgets. Pretty soo…

Do you have some server to host it on? If so, I’d run the notebook on the remote server and just teach them whatever command they need to make a ssh tunnel there. Something like what is described here: https://techtalktone.wordpress.com/2017/03/28/running-jupyte... So they would utter the unknowable incantation and then point their browser at localhost:8000 or whatever and then use their version of the notebook.

I think that would be within reason for most of our users, but we have a couple of Windows users. I'm not particularly keen on telling them to install putty or WSL.

Re: Why Jupyter is data scientists’ computational notebook of choice

#148

Post by reilly3000 »

hogu wrote: post #137
reilly3000 wrote: post #127

Does anybody know of a good hosted solution of JupyterHub? I made a neat notebook that I needed to share with my non-technical team, it was using iPyWidgets to do some interactive modeling, but they each needed to be able to use it independently. It has private data so I couldn't use Binder. I've been following Zepl.com for a long time, but couldn't use them here because Zepplin doesn't support iPyWidgets. Pretty soo…

I'm literally building this right now to fulfill this need. If you shoot me an email to hugo@opensourceanswers.com, I can let you know when it's ready. My plan is to charge a premium (similar to github prices) per user, and pass on compute costs directly to the customer with no markup

Contacted. I think that is a great business model.

Re: Why Jupyter is data scientists’ computational notebook of choice

#150

Post by autokad »

amirathi wrote: post #65

Version control for Jupyter notebooks was one of the biggest complaint I had. Specifically, diff and merge with the JSON files (.ipynb) is ugly. I built ReviewNb[1] to solve one of those problems (diff). Note that, there is nbdime[2] which works well for local diff/merge. The idea for ReviewNb is to have much tighter integration with GitHub etc. [1] https://reviewnb.com [2] https://nbdime.readthedocs.io/en/latest/

I'm a huge fan of databricks, its got github sync built into it
Post reply on HN