Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Now Serving: Full-Text Sampler in IPython Notebook Format

miningthesocialweb.com

Post reply on HN
Print view View original

11–20 of 28 posts

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#11

Post by jyeee »

mcburton wrote: post #8
ptwobrussell wrote: post #6

Earlier quoted context omitted.

The 1.0.0 version started bundling nbconvert, which does a pretty good job of exporting to html, pdf, latex, etc. Have you tried it out yet?

I haven't started meaningfully playing with nbconvert yet, but I think one of the really promising features are the nbconvert templates[1]. From what I gather you can make custom templates with jinja and invoke them on the command line. It would be interesting to create a docbook, msword, specifically formatted pdf templates which would allow IPython Notebooks to flow into existing print publication workflows (if I r…

+1 mcburton

What an awesome idea -- I can think of some sociologists/biologists who had to suffer through MS Word equation editor with excel charts who would love something like this. The internal hyperlinks would be awesome too.

For now, at least you can "decode" ipynb to LaTeX and use the %%latex magic.

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#12

Post by leephillips »

jyeee wrote: post #4
ptwobrussell wrote: post #3

I think it's your opinion that is really the deciding factor there ;)

lol, don't just take my word for it: http://blog.fperez.org/2012/09/blogging-with-ipython-noteboo...

Really interesting blog. I would love to follow it but I don't see an RSS (or atom) feed: did I miss it?

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#13

Post by mherradora »

It is a very practical idea. How many times do you want to test an example? With pdf and other formats you could make a copy-paste but many things could go wrong. But the really important improvement is the use of Vagrant and a virtual machine to give an accurate workspace.

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#14

Post by jyeee »

mherradora wrote: post #13

It is a very practical idea. How many times do you want to test an example? With pdf and other formats you could make a copy-paste but many things could go wrong. But the really important improvement is the use of Vagrant and a virtual machine to give an accurate workspace.

+1 mherradora - I got the first version right after twitter changed the API >_< and busted one of the examples in chapter 1. Not anymore with Mining the Social Web 2e :). Bonus style points for Vagrant so that the author doesn't have to host (i.e. pay for) a VM and the massive bandwidth.

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#15

Post by jyeee »

leephillips wrote: post #12
jyeee wrote: post #4

Earlier quoted context omitted.

lol, don't just take my word for it: http://blog.fperez.org/2012/09/blogging-with-ipython-noteboo...

Really interesting blog. I would love to follow it but I don't see an RSS (or atom) feed: did I miss it?

On bottom right: http://miningthesocialweb.com/feed/

One of the fun examples shows how to mine an RSS feed ;)

https://rawgithub.com/ptwobrussell/Mining-the-Social-Web-2nd...

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#17

Post by ptwobrussell »

hesdeadjim wrote: post #16

I would love to see this start to happen in the academic world too. Being able to play around with a very complicated algorithm you are trying to wrap your head around would be a godsend.

There are some awesome notebooks out that demonstrate exactly that. Here are a couple of good links with combinatorial optimization and TSP:

http://nbviewer.ipython.org/urls/raw.github.com/fonnesbeck/B...

http://nbviewer.ipython.org/url/norvig.com/ipython/TSPv3.ipy...

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#18

Post by mcburton »

ptwobrussell wrote: post #9
mcburton wrote: post #8

Earlier quoted context omitted.

I haven't started meaningfully playing with nbconvert yet, but I think one of the really promising features are the nbconvert templates[1]. From what I gather you can make custom templates with jinja and invoke them on the command line. It would be interesting to create a docbook, msword, specifically formatted pdf templates which would allow IPython Notebooks to flow into existing print publication workflows (if I r…

Wow, you definitely have some great ideas here, and given the enthusiasm about ipynb, I would not be surprised to see these things happen in the next 6-12 months. O'Reilly does use docbook internally as part of the toolchain, but asciidoc is coming into style as well. I've done most of my work in docbook with a docbook editor, but did some of my latest boook in asciidoc, which was much easier. Just use a standard tex…

asciidoc support would require an ansciidoc renderer written in javascript, which does seem to exist[1](although I haven't used it). This also highlights some of the problems with markdown because it is an insufficiently rich language for generating semantically meaningful markup for use-cases beyond blogging. There has been some really interesting work on "scholarly markdown"[2][3], but given the social and technical complexities of markdown implementations and the community[4] seems like adding asciidoc is easier than fixing markdown.

[1] http://asciidoctor.org/news/2013/05/21/asciidoctor-js-render...

[2]https://github.com/scholmd/scholmd/wiki

[3]http://blog.martinfenner.org/2013/06/19/citations-in-scholar...

[4]http://www.codinghorror.com/blog/2012/10/the-future-of-markd...

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#19

Post by sillysaurus2 »

ptwobrussell wrote: post #17
hesdeadjim wrote: post #16

I would love to see this start to happen in the academic world too. Being able to play around with a very complicated algorithm you are trying to wrap your head around would be a godsend.

There are some awesome notebooks out that demonstrate exactly that. Here are a couple of good links with combinatorial optimization and TSP: http://nbviewer.ipython.org/urls/raw.github.com/fonnesbeck/B... http://nbviewer.ipython.org/url/norvig.com/ipython/TSPv3.ipy...

This is the first I've looked into IPython Notebook, so apologies for the newbie question: Is a notebook an html page with Python code snippets interspersed? Are these supposed to be interactive at all? Or do you have to copy the Python locally, then install some packages before you can finally run it?

I guess I'm asking, what's the difference between an HTML page that shows a Python implementation of an algorithm vs those links? Or what's the appeal?

I'm certain IPython Notebooks are valuable, since everybody seems to love them. It's not clear from glancing at those examples what the big deal is, though, so I thought I should ask in case more newbies come along and incorrectly conclude that there's nothing especially interesting about those examples beyond their content. (To be clear, the content is excellent, but why is IPython Notebook to thank rather than the author? Could those examples not have been done via some other method, or is the purpose of IPython Notebook just to make it really easy to generate such pages?)

Re: Now Serving: Full-Text Sampler in IPython Notebook Format

#20

Post by jyeee »

sillysaurus2 wrote: post #19
ptwobrussell wrote: post #17

Earlier quoted context omitted.

There are some awesome notebooks out that demonstrate exactly that. Here are a couple of good links with combinatorial optimization and TSP: http://nbviewer.ipython.org/urls/raw.github.com/fonnesbeck/B... http://nbviewer.ipython.org/url/norvig.com/ipython/TSPv3.ipy...

This is the first I've looked into IPython Notebook, so apologies for the newbie question: Is a notebook an html page with Python code snippets interspersed? Are these supposed to be interactive at all? Or do you have to copy the Python locally, then install some packages before you can finally run it? I guess I'm asking, what's the difference between an HTML page that shows a Python implementation of an algorithm vs…

The nbviewer links are just HTML pages, but if you were running your own IPython notebook server, it would be the actual python interpreter running your live code!

Setting up that IPython notebook server is easy: check out this 2 min video (http://vimeo.com/72383764). Bonus: if you use the one provided in github in that link, it comes with all the python imports you'd already need like networkx, response, etc. :)

Post reply on HN