Live data from Hacker News

Distill: a modern machine learning journal

distill.pub

21–30 of 109 posts

Re: Distill: a modern machine learning journal

#21
post #19

Is there any concern about a web-native journal being less "future-proof"? I've come across quite a few interactive learning demonstrations in Flash/Java that no longer work.

This is a high-priority for us. By focusing on web-standards and avoiding proprietary plugins we're pretty confident that the content will be future-proof.

Re: Distill: a modern machine learning journal

#22
post #18

I sure hope this catches on, but we should all be aware of the hurdles: - Little incentive for researchers to do this beyond their own good will. - Most ML researchers are bad writers, and it's unlikely that the editing team will do the work needed (which is often a larger reorganization of a paper and ideas) to improve clarity. - Producing great writing and clear, interactive figures, and managing an ongoing github…

You're absolutely right that this is a lot of work, and not many ML researchers have all the skills needed for it.

In the short term, Distill's editorial assistance will help authors produce outstanding papers, although they need to be willing to work as well.

In the longer-term, I'd like to explore match making between data visualization people who would like to get into machine learning and machine learning researchers publishing papers.

And in the very long term, I think the right solution is to add a new component to the research ecosystem. Just like we we have people who specialize as research engineers, theoreticians, and experimentalists, I'd like to have a respected "research distiller" specialization. Eventually, I'd like to try and start special grants for research groups to have someone focused on this.

Re: Distill: a modern machine learning journal

#23
post #18

I sure hope this catches on, but we should all be aware of the hurdles: - Little incentive for researchers to do this beyond their own good will. - Most ML researchers are bad writers, and it's unlikely that the editing team will do the work needed (which is often a larger reorganization of a paper and ideas) to improve clarity. - Producing great writing and clear, interactive figures, and managing an ongoing github…

Good points. We do believe that well-written articles save readers time on the other end, which hopefully will offset some (if not all) of the cost of producing them. We also believe that taking the time to edit your ideas not only helps your audience but helps your own thinking. Outsourcing the work to others would most likely just lead to adding a veneer to an article rather than a substantive improvement. Instead of outsourcing we're thinking about how to foster collaborations in the future.

Re: Distill: a modern machine learning journal

#24
post #20
post #2

Various announcements: Google Research: https://research.googleblog.com/2017/03/distill-supporting-c... DeepMind: https://deepmind.com/blog/distill-communicating-science-mach... OpenAI: https://openai.com/blog/Distill/ YC Research: http://blog.ycombinator.com/distill-an-interactive-visual-jo... Chris Olah: http://colah.github.io/posts/2017-03-Distill/

Awesome. How do I donate to this?

Just by spreading the word :)

Re: Distill: a modern machine learning journal

#25
I don't want to undermine visualizations, they are awesome, but one of the big problems I see with ML research is the lack of re-produceability. I know that Google, Facebook and some others already share associated source repos, but it should almost be mandatory when working with public benchmark datasets. Source + Docker Images would be even better.

I worked in clinical research in a past life and studies would be highly discounted if they couldn't be reproduced. A highly detailed methods section was key. Many ML papers I see tend to have incredibly formalized LaTeX+Greek obsessed methods section, but far short of anything to allow reproduction. Some ML papers, i swear must have run their parameter searches a 1000 times to overfit and magically achieve 99% AUC.

Worse, I actually have tons of spare GPU farm capacity i'd love to devote to re-producing research, tweaking, trying it on adjacent datasets, etc. But the effort to re-produce is too high for most papers.

It is also disappointing to see various input datasets strewn about individuals' personal homepages, and sometimes end up broken. Sometimes the "original" dataset is in a pickled form after having already gone through multiple upstream transformations. I hope Distill can instill some good best practices to the community.

Re: Distill: a modern machine learning journal

#26

I don't want to undermine visualizations, they are awesome, but one of the big problems I see with ML research is the lack of re-produceability. I know that Google, Facebook and some others already share associated source repos, but it should almost be mandatory when working with public benchmark datasets. Source + Docker Images would be even better. I worked in clinical research in a past life and studies would be h…

I think that having a venue that can publish non-traditional academic artifacts is an important step for reproducibility, even if it isn't our focus.

It seems clear to me that the future will involve some kind of linking reproducibility to papers. If we want to find that future, we need a way for people to experiment with what a publication is.

Re: Distill: a modern machine learning journal

#27

As a developer with a weaker background in mathematics, I face a language barrier with many modern algorithms. After lots of research I can understand and explain them in code, but I have no idea what your artistic-looking MathXML means. Visualizations or algorithms described using code are much, much easier for me to understand and serve as a great starting point for unpacking the math explanations.

I understand where you're coming from and you raise a valid point, but the ML/AI is heavily academic and oriented around research. The target audience is people with a very strong math background and the necessary context.

I would recommend picking up a book on Comp Sci or algorithms, even just a cursory reading helps a lot. CS is very much not just programming and it is heavily restricted by descriptions through code.

Re: Distill: a modern machine learning journal

#28
post #18

I sure hope this catches on, but we should all be aware of the hurdles: - Little incentive for researchers to do this beyond their own good will. - Most ML researchers are bad writers, and it's unlikely that the editing team will do the work needed (which is often a larger reorganization of a paper and ideas) to improve clarity. - Producing great writing and clear, interactive figures, and managing an ongoing github…

You're right, i've been myself using git, github, keynote, ffmpeg, medium, JS, python, d3 and others to build blog post.

I clearly don't expect people to do that much. I can only do that because i'm coming from web development, and very nice tools started to appear recently.

People in research needs a design framework like a set of templates for keynotes/PPT/JS/CSS (think about how much traction got bootstrap). Distill is doing an awesome jobs at showing the example of what you could do.

Maybe Distill could open-source the templates they use to build those blog post?

Re: Distill: a modern machine learning journal

#29

The announcements and About page indicate an emphasis on visuals and presentation, which I apprI've. But when I think of "modern machine learning," I think of open-source and reproducibility (e.g. Jupyter notebooks). Will the papers published on Distill maintain transparency of the statistical process? I see in the submission notes that articles are required to be a public GitHub repo, which is a positive indicator.…

I totally agree that this is very important. While it isn't currently our primary focus, having a publishing platform that can accommodate a variety of content types (including code and data) feels like a step in the right direction.
Post reply on HN