Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ArXiv now offers papers in HTML format

blog.arxiv.org

Post reply on HN
Print view View original

191–200 of 325 posts

Re: ArXiv now offers papers in HTML format

#191

Post by matt1 »

jakderrida wrote: post #112
matt1 wrote: post #41

For anyone interested in staying informed about important new AI/ML papers on arXiv, check out https://www.emergentmind.com , a site I'm building that should help. Emergent Mind works by checking social media for arXiv paper mentions (HackerNews, Reddit, X, YouTube, and GitHub), then ranks the papers based on how much social media activity there has been and how long since the paper was published (similar to how HN a…

This is exactly what I was using HN for. But, yeah, in kinda sucked compared to yours. Another thing I was trying to create was some sort of NN model that could use the semanticscholar h-index of authors along with the abstract text and T5 to estimate the one-year out citations. Just for personal use, though. That whole thing fell apart because semanticscholar is kinda crap for associating author links to the same au…

Just a note to say that factoring authors into the ranking system is high on my todo list. v1 won't be too fancy - just a hardcoded list of prominent authors whose papers warrant extra visibility. A future version will likely automate it to avoid the hardcoded list.

Also, soon-ish I'm going to add the ability for users to follow specific authors, so you can get notified when they publish new papers.

Re: ArXiv now offers papers in HTML format

#193

Post by matt1 »

carlossouza wrote: post #120
jakderrida wrote: post #112

Earlier quoted context omitted.

This is exactly what I was using HN for. But, yeah, in kinda sucked compared to yours. Another thing I was trying to create was some sort of NN model that could use the semanticscholar h-index of authors along with the abstract text and T5 to estimate the one-year out citations. Just for personal use, though. That whole thing fell apart because semanticscholar is kinda crap for associating author links to the same au…

I did that (used other features). This is how new papers are ranked here: https://trendingpapers.com

Great site, thanks for sharing. Can you explain how you're determining how many times a paper is cited? Obviously papers include a list of references, but extracting them accurately from the PDF is difficult in my experience (two column formats, ugh) - though the new HTML versions help. And even if you have a list, many authors just mention arXiv paper titles, not their ids, making identifying specific references tricky.

Re: ArXiv now offers papers in HTML format

#194

Post by matt1 »

nojvek wrote: post #145
matt1 wrote: post #41

For anyone interested in staying informed about important new AI/ML papers on arXiv, check out https://www.emergentmind.com , a site I'm building that should help. Emergent Mind works by checking social media for arXiv paper mentions (HackerNews, Reddit, X, YouTube, and GitHub), then ranks the papers based on how much social media activity there has been and how long since the paper was published (similar to how HN a…

Great site. Bookmarked it. Would be nice if I could change timeframe. Top this week, month, year, all time.

I'm slowly adding older papers as I work out the kinks in the site. Down the road when the database is more comprehensive, this should definitely be possible.

Re: ArXiv now offers papers in HTML format

#195

Post by therealmarv »

This is the reason I've never liked LaTeX from a data point view. It's made to be printed out or get to look beautiful on a PDF but was never designed to get you to a HTML file or a Word file.

I've written my thesis in Markdown in the past because of this (best for humans) which can be easily transformed to HTML, Word, PDF and even LaTeX https://github.com/tompollard/phd_thesis_markdown

And I think that XML is the best format for machines.

Re: ArXiv now offers papers in HTML format

#196

Post by spookie »

Blikkentrekker wrote: post #159
spookie wrote: post #152

Earlier quoted context omitted.

There are braille keyboards too

Or normal keyboards? Many people can type blind. Some learned to do so while born blind, others became blind after they had already learned this skill. I would assume that the majority of persons on HN are not looking at their keyboard as they type.

I was just giving an additional way to use a computer not known by many. Either way, we shouldn't rely on the skills of a few to interact with a computer.

Re: ArXiv now offers papers in HTML format

#197

Post by delhanty »

> If you are familiar with ar5iv, an arXivLabs collaboration, our HTML offering is essentially bringing this impactful project fully “in-house”. Our ultimate goal is to backfill arXiv’s entire corpus so that every paper will have an HTML version, but for now this feature is reserved for new papers.

IIRC, ar5iv was created on his own initiative by Deynan Ginev

https://twitter.com/dginev/status/1736792316675825981

and it seems that he has worked tirelessly to fix nearly all of the edge cases during the collaboration.

This project creates huge value to humanity so Deynan is to be heartily thanked.

Re: ArXiv now offers papers in HTML format

#198

Post by jakderrida »

dginev wrote: post #122
jakderrida wrote: post #115

Earlier quoted context omitted.

And, of course, https://ar5iv.labs.arxiv.org/html However, ar5iv isn't a la carte like arxiv-vanity. They pretty much do last month's papers every month or so. Something like that.

Hi, ar5iv creator here. You can think of both arxiv-vanity and ar5iv as the "alpha" experiments that lead into the official arXiv "beta" HTML announced today. Once a few rounds of feedback and improvements are integrated, and the full collection of articles acquires HTML in the main arXiv site, ar5iv will be decommissioned. The plan is to turn all existing ar5iv links into redirects to the official HTML, and free up…

lmao! The actual creator of ar5iv? Sometimes I forget this isn't reddit and legit accomplished people comment here.

Reminds of Burning Man when people kept telling me, "Never talk trash on the art at the main landmarks. The artists are frequently within listening distance."

So, of course, I'd walk around talking about buying the art for $50K-$60k, knowing it's already scheduled to be burned with the landmark.

Re: ArXiv now offers papers in HTML format

#199

Post by Zuiii »

wolverine876 wrote: post #169
nonethewiser wrote: post #166

Earlier quoted context omitted.

> There's no straightfoward, standard way to read an html document on another platform. Such as? What doesn’t have a browser but can render pdfs?

I mean, how do I save it locally on one platform and read it on any platform? Or share it with someone else to read (without them downloading software)? I.e., we don't have a standard, local, single-file html format.

You're right.

We could have such a format if browser and os vendors were interested in supporting such a use case. Unfortunately, they aren't.

On the browser side, supporting all-in-one html files can be as simple a reading a single multipart-encoded page. Heck, if they support automatically serializing all external resources as datauris when saving pages, then most browsers will be able to open them without any modification.

On the OS side, operating systems can treat html files as first class citizens; execute them in an offline sandbox (most operating systems have embedded webviews), then extract icon, title, description and other metadata to present to the user. An icon the consists of a blank page with a small browser icon in the corner doesn't tell me anything about what the page is about. This needs to change.

In short, html can be easily made nicer to deal with locally thanks to all the parts already being in place. The problem is that no one (tech giants, os vendors) are interested in doing this.

Re: ArXiv now offers papers in HTML format

#200

Post by jakderrida »

matt1 wrote: post #191
jakderrida wrote: post #112

Earlier quoted context omitted.

This is exactly what I was using HN for. But, yeah, in kinda sucked compared to yours. Another thing I was trying to create was some sort of NN model that could use the semanticscholar h-index of authors along with the abstract text and T5 to estimate the one-year out citations. Just for personal use, though. That whole thing fell apart because semanticscholar is kinda crap for associating author links to the same au…

Just a note to say that factoring authors into the ranking system is high on my todo list. v1 won't be too fancy - just a hardcoded list of prominent authors whose papers warrant extra visibility. A future version will likely automate it to avoid the hardcoded list. Also, soon-ish I'm going to add the ability for users to follow specific authors, so you can get notified when they publish new papers.

> Also, soon-ish I'm going to add the ability for users to follow specific authors, so you can get notified when they publish new papers.

If you could do it, this would be a dream. My original intent was to be able to look through only papers citing a popular one and filtering the results for ones having at least one author with a set minimum h-index. Using Google Scholar data required using SerpAPI, which has some annoying limitations.

The core goal is obviously just not to miss out on a paper that will very likely be influential while not having to comb through the mountain of irrelevant papers.

What's funny is that Microsoft Academic was the best suited, but was retired in 2021.

Post reply on HN