How large of a model download would be required to remove the dependency on a cloud service?
No more than 1GB, and inference would be dependent on the speed but no more than 10 seconds. Completely reasonable as a standalone program.
Show HN: Chrome extension that summarizes text content using DistilBART model
11–20 of 27 posts
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#12Can you do the same for Firefox?
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#13Highlight any text, double tap 'Enter' and get a summary of any text on web Use it to summarize wikipedia articles, scientific papers, books or anything
Chrome 92.
Double tap "enter" does nothing. Feedback link on extension leads to nowhere. No description page on plugin. No instructions.
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#14I tried it on general news and the outputs were quite good actually.
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#15How large of a model download would be required to remove the dependency on a cloud service?
No more than 1GB, and inference would be dependent on the speed but no more than 10 seconds. Completely reasonable as a standalone program.
Would that require running a separate server locally? That's all kinds of non-techie hostile :(
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#16How large of a model download would be required to remove the dependency on a cloud service?
No more than 1GB, and inference would be dependent on the speed but no more than 10 seconds. Completely reasonable as a standalone program.
Is there a guide on running it locally? I am currently using some classic algorithms to summarize my RSS feeds, but they aren’t very good.
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#17Highlight any text, double tap 'Enter' and get a summary of any text on web Use it to summarize wikipedia articles, scientific papers, books or anything
(special credits to Sam Shleifer and Huggingface team for the model and infrastructure)
Are you experiencing any cost on your part for utilizing the Huggingface platform ? I see they have something like $25/1M char lookups so just wondering and am excited to see what you have done (possibly at your own expense!). I have been following Semantic Scholar [1] who are part of the Paul Allen AI for Good program and they are also working on NLP summarization -- definitely interesting things happening in this space! Thanks for your contribution.
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#18I love the idea! How do you get it to work though? I'm using Chrome 92.0.4515.159, I've disabled all other extensions, and highlighting text and double tap enter does nothing. When I right click on the text there's no context menu option, which is what I would expect.
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#19Not sure why it doesn't summarize the entire article
Re: Show HN: Chrome extension that summarizes text content using DistilBART model
#20Pretty sure it’s DistilBERT, not DistilBART: https://huggingface.co/transformers/model_doc/distilbert.htm...