Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Scraping Recipe Websites

benawad.com

Post reply on HN
Print view View original

1–10 of 204 posts

Re: Scraping Recipe Websites

#2

Post by jangstrom »

This is pretty interesting. I wonder how the recipe parsers from MyFitnessPal or Pinterest compare to this. Sometimes I think they do pretty good, but often they do miss the mark. My guess is on Pinterest they only treat something as a Recipe if it contains the metadata mentioned in the article, and do the easy parse if so. MFP seems to try something a bit more advanced, but I've never been super-impressed with its parsing abilities.

Re: Scraping Recipe Websites

#3

Post by gklitt »

Pleasantly surprised to learn that most recipe sites include structured metadata. Makes sense given the combination of a relatively straightforward schema, and SEO incentive from Google.

Re: Scraping Recipe Websites

#4

Post by stx »

This could also be useful for websites that do not print well. I have run into a few occasions where adds and other website elements printed with the actual recipe. The result was a small recipe divided on several pages mostly covered with other content. There were pictures and text formatting that I could not copy out. Often for stuff like that I just pull the HTML and edit until it prints well but I would rather have an easier way.

Re: Scraping Recipe Websites

#5

Post by kmbfjr »

But how will I read about "Dakota", an avid yoga enthusiast who just happens to be a mom, who enjoys making healthy and savory meals for her family while blogging?

Seriously, I hope this spells an end to the Google ranking imposed nonsense that makes the simple act of searching for a recipe so insufferable.

Re: Scraping Recipe Websites

#6

Post by tmountain »

kmbfjr wrote: post #5

But how will I read about "Dakota", an avid yoga enthusiast who just happens to be a mom, who enjoys making healthy and savory meals for her family while blogging? Seriously, I hope this spells an end to the Google ranking imposed nonsense that makes the simple act of searching for a recipe so insufferable.

It's a running joke in our house. I start off wanting to make some mashed potatoes, and time and time again, I have to suffer through someone's life story--the camping trip in North Dakota when Susan's husband first discovered his love of homemade sour cream--etc. Makes me wonder if a super barebones recipe site that literally just has recipes and absolutely no fluff would be something people would gravitate towards.

Re: Scraping Recipe Websites

#7

Post by m_ke »

Are there any legal issues with scraping recipe sites in a commercial app like that?

I'm assuming ingredients and directions are "facts" so can't be copyrighted, but what about the pictures?

Re: Scraping Recipe Websites

#9

Post by sseagull »

kmbfjr wrote: post #5

But how will I read about "Dakota", an avid yoga enthusiast who just happens to be a mom, who enjoys making healthy and savory meals for her family while blogging? Seriously, I hope this spells an end to the Google ranking imposed nonsense that makes the simple act of searching for a recipe so insufferable.

My favorite: talking about how this recipe helped you cope with the September 11 attacks (although this intro is shorter than a lot that I have seen).

https://cooking.nytimes.com/recipes/1017089-maple-shortbread...

Post reply on HN