Live data from Hacker News

Scraping Recipe Websites

benawad.com

121–130 of 204 posts

Re: Scraping Recipe Websites

#121

I highly useful tool in my household for dealing with the SEO/tracking scourge that recipe blogs have become is https://www.paprikaapp.com/ . Hoping someday to have some spare time to integrate this with https://grocy.info/ and have a pipeline for recipe -> preparation automation.

and paprika exports into h-recipe http://microformats.org/wiki/h-recipe

there are quite a few sites that also put up their recipes in h-recipe format, which makes it very nice to scrape.

Re: Scraping Recipe Websites

#122
The simple truth is that the core recipes are fact-based and non-copyrightable, and the 1000-word blogspam recipe header is both copyrightable and garners better search result rankings.

So the business model is to take facts from the public domain, wrap it in bullshit prose, and then SEO the bullshit to have higher ranking than the naked source facts, for more unique visitors and ad revenue.

Making comments about "providing recipes for free" are exactly as useful as comments about "providing phone numbers for free" or "providing mailing addresses for free" or "providing the original text of 'Little Women' for free" or "providing the steps of the long division algorithm for free".

Obfuscating the public domain is not a valuable service. Automatically removing the obfuscation is valuable. A "Project Gutenberg" style repository of recipes would be recurringly donation-worthy.

Re: Scraping Recipe Websites

#123

https://www.eater.com/2020/3/31/21201374/why-are-free-online...

Ha! I should totally know better, but for a second, I mixed up .com and .net and thought, "Ben has a blog? And posted about recipes? Did he pull them into his 8 bit computer or something??" I didn't realize my mistake until I clicked.

Re: Scraping Recipe Websites

#124

Earlier quoted context omitted.

They're being rightly trashed because it's a SEO tactic and nothing more. Between the preamble ranking them higher and Adsense requiring "substance" in order to monetise the page, there is a systematic issue that's leading to what is essentially useless information to what I would say is the majority of people. They're very welcome to write their life story, but I bet if google changed their algorithm slightly you'd…

My god this level of cynicism is such an eyeroll. HNers writhing over each other to be the most cynical and dismissive. For fun, can you link me to a highly ranked recipe page with a bullshit SEO story on it in line with "the camping trip in North Dakota when Susan's husband first discovered his love of homemade sour cream"?

https://www.garlicandzest.com/julia-childs-boeuf-bourguignon...

"When I woke up that Sunday morning, it was a crisp 68°. I opened every window in the house (the first time we’d aired it out since April) and put on a pair of jeans and a light long-sleeved shirt. While Scott was busy appraising his fantasy football rosters, I was searing beef and taking pictures."

Re: Scraping Recipe Websites

#125
post #44

Earlier quoted context omitted.

Thanks. This makes sense. I was wondering what these fluff pieces have to do with SEO, because surely the search engines aren’t monitoring all users and how long they spend on each page in order to rank the usefulness of the content in their search results. Bounce rates and how long a visitor stays on a page matter for those who own the sites and/or do some sort of marketing on them (ads, their own products, their se…

Yes, search engines monitor result clicks, bounce rates, dwell times, etc. They do affect ranking. And if you have Google analytics on your recipe site, Google has even more data about it.

Are you implying that having Google Analytics on your page increases your Google ranking?

Re: Scraping Recipe Websites

#126

Earlier quoted context omitted.

I can't validate this but have been told this by multiple authors and SEO professionals. So it's anecdotal. One blogger apologized to me and told me she was embarrassed doing it but it's an industry practice. She explained it's because other recipe sites use automated scraping tools and republish their recipes in an effort to outrank original authors. The personal fluff helps slow them down. Also, a lot of recipes ar…

Recipes aren't copyrightable. It's bad manners to copy and republish one without attribution, but not illegal. The introductory fluff is copyrightable, and that's one reason for it.

Photographs, videos, or drawings of recipes in progress are copyrightable, and usually more helpful. Furthermore, they provide evidence that the recipe is actually viable.

That's why you shouldn't expect to make a cent from creating a new recipe, unless you have a chef and photographer/artist lined up, or own your own restaurant chain.

Re: Scraping Recipe Websites

#127

Earlier quoted context omitted.

You might want to checkout an app I built called Cooklist. It has the features of Paprika + Grocy + Instacart + Pinterest all in one. https://cooklist.co

works in Canada?

Only in the US at the moment but planning for Canada later this year

Re: Scraping Recipe Websites

#128

I highly useful tool in my household for dealing with the SEO/tracking scourge that recipe blogs have become is https://www.paprikaapp.com/ . Hoping someday to have some spare time to integrate this with https://grocy.info/ and have a pipeline for recipe -> preparation automation.

I love Paprika, but what keeps frustrating me is the inability to share recipes with my partner. I can Airdrop a single recipe to her, but doing this for all of them, one byone, super tedious, and then she makes some changes which I'd like to have too, and there seems to be no reliable way to get her changes back on my devices. It's all the more frustrating as Paprika does sync really well, but apparently just within a single Apple ID.

Re: Scraping Recipe Websites

#129
Interesting! I wrote https://plainoldrecipe.com (open source!) to solve this, an inadvertently discovered many of the metadata tags described here.

The irony is that the content is required for SEO purposes, but once you’ve landed on the page you don’t want to see it. I wonder if there would be a way to write SEO that only the google bot sees and hide it from humans...

Re: Scraping Recipe Websites

#130

Earlier quoted context omitted.

My god this level of cynicism is such an eyeroll. HNers writhing over each other to be the most cynical and dismissive. For fun, can you link me to a highly ranked recipe page with a bullshit SEO story on it in line with "the camping trip in North Dakota when Susan's husband first discovered his love of homemade sour cream"?

A few comment above yours is this link talking about the healing power of cooking after 9/11: https://cooking.nytimes.com/recipes/1017089-maple-shortbread... Two days ago, I made this absolutely delicious "5 minute tiramisu": https://wishesndishes.com/5-minute-tiramasu-dip/ - That page doubles as a sponsored article, too (see disclaimer). But just to prove your point and make you happy, and also because I'm hungry, I…

Your first link is a recipe from 2001-09-19, which seems like strong evidence that it being written around 9/11 wasn't motivated by modern recipe SEO?
Post reply on HN