This case is a perfect 'recipe' for reinforcement learning. Let me know if you want help here.
I considered going down the ML route, but didn't know where to start. I'd love to hear how you would approach it.
Scraping Recipe Websites
161–170 of 204 posts
Re: Scraping Recipe Websites
#162Really nice! I often copy and paste recipes into text files I have locally so this is a great alternative. One feature request (if I may be so bold): it would be great to offer an imperial metric convertor. This is predominantly one of the reasons I keep copies of recipes I find and use.
It's really the conversion to weight (grams, from cups/tbsp/tsp/hogsheads) that would be valuable. It's just so much easier to clean to stick a scale under the mixing bowl.
this is coming soon!
Re: Scraping Recipe Websites
#163This is pretty awesome. I'm currently working on a data pipeline to demonstrate recipe scraping with kafka streams. This is going to be a big help in part of it.
Re: Scraping Recipe Websites
#164Googling for recipes drove me to install ad-blocker. Have to say I never considered how google created recipe card featured snippets -- cool stuff!
Re: Scraping Recipe Websites
#165This is great! Its a wonderful write-up.
I've also made something almost identical - a Go library for recipes scrapers for ingredients [1] and instructions [2]. Instead of the LCA method here, in my version I try to find the longest sequence of highest scoring HTML tags and those are "ingredients" or "instructions". It works very well (although I think this one works better).
Like the article mentioned, I found that the heuristics for finding HTML elements with ingredients turn out to be surprisingly simple - they usually include just a number, a measurement, and a food! This simple heuristic worked better than other sophisticated things I tried.
Re: Scraping Recipe Websites
#166I highly useful tool in my household for dealing with the SEO/tracking scourge that recipe blogs have become is https://www.paprikaapp.com/ . Hoping someday to have some spare time to integrate this with https://grocy.info/ and have a pipeline for recipe -> preparation automation.
We built this at https://ultimatemealplans.com with an eye towards consistency & simplicity.
You can
- plan your meals for the week in seconds
- generate your shopping list
- exclude foods you don't like/want
- checkout online with amazon fresh/instacart and get your groceries delivered.
Happy to demo it for any HNers who want to give it a try.
Re: Scraping Recipe Websites
#167Earlier quoted context omitted.
I think it's also about different types of recipe collections. There are cookbooks that are all recipes. This seems to be what the HN crowd is looking for when they search the internet. There are cookbooks where each recipe is accompanied by a little story. These seem to sell well, judging by the number of them that appear on bookstore shelves. And then there are cookbooks where all of the anecdotes are in the front…
I wouldn't mind the "recipe at the end" format if that were the actual case. But it's not at the end. The actual structure of a modern recipe article is 1) Header 2) Blogpost 3) Click to read button 4) More blogpost, structured in a format that looks like an informal recipe - bulleted ingredients without quantities, discussion of steps. 5) Ad. 6) More blogpost 7) More ad that looks confusingly like a kind of recipe.…
You forgot the pop-up modal asking you to subscribe. Then you close that to get subjected to the bottom-floating one while you scroll.
Re: Scraping Recipe Websites
#168Earlier quoted context omitted.
A few comment above yours is this link talking about the healing power of cooking after 9/11: https://cooking.nytimes.com/recipes/1017089-maple-shortbread... Two days ago, I made this absolutely delicious "5 minute tiramisu": https://wishesndishes.com/5-minute-tiramasu-dip/ - That page doubles as a sponsored article, too (see disclaimer). But just to prove your point and make you happy, and also because I'm hungry, I…
Your first link is a recipe from 2001-09-19, which seems like strong evidence that it being written around 9/11 wasn't motivated by modern recipe SEO?
What did I claim?
Re: Scraping Recipe Websites
#169This is great. I made a similar product at No Nonsense Recipes https://nononsense.recipes because I was also tired of dealing with all the dreck on recipe sites. I did scrape some recipes to seed the site with but haven't integrated it as a feature yet.
I did ignore the photos though, since while recipes are not subject to copyright, photos are.
Re: Scraping Recipe Websites
#170Earlier quoted context omitted.
My favorite: talking about how this recipe helped you cope with the September 11 attacks (although this intro is shorter than a lot that I have seen). https://cooking.nytimes.com/recipes/1017089-maple-shortbread...
It ran in the paper 8 days after 9/11... seems pretty reasonable to me. In much the same vein as the rush by many to baking now.
The "9/11 content" is also literally four sentences long. One sentence also introduces the recipe contributor, while another describes the original source she adapted it from.
It's not particularly gratuitous, especially given the date and location.