Live data from Hacker News

I had to build a web scraper to buy groceries

utkuufuk.com

61–70 of 175 posts

Re: I had to build a web scraper to buy groceries

#61
post #58

Young healthy people shouldn’t be doing this, the slots should go to the ill and elderly, people who are in immediate danger from catching the illness.

In Bulgaria between 8.30 and 10.30 shops are open for the elderly only. I'm not sure how effective this is but it strikes me as a good low tech move.

Some stores in Washington state (US) have elected to implement this, but it is not a legal requirement.

Re: I had to build a web scraper to buy groceries

#62

Of all the grocery companies in my area, only Walmart has it right: Choose an available pick up time, then start online shopping. All the others let you fill your cart, then at checkout tell you there are no slots available until the end of time. Waste of time, energy, and hope. F U, Target, Safeway, Albertsons, and Kroger.

I believe Kroger recently fixed this. Over the past two weeks I’ve had to deal with the insanity of putting some apples in my cart and start the checkout process to see if there was a slot, and if so, grab it and then come back and modify my order with all the items I needed.

But just today using the app I opened it and it asked me to confirm a time slot for my next pickup. No items in my cart - just choose a time, lock it in, and add my items later.

In my area at least, online + curbside pickup was not very common in the past, so it maybe was previously a non-issue because a slot was generally available. Glad to see they’ve made some quick adjustments.

Re: I had to build a web scraper to buy groceries

#63
post #38
post #7

Earlier quoted context omitted.

Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. If you’re talking about order queues than people will stuff the queue and cancel their orders or just have more hoarding if their multiple deliveries get processed. If it’s FIFO same technical advantages will apply: bots can click much faster than humans ever will. I think the issue is more human nature and thi…

Grocery delivery needs an address. You could pretty easily limit to one queued order per address, and limit order changes.

One hack around address limits is to put in a unit number. 1 Park Avenue or whatever in Manhattan will have multiple units in it. And if you live in one of these units you can add a letter, like "Unit 522B" which will just get delivered to your unit 522.

Some companies have databases that know the layouts in each address but many do not.

Re: I had to build a web scraper to buy groceries

#64
Shameless but very relevant plug: Monitoring a website for changes and sending data somewhere else is exactly what we do at https://monitoro.xyz

It’s the difference between maintaining a bunch of scripts and making sure they don’t stop working abruptly, and having the data you wanted without headaches.

It also wouldn’t make for such an elaborate article, but that’s the cost of simplicity if you just want to get things done.

Re: I had to build a web scraper to buy groceries

#65

Of all the grocery companies in my area, only Walmart has it right: Choose an available pick up time, then start online shopping. All the others let you fill your cart, then at checkout tell you there are no slots available until the end of time. Waste of time, energy, and hope. F U, Target, Safeway, Albertsons, and Kroger.

Except when you reserve your cart they have to put a clear timer on the cart reservation, and you can DOS them by reserving all carts and holding them with bots.

During the Corvid pandemic the programmers are the only ones who’re gonna get fed XD

Re: I had to build a web scraper to buy groceries

#66

Of all the grocery companies in my area, only Walmart has it right: Choose an available pick up time, then start online shopping. All the others let you fill your cart, then at checkout tell you there are no slots available until the end of time. Waste of time, energy, and hope. F U, Target, Safeway, Albertsons, and Kroger.

FWIW, Save-On-Foods does this as well.

Save-On-Foods has another - different issue. They normally let you modify orders, which is great. However I've noticed that modifying when there are no additional available time slots for your post code does not work. Your time slot stays reserved however upon trying to check out you will get told that they do not deliver to your area. Eventually new slots opened up and I could update my order but a frustrating bug all the same.

Re: I had to build a web scraper to buy groceries

#67
post #14

Earlier quoted context omitted.

38% of the people hospitalized with COVID-19 are between 20 and 54. [1] Everyone can catch the illness, everyone can wind up in the hospital, and depending on the state of the local hospitals, everyone is in immediate danger. [1] https://www.msn.com/en-ca/health/medical/close-to-40percent-...

That 38% figure is not relevent in this context, because it does not control for the demographics of the population in general. 45% of admisions are over 65, despite the fact that >65 makes up only 16% of the total population [0]. Further, according the the underlying report, of the 22-44 year olds admitted to the hospital, only 2-4% went to the ICU. The 75–84 bracket had 11%–31% admitance to the ICU. Of the deaths r…

[deleted]

Re: I had to build a web scraper to buy groceries

#68

Young healthy people shouldn’t be doing this, the slots should go to the ill and elderly, people who are in immediate danger from catching the illness.

Whilst I may be young and relatively healthy (mild asthma) I'm still sticking to delivery. Near to me there are few grocery stores and if I wanted to go to a larger store I would typically take transit. I've tried to minimise my impact by only ordering every 2 weeks as opposed to every week, but it seems like this is how I can have the lowest impact given the situation.

Re: I had to build a web scraper to buy groceries

#69
post #58

Earlier quoted context omitted.

In Bulgaria between 8.30 and 10.30 shops are open for the elderly only. I'm not sure how effective this is but it strikes me as a good low tech move.

Some stores in Washington state (US) have elected to implement this, but it is not a legal requirement.

Happening in Canada as well, Save-On-Foods, Shoppers Drug Mart, Real Canadian Superstore and London Drugs at least - there may be others. London Drugs have also added an hour for healthcare workers and first responders at the end of the day.

Re: I had to build a web scraper to buy groceries

#70
post #58

Young healthy people shouldn’t be doing this, the slots should go to the ill and elderly, people who are in immediate danger from catching the illness.

In Bulgaria between 8.30 and 10.30 shops are open for the elderly only. I'm not sure how effective this is but it strikes me as a good low tech move.

Singapore does 7am till 8am, you need a senior citizen card, or be taking care of a senior citizen / person with disability to get in during this time.

I think this is really great. When I go it's often crowded because people are still panicking.

Post reply on HN