I had to build a web scraper to buy groceries
utkuufuk.com
I had to build a web scraper to buy groceries
1–10 of 175 posts
Re: I had to build a web scraper to buy groceries
#2Amazon Fresh (until a few days ago) was releasing slots 3 days out each night at midnight, so I've been saying up to place orders. Now it seems incremental throughout the day, but I've gotten lucky and nicked a spot. However, they don't have everything I need even normally. Now, it's even worse, so I have to order from multiple places. The local Mart's that deliver are still opening their slots at midnight, though usually for 8 days out, and again items ordered often go out of stock before delivery. It feels like a sureal video game.
Re: I had to build a web scraper to buy groceries
#3It seems like a lot of demand issues highlighted by the pandemic could be solved by queues. Instead of saying "there are no slots available", put the user in the queue. Process the queue in order. The improvement in wait time and demand accuracy would be a win for both consumers and the business.
Re: I had to build a web scraper to buy groceries
#4Young healthy people shouldn’t be doing this, the slots should go to the ill and elderly, people who are in immediate danger from catching the illness.
Re: I had to build a web scraper to buy groceries
#5It seems like a lot of demand issues highlighted by the pandemic could be solved by queues. Instead of saying "there are no slots available", put the user in the queue. Process the queue in order. The improvement in wait time and demand accuracy would be a win for both consumers and the business.
Some websites do put you in a queue to get to the actual website/shopping. You don't even get to access the website until it's your turn. Like waiting in front of a shop.
Not a great experience if you want to just access your account, or some general information on the website, like contact info, or delivery times.
Re: I had to build a web scraper to buy groceries
#6I’ve just been going to the grocery store as usual and it works great. You show up in the morning and there’s no line yet and shelfs are full. Later in the day they meter entry so you can keep distance inside.
Don’t be that ass who makes others do your shopping just coz you’re too afraid to.
Re: I had to build a web scraper to buy groceries
#7It seems like a lot of demand issues highlighted by the pandemic could be solved by queues. Instead of saying "there are no slots available", put the user in the queue. Process the queue in order. The improvement in wait time and demand accuracy would be a win for both consumers and the business.
Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. If you’re talking about order queues than people will stuff the queue and cancel their orders or just have more hoarding if their multiple deliveries get processed. If it’s FIFO same technical advantages will apply: bots can click much faster than humans ever will. I think the issue is more human nature and things moving to the web creating inequality between the technically adept and non-adept.
Re: I had to build a web scraper to buy groceries
#8We recently ran into this problem at Cooklist in the US. We ended up setting up the ability for our users to place orders up to 3 days out.
Our system then books their pickup order at midnight when the new pickup slots are opened. We are seeing that most pickup slots are filled for the next day by 9am.
It is interesting that the stores don't allow booking several days in advance anymore. It makes sense though because even with booking for the next day we are seeing that 25% to 50% of the order is substituted due to out of stocks.
Re: I had to build a web scraper to buy groceries
#9It seems like a lot of demand issues highlighted by the pandemic could be solved by queues. Instead of saying "there are no slots available", put the user in the queue. Process the queue in order. The improvement in wait time and demand accuracy would be a win for both consumers and the business.
Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. If you’re talking about order queues than people will stuff the queue and cancel their orders or just have more hoarding if their multiple deliveries get processed. If it’s FIFO same technical advantages will apply: bots can click much faster than humans ever will. I think the issue is more human nature and thi…
Require SMS or callback confirmation of the order slot using a non-Google/Twilio/SIP number (mobile phones or landlines both work here). Provide for one time order cancellation at no cost, cancellations after that incur a $10 cancellation fee.
This should negate any technical advantage from a sophisticated entity. Queues still work, if managed properly.
Re: I had to build a web scraper to buy groceries
#10Young healthy people shouldn’t be doing this, the slots should go to the ill and elderly, people who are in immediate danger from catching the illness.
People will do what the system forces people to do. You don't want people who are in danger to starve? Let's change the system to one where we help those in need. The current way of living, in many parts of the world (especially the US), is that you have to eat others, otherwise they'll eat you. This is the system the leaders keep defending, and the people keep cheering the leaders on.
So you get what you want. Otherwise, go out on the streets and show you're not happy with it.
Getting people who are writing scrapers for groceries to stop is not realistically gonna change anything.