Live data from Hacker News

I had to build a web scraper to buy groceries

utkuufuk.com

41–50 of 175 posts

Re: I had to build a web scraper to buy groceries

#41

It seems like a lot of demand issues highlighted by the pandemic could be solved by queues. Instead of saying "there are no slots available", put the user in the queue. Process the queue in order. The improvement in wait time and demand accuracy would be a win for both consumers and the business.

[deleted]

Re: I had to build a web scraper to buy groceries

#42

Amazon Fresh (until a few days ago) was releasing slots 3 days out each night at midnight, so I've been saying up to place orders. Now it seems incremental throughout the day, but I've gotten lucky and nicked a spot. However, they don't have everything I need even normally. Now, it's even worse, so I have to order from multiple places. The local Mart's that deliver are still opening their slots at midnight, though us…

Still better then Wal-Mart’s site where everything is in-store pick up, and Target’s site where everything is out but you can’t tell until you click into the item and try to put it into a basket. My only gripe with Amazon is that it’s too hard to distinguish between them and their third party sellers, and it’s a pain to deal with the sellers. I also wish there was a button to report price gouging - I was looking for some emergen-c packs to flavor my water, normally it’s cheaper then cool-aid and less hassle to mix, some fool is charging $109 for a box of thirty packets.

Re: I had to build a web scraper to buy groceries

#43
post #30

Earlier quoted context omitted.

>Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. ...and that's rendered ineffective by SaaS bot companies that take your account logins and payment details and places the orders on your behalf, for a fee of course[1]. The economically efficient solution would be to auction off the slots, so at least the grocer is reaping the profit rather than some third par…

This assumes it's easy to resell a slot, which may not be correct (eg if you have to put in your delivery address when entering the queue). Tickets are a very different commodity.

>This assumes it's easy to resell a slot

That's not what I'm saying. Rather than buying a slot (or an account) from the bot operator, you'd give the bot operator your order and address/account/payment info, so when the slots become available, the bot operator can place an order on your behalf.

Re: I had to build a web scraper to buy groceries

#44
post #6

I’ve just been going to the grocery store as usual and it works great. You show up in the morning and there’s no line yet and shelfs are full. Later in the day they meter entry so you can keep distance inside. Don’t be that ass who makes others do your shopping just coz you’re too afraid to.

Having fewer people be out and about in supermarkets protects against more spread and helps flatten the curve.

Re: I had to build a web scraper to buy groceries

#45
post #43

Earlier quoted context omitted.

This assumes it's easy to resell a slot, which may not be correct (eg if you have to put in your delivery address when entering the queue). Tickets are a very different commodity.

>This assumes it's easy to resell a slot That's not what I'm saying. Rather than buying a slot (or an account) from the bot operator, you'd give the bot operator your order and address/account/payment info, so when the slots become available, the bot operator can place an order on your behalf.

Isn't that just what amazon should already be doing?

They need an option for people who are flexible with their delivery times, put in your order and they assign you a delivery slot when one opens up.

If a bot can do that, then amazon can just do it themselves and actually improve the user's experience.

How many people are working from home right now that don't can _when_ groceries get delivered other than "the next available slot"

Re: I had to build a web scraper to buy groceries

#46
post #31
post #26

Earlier quoted context omitted.

But unfortunately there are a limited number of per day delivery slots, so bots will own anything FIFO. They will monitor the page and be the first ones in. There also aren’t really fully standardized addresses per se, it’s actually kinda weird, but what’s stopping anyone using the apartment number next to them and receiving the delivery when notified?

>But unfortunately there are a limited number of per day delivery slots I guess the idea is to put everyone in one queue, rather than having separate queues per day/slot. Presumably this isn't an issue since everyone's on lockdown anyways, so they're always available to accept a delivery.

But there are only so many delivery people. 1,000 delivery people simply cannot give 2,000 people their groceries within a 1 hour window. The timeslots manage when the deliveries occur. People also sleep at different times, and some essential employees are still working, so you can't simply deliver the groceries to everyone without a known time.

Re: I had to build a web scraper to buy groceries

#47
post #39

Earlier quoted context omitted.

Require SMS or callback confirmation of the order slot using a non-Google/Twilio/SIP number (mobile phones or landlines both work here). Provide for one time order cancellation at no cost, cancellations after that incur a $10 cancellation fee. This should negate any technical advantage from a sophisticated entity. Queues still work, if managed properly.

>Require SMS or callback confirmation of the order slot using a non-Google/Twilio/SIP number (mobile phones or landlines both work here). How does this deal with bots that places orders on other people's behalf? https://news.ycombinator.com/item?id=22715875

It does not provide for them.

Re: I had to build a web scraper to buy groceries

#49
post #18
post #6

I’ve just been going to the grocery store as usual and it works great. You show up in the morning and there’s no line yet and shelfs are full. Later in the day they meter entry so you can keep distance inside. Don’t be that ass who makes others do your shopping just coz you’re too afraid to.

In store: you need to have someone stock the shelves, someone walk through the store and pick groceries, and someone handle the payment in person. Chance of infection: depends how long since someone coughed in the store. Online: you need someone to stock the orders and wait for people to drive up for curbside pickup. Chance of infection: low. Surely the second option is both safer and more efficient?

Probably different regions but none of my grocery stores do online like that. They have someone walk the aisles and shop like a regular shopper, and check-out at the cash register like a regular shopper. They will even give you their receipt to verify the order. You're just offloading the risk of infection to someone being paid to grab groceries.

Re: I had to build a web scraper to buy groceries

#50
post #30
post #7

Earlier quoted context omitted.

Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. If you’re talking about order queues than people will stuff the queue and cancel their orders or just have more hoarding if their multiple deliveries get processed. If it’s FIFO same technical advantages will apply: bots can click much faster than humans ever will. I think the issue is more human nature and thi…

>Web queues are ineffective as shown by sneaker bots. You’d need actual ID style authentication of accounts. ...and that's rendered ineffective by SaaS bot companies that take your account logins and payment details and places the orders on your behalf, for a fee of course[1]. The economically efficient solution would be to auction off the slots, so at least the grocer is reaping the profit rather than some third par…

Totally agreed. It’s the classic “hiring people to wait in line for you” solution. Eh I don’t think surge pricing should be put anywhere near this problem and it’s certainly not economically efficient in the classic sense, that is creating the most economic output and benefit for the consumer.
Post reply on HN