Live data from Hacker News

A Google bot scrapes pricing info by adding items to carts

wsj.com

11–20 of 291 posts

Re: A Google bot scrapes pricing info by adding items to carts

#11

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

There's a tiktok meme doing this to harass the Trump campaign's online store.

Re: A Google bot scrapes pricing info by adding items to carts

#12
> When The Wall Street Journal contacted Google in June, a spokesman at the internet giant, after a few days of digging, provided an update: The mystery shopper is a bot of its own creation.

> The purpose: making sure the all-in price for the product, including tax and shipping, matches the listing on its Google Shopping platform or in advertisements. It wasn’t to cause angst to merchants due to thousands of abandoned carts.

> “We use automated systems to ensure consumers are getting accurate pricing information from our merchants,” a company spokesman said. “This sometimes leads to merchants seeing abandoned carts as a result of our system testing whether the price displayed matches the price at checkout.”

You'd think they could have better identified themselves in accounts they were creating rather than creating this mysterious "John Smith" persona. Maybe "GoogleBot PriceVerifier" would have been a better choice.

edit: remove my inaccurate confusion about something, and fix quotes that I'd copied from a plagiarized version of the article.

Re: A Google bot scrapes pricing info by adding items to carts

#13

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

e-commerce storefronts should do that in the first place without going through the whole checkout process

Yes but how would you verify this or hold them accountable?

Re: A Google bot scrapes pricing info by adding items to carts

#14

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

> This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process.

It's usually not possible because you don't know how much the shipping + taxes are until the customer enters the billing information.

Re: A Google bot scrapes pricing info by adding items to carts

#15

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

Makes you wonder whether the smart thing to do is just make it convenient for the bots to get the info out so they won't ruin your data and waste your bandwidth. Can't fight them, join them. Can't really stop free information flow.

Re: A Google bot scrapes pricing info by adding items to carts

#16
post #14

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

> This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. It's usually not possible because you don't know how much the shipping + taxes are until the customer enters the billing information.

Yeah that's true. But from a UX perspective there are ways to make this less opaque. Perhaps a call to action at the top of the listing with an entry box to enter the Zip Code so an approximate final price can be calculated.

Any good UX designer can come up with a solution for this in a couple of hours or less. There's just no motivation to make it happen because this obfuscation of data is particularly optimized and useful for the sellers.

Re: A Google bot scrapes pricing info by adding items to carts

#17

This bot is simply trying to get the final price (with tax and shipping) which is ridiculous because e-commerce storefronts should do that in the first place without going through the whole checkout process. I always have found that kind of shady but it's probably known to increase conversions. What I found interesting is that this an open attack vector for e-commerces. Multiple bots can hit a website and start addin…

Makes you wonder whether the smart thing to do is just make it convenient for the bots to get the info out so they won't ruin your data and waste your bandwidth. Can't fight them, join them. Can't really stop free information flow.

Or quietly detect the bots and feed them junk data after they've gone through the hoops. Not saying it's the better option, but knowing the business maybe the more likely one.

Re: A Google bot scrapes pricing info by adding items to carts

#19
post #17

Earlier quoted context omitted.

Makes you wonder whether the smart thing to do is just make it convenient for the bots to get the info out so they won't ruin your data and waste your bandwidth. Can't fight them, join them. Can't really stop free information flow.

Or quietly detect the bots and feed them junk data after they've gone through the hoops. Not saying it's the better option, but knowing the business maybe the more likely one.

Which is why it should be a chrome extension (like Honey); exfiltrate the data out while providing the end user financial benefits. Messing with the data breaks the user experience and impacts revenue of the target site.

Re: A Google bot scrapes pricing info by adding items to carts

#20
post #12

> When The Wall Street Journal contacted Google in June, a spokesman at the internet giant, after a few days of digging, provided an update: The mystery shopper is a bot of its own creation. > The purpose: making sure the all-in price for the product, including tax and shipping, matches the listing on its Google Shopping platform or in advertisements. It wasn’t to cause angst to merchants due to thousands of abandone…

They need to be non traceable. If I'm doing something underhanded with pricing information I want to detect Google and other such bots and give them different information.
Post reply on HN