Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Are Product Hunt's featured products still online today?

scrapingbee.com

Post reply on HN
Print view View original

61–70 of 114 posts

Re: Are Product Hunt's featured products still online today?

#61

Post by frogpelt »

time_to_smile wrote: post #23
daolf wrote: post #4

Earlier quoted context omitted.

I find your warning a bit unfair as there are literally no CTA inside the blog content promoting our product and only 2 internal links toward other educational posts. But anyway, I thought about taking a random sample of pages who returns a "200". Let's say 150, and manually tagging them to find if they're "dead" or not. And then reuse the "dead or alive but a 200" ratio for all the pages but I was afraid that I'd ne…

> I find your warning a bit unfair as there are literally no CTA inside the blog content promoting our product and only 2 internal links toward other educational posts. I've worked in or adjacent to the content marketing world long enough to know that a CTA is not necessary for the post to be marketing/advertising. One of the major goals of content marketing it to establish the authority of the brand. You are well aw…

What's the point of the warning though?

If you're paying attention you know it's content marketing. If you're oblivious, the marketing probably isn't working.

Either way, you probably don't need a warning.

Re: Are Product Hunt's featured products still online today?

#62

Post by conductr »

paxys wrote: post #57
BlewisJS wrote: post #48

Earlier quoted context omitted.

I agree it's a strong word, which is why I said borderline nefarious. However, it's not that far off from a DDOS tool. At least in the United States, sounds like the jury is still out on the legality: https://www.reuters.com/technology/us-supreme-court-revives-... , but my perspective was more from an ethics standpoint anyway.

It is very far from a DDOS tool. Scraping can be done from a single source, one request at a time, with self imposed rate limits. Sure it can overwhelm a server, but then so can a single user opening 10 tabs.

> Scraping can be done from a single source

That's not what this tool does though. It allows you to distribute your scraping to a layer of proxies. So, the only difference is whether there is an intent to do harm to the target or merely collect data... which could be a form of doing harm as well?

Re: Are Product Hunt's featured products still online today?

#64

Post by bydlocoder »

brimble wrote: post #56
bydlocoder wrote: post #42

Earlier quoted context omitted.

Sometimes the scraping situation gets kinda ironic. I worked at a large eRetailer/marketplace and obviously we scraped our major competitors just as they scraped us (there are four major marketplaces here). So each company had a team to implement anti-scraping measures and defeat competitor's defences. Instead of providing an API everyone decided to spend time and money on this useless weapons race.

Absent someone breaking really far away from the pack, that's a classic example of one type of "bullshit job" called out in Graeber's book... Bullshit Jobs . Zero-sum, ever-escalating competition. Militaries are another obvious example (we'd all be better off if every country's military spending were far closer to zero—but no one country can risk lowering it unilaterally, and may even be inclined to increase theirs i…

I wonder how anyone in IT could take Graeber seriously. One of his opinions about programming was that programmers work "bullshit jobs" for their employer and do cool open source stuff in their free time which is demonstrably false.

Re: Are Product Hunt's featured products still online today?

#66

Post by nullspace »

tnolet wrote: post #65

Totally anecdotal / single datapoint: launched my side project in 2018 on Producthunt. Total crickets. 5 upvotes. We are now a 20+ people team, 400+ B2B customers and $12M raised.

And we are one of those 400+ B2B customers. Didn't know you were just 20+ people!

Really, really solid product. Checkly is a very core part of our infrastucture.

Re: Are Product Hunt's featured products still online today?

#67

Post by brimble »

bydlocoder wrote: post #64
brimble wrote: post #56

Earlier quoted context omitted.

Absent someone breaking really far away from the pack, that's a classic example of one type of "bullshit job" called out in Graeber's book... Bullshit Jobs . Zero-sum, ever-escalating competition. Militaries are another obvious example (we'd all be better off if every country's military spending were far closer to zero—but no one country can risk lowering it unilaterally, and may even be inclined to increase theirs i…

I wonder how anyone in IT could take Graeber seriously. One of his opinions about programming was that programmers work "bullshit jobs" for their employer and do cool open source stuff in their free time which is demonstrably false.

The presentation of that in the book, based off a message from someone in the industry, doesn't seem out of line with the overall tone and reliability-level that Graeber explicitly sets out in the beginning, which is both that the book is not rigorous science and that it's mainly concerned with considering why people's perceptions of their own jobs would be that they're bullshit.

[EDIT]

> One of his opinions about programming was that programmers work "bullshit jobs" for their employer and do cool open source stuff in their free time which is demonstrably false.

Further, I'm not even sure that's incorrect. It can both be true that most open source (that's actually used by anyone) is done by people who are paid to do it, and that most programmers have very little interesting or challenging to do at work unless they work on hobby projects—maybe open source—in their free time.

The overall letter as quoted in the book, and Graeber's commentary on it, actually makes some good points aside from all this. Things don't have to be perfect to be useful.

Re: Are Product Hunt's featured products still online today?

#68

Post by codazoda »

BlewisJS wrote: post #48
paxys wrote: post #39

Earlier quoted context omitted.

"Nefarious" is a strong word. Courts have repeatedly ruled that scraping data that is otherwise available publicly is legal. You may not personally agree with the ethics, but there are a lot of people who do.

I agree it's a strong word, which is why I said borderline nefarious. However, it's not that far off from a DDOS tool. At least in the United States, sounds like the jury is still out on the legality: https://www.reuters.com/technology/us-supreme-court-revives-... , but my perspective was more from an ethics standpoint anyway.

Based on another comment, and the wikipedia article they linked to, it looks like the Supreme Court vacated the decision and remanded the case for further review in June 2021 (probably after this article).[1] Unfortunately there is no citation for that sentence so I'm not entirely sure.

I think that means the jury is still out, as you mentioned, but it's leaning towards scraping being legal as long as the data is publicly available. IANAL

[1] https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn

Re: Are Product Hunt's featured products still online today?

#69

Post by bydlocoder »

brimble wrote: post #67
bydlocoder wrote: post #64

Earlier quoted context omitted.

I wonder how anyone in IT could take Graeber seriously. One of his opinions about programming was that programmers work "bullshit jobs" for their employer and do cool open source stuff in their free time which is demonstrably false.

The presentation of that in the book, based off a message from someone in the industry, doesn't seem out of line with the overall tone and reliability-level that Graeber explicitly sets out in the beginning, which is both that the book is not rigorous science and that it's mainly concerned with considering why people's perceptions of their own jobs would be that they're bullshit. [EDIT] > One of his opinions about pr…

The job being un-interesting and un-rewarding doesn't make it bullshit. The job of a truck or a taxi driver is boring as fuck, but it's not bullshit.

Re: Are Product Hunt's featured products still online today?

#70

Post by richardfey »

jedberg wrote: post #47

> We consider a 2XX (Success) and 3XX (Redirection) status codes successful I feel like this is flawed, especially considering 1/2 of the successful responses were 3XX. It's possible that they had just linked a short URL that was a redirect, but it's also possible that the product was shuttered and a redirect put in place to a replacement product, the company homepage, or even an acquiring company. I don't think ther…

Won't parked domains be all 2XX? But those are hardly "alive"
Post reply on HN