Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Are Product Hunt's featured products still online today?

scrapingbee.com

Post reply on HN
Print view View original

31–40 of 114 posts

Re: Are Product Hunt's featured products still online today?

#31

Post by roansh »

daolf wrote: post #21
roansh wrote: post #18

It would be interesting to see: 1. How the online ones are doing financially. 2. Which sectors are doing well - what are the trending tools. Skimmed through PH APIs, don't think this is possible. Courtland's Indie Hackers (they have stripe verified revenue) maybe of help - a quick google resulted in this¹ result There's also microconf report on SaaS's² [1] https://www.indiehackers.com/post/indie-hackers-are-making-6.…

Revenue would be near impossible to do, however we could have analyzed traffic using SimilarWeb or Ahrefs API. We could also have analyzed the sitemap to check the last update date. Those articles are really fun to write (I haven't written this one, I'm just the editor), but at some point you have to stop otherwise you end with a 20k words essay.

Agreed. A subset of products are "stripe verified" on Indie Hackers - should be a good enough population.

I think the parent article is interesting, thanks for your contributions. I am not saying that the same should have contained revenue, performance data - just that it would be interesting to see :)

Re: Are Product Hunt's featured products still online today?

#32

Post by [deleted] »

time_to_smile wrote: post #23
daolf wrote: post #4

Earlier quoted context omitted.

I find your warning a bit unfair as there are literally no CTA inside the blog content promoting our product and only 2 internal links toward other educational posts. But anyway, I thought about taking a random sample of pages who returns a "200". Let's say 150, and manually tagging them to find if they're "dead" or not. And then reuse the "dead or alive but a 200" ratio for all the pages but I was afraid that I'd ne…

> I find your warning a bit unfair as there are literally no CTA inside the blog content promoting our product and only 2 internal links toward other educational posts. I've worked in or adjacent to the content marketing world long enough to know that a CTA is not necessary for the post to be marketing/advertising. One of the major goals of content marketing it to establish the authority of the brand. You are well aw…

[deleted]

Re: Are Product Hunt's featured products still online today?

#33

Post by agentdrtran »

PragmaticPulp wrote: post #3

Fair warning: This is a blog post advertisement for ScrapingBee. The data is still interesting. The most interesting chart is one of the last: Proportion of Failures over time. As expected, more recent product links are less likely to 404 or 5xx. Going back to 2014, almost 1/3 of the featured links give a 4xx or a 5xx response. That’s a lot! More surprising, links as recent as 2020 show a 1/4 failure rate. Those proj…

I would love a PH where you have to show off an actual product (instead of blogspam guides, design resources, etc, even though these can be useful)

Re: Are Product Hunt's featured products still online today?

#35

Post by polote »

PragmaticPulp wrote: post #3

Fair warning: This is a blog post advertisement for ScrapingBee. The data is still interesting. The most interesting chart is one of the last: Proportion of Failures over time. As expected, more recent product links are less likely to 404 or 5xx. Going back to 2014, almost 1/3 of the featured links give a 4xx or a 5xx response. That’s a lot! More surprising, links as recent as 2020 show a 1/4 failure rate. Those proj…

> Fair warning: This is a blog post advertisement for ScrapingBee.

Yeah we have all seen it is on scrapingBee, no need for a warning.

Re: Are Product Hunt's featured products still online today?

#36

Post by jastr »

> there's actually proportionally less failures in Product Hunts busiest period

This is a really interesting post! I think there's a little survivorship bias. As Product Hunt grew 2015-2017, users posted old projects of theirs which were already popular and successful.

Re: Are Product Hunt's featured products still online today?

#37

Post by samwillis »

brimble wrote: post #30
stickfigure wrote: post #19

Earlier quoted context omitted.

No more nefarious than the measures websites put up to avoid scrapers? This just rehashes the Linkedin vs Hiq case: https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn (not a user, but I do some amount of scraping through other means)

It is definitely super annoying that companies are allowed to spy on us and do all kinds of crazy things with our data, all using computers and automation and "bots" and such, but individuals are increasingly not allowed to use automation to help us out online. Seems rather one-sided. On the other hand, I get that abuse is a huge problem. I do wish at least bots operating at roughly human request rates & daily total…

I believe whenever the “no automation/scraping/bots” clause in Ts&Cs has been test in court they have never held up. However that’s not to say a service can’t just cancel your account if you are found to be using one.

Running a site thats had a bot get stuck in a loop and suddenly x10000 times the request rate, when they go wrong it’s super annoying for the website owner. We ultimately just banned the whole AWS ip ranges.

Re: Are Product Hunt's featured products still online today?

#38

Post by paxys »

PragmaticPulp wrote: post #3

Fair warning: This is a blog post advertisement for ScrapingBee. The data is still interesting. The most interesting chart is one of the last: Proportion of Failures over time. As expected, more recent product links are less likely to 404 or 5xx. Going back to 2014, almost 1/3 of the featured links give a 4xx or a 5xx response. That’s a lot! More surprising, links as recent as 2020 show a 1/4 failure rate. Those proj…

The most surprising thing to me is not the failures but that the devs won't even pay a few bucks a year to keep the domains online. If I spent time and effort into building a product that went viral and got a bunch of users, I'd at least leave the front page of it up indefinitely as some sort of tombstone.

Re: Are Product Hunt's featured products still online today?

#39

Post by paxys »

BlewisJS wrote: post #16

Unrelated to the article - is it just me or is this scrapingbee product borderline nefarious? From the homepage: > Thanks to our large proxy pool, you can bypass rate limiting website, lower the chance to get blocked and hide your bots! > Scrapingbee helps us to retrieve information from sites that use very sophisticated mechanism to block unwanted traffic, we were struggling with those sites for some time now and I'…

"Nefarious" is a strong word. Courts have repeatedly ruled that scraping data that is otherwise available publicly is legal. You may not personally agree with the ethics, but there are a lot of people who do.

Re: Are Product Hunt's featured products still online today?

#40

Post by fjabre »

BlewisJS wrote: post #16

Unrelated to the article - is it just me or is this scrapingbee product borderline nefarious? From the homepage: > Thanks to our large proxy pool, you can bypass rate limiting website, lower the chance to get blocked and hide your bots! > Scrapingbee helps us to retrieve information from sites that use very sophisticated mechanism to block unwanted traffic, we were struggling with those sites for some time now and I'…

Nefarious? Then they should arrest Google first, it is the king of web scrapers.
Post reply on HN