Live data from Hacker News

Getting around website paywalls with devtools alone

bbarrows.com

111–120 of 123 posts

Re: Getting around website paywalls with devtools alone

#111

Earlier quoted context omitted.

https://12ft.io is another good one but yes agreed, you should cough up for the subscription when possible

I've tried that on like 3 or 4 different sites and it didn't work for a single one

I noticed too this site is having issues lately. It usually works for me. Either that, or sites have figured out its trick to bypass.

Re: Getting around website paywalls with devtools alone

#112
post #57

Earlier quoted context omitted.

But the number of AMP versions is dwindling as Google is no longer forcing it.

Yep. And the browser vendor can make changes to DevTools, archive.ph is already privacy-unfriendly and blocked in some countries, it could disappear, 12ft.io could disappear, and so on. The fact that seems least likely to change is that most "paywalls" rely on Javascript, CSS or some other "feature" of so-called "modern" web browsers. I have lost count of how many times an HN comment alleges "paywalled" in a thread a…

Lynx was a program I used on the early www. In the early 2000s I moved on to something better. Without much effort anyone can have a static binary with better HTML table rendering that is significantly smaller than today's lynx.

   readelf -d links

   There is no dynamic section in this file.

   stat -c '%s' /usr/bin/lynx links
   1894400
   1276712

Re: Getting around website paywalls with devtools alone

#113

Another option no one has menitoned is AMP. Many sites that try to use "paywalls" have AMP URLs which point to pages that have all the full text of the article in tags. These AMP sites generally look great in a text-only browser that does not run Javascript. Popular example is WSJ. In the URL, add /amp before /article/. Paywalls are insidious because they target non-subscribers. Why let non-subscribers view articles.…

"Other proposals would have more broadly exposed providers to liability for hosting unlawful content, if the provider is aware of that content.318 For example, the Platform Accountability and Consumer Transparency Act (PACT Act) would have amended Section 230 so that certain providers lose immunity under subsection (c)(1) if the provider is notified about illegal content or activity occurring on its service and does not remove the illegal content or stop the illegal activity within 24 hours."

"Proposals like the PACT Act would state that if a provider is aware of an unlawful post, it will lose immunity for a lawsuit premised on that specific post.334"

"The CASE-IT Act would have taken a similar approach, providing that service providers and users lose Section 230(c)(1) immunity for a year if they engage in certain activities, including permitting harmful content to be distributed to minors, if the harmful content is made readily accessible to minors by the failure of such provider or user to implement a system designed to effectively screen users who are minors from accessing such content.337"

"In the same vein, other bills would have caused providers to lose Section 230 immunity if they use algorithms to distribute content to users or display behavioral advertising.338"

https://crsreports.congress.gov/product/pdf/R/R46751

Re: Getting around website paywalls with devtools alone

#114
post #61

Many sites don't contains the full content even if you do that. I'm not sure of how it works (does it subscribed to them all?) but https://archive.ph/ is a good way to see the content in those cases. But really, if you are regularly reading content on a site you should subscribe to support the journalists employed there.

I subscribe to a major newspaper. But I'm not going to subscribe to all major newspapers. The individual subscription model doesn't really fit a world where you can go to one site, and click links to articles from lots of different publications. If they had a common subscription, where you pay one reasonable fee and they divide it up according to whose articles you read, I'd subscribe to that. Since they don't, I sub…

That is basically the Apple News model. If you have Apple News (part of the Apple One bundle) you can get articles from a number of publishers that would normally require a separate prescription. I’m not sure if the publishers really like this model but so far they seem to be willing to play along.

Re: Getting around website paywalls with devtools alone

#115
post #87

Earlier quoted context omitted.

> but I just don't find it viable to pay all the websites where I read just a single article. This. In the print days, you'd buy a newspaper; you'd have access to all the articles in that edition. I used to read a daily paper. In the modern world, these papers expect you to pay for a newspaper just to read a single article. I dunno, perhaps they could form a "Paywall Consortium", so that I could pay a one-day fee to…

> But if you want me to buy the whole paper to read a single article, well, ain't gonna happen. This was common for non-subscribers in the print days. Newspapers would print a number of enticing headlines and images on the front page above the fold, and display those folded newspapers for sale at dispensers, newsstands, and stores. Many people who bought a one-off paper would buy for a single article that interested…

For a quarter. Which I would pay now for a single article that interested me, no physical paper required.

Re: Getting around website paywalls with devtools alone

#116

Earlier quoted context omitted.

I’d be more willing to subscribe if publications didn’t pull the dark pattern of making signing up fast and easy, but then requiring a call to a rep to cancel. I used to subscribe to the nytimes but a few years ago I needed a break from news. My plan was to come back in 6-12 months, but they made me wait on the phone for 25 mins for something that should have taken a couple of minutes on their site. I cancelled and n…

My secret weapon for cutting through the call-to-cancel CSR script with a machete is the following: "May I ask why you want to cancel your account today?" "No, you may not." For some insane reason they ALL phrase the question this way, enabling this little grammatical gem of a response. Enjoy.

Also useful when phoning for many other reasons:

"... calls may be recorded for training purposes."

"Thanks for giving me permission, I am recording this call ..."

Re: Getting around website paywalls with devtools alone

#117
post #111

Earlier quoted context omitted.

I've tried that on like 3 or 4 different sites and it didn't work for a single one

I noticed too this site is having issues lately. It usually works for me. Either that, or sites have figured out its trick to bypass.

FWIW, I read once that 12ft.io has the business model of charging businesses for the right to stop 12ft.io working on their site.

Re: Getting around website paywalls with devtools alone

#118
post #76

Earlier quoted context omitted.

Why would this work? I know FQDNs sometimes require specifying a period at the end, and browsers seem to accept it as well, but I wonder why this would affect some frameworks' displayed content. Normally a site would rely on a cookie to maintain logged-in status, and that shouldn't be affected by the request URL.

Maybe some backend concession to allow viewing the article on hostnames/uris that are meant for internal use, partner sharing sites, etc? Like an if/then that checks the origin hostname?

Maybe Javascript or backend mistake in matching the domain name - most people don't know that domain names can end with a final dot.

Re: Getting around website paywalls with devtools alone

#119

Many sites don't contains the full content even if you do that. I'm not sure of how it works (does it subscribed to them all?) but https://archive.ph/ is a good way to see the content in those cases. But really, if you are regularly reading content on a site you should subscribe to support the journalists employed there.

https://12ft.io is another good one but yes agreed, you should cough up for the subscription when possible

No, this website, I never succeed even one time...

Re: Getting around website paywalls with devtools alone

#120

Many sites don't contains the full content even if you do that. I'm not sure of how it works (does it subscribed to them all?) but https://archive.ph/ is a good way to see the content in those cases. But really, if you are regularly reading content on a site you should subscribe to support the journalists employed there.

+1 for this.

This website almost succeed every time I run out of my tricks, like:

1) ESC to interrupt the page load 2) quickly hit "view mode" before the wall appears 3) add a "." behind the .com, so like .com./ 4) visit in incognito window when the tokens run out (e.g. Medium) 5) Check Google cache of this page, (you can quickly add cache: URL to visit the cache page) 6) Check archive.org cache of some lost pages 7) maybe some extensions but I seldom use them nowadays 8) before, there are some cool sites like, sorry I forgot the names, all stopped working, those websites can remove paypall

9) console tricks though I dunno.

Post reply on HN