Viewing profile — zlagen

the most annoying thing about new laptops is how difficult is to find replacement batteries that can be trusted and work well. The battery situation is a downgrade compared to the …

data as a business, now everyone needs good data to plug it into their ai.

Interesting how this site talks about the bad experience using google and while I scroll through it I'm shown more than 10 advertisements.

in the perfect world we would have a very high trust internet in which everyone follows the rules, checks robots.txt, rate limits, etc. But we don't live in such a world. Getting a…

that's a good point, in search we have google as a monopoly and since a big percentage of sites only want to be crawled by them it reinforces the monopoly. So a lot of people compl…

Wait until legitimate users start getting their fake responses. Who is willing to trust this company to serve random data?

shouldn't QUIC be supported at the operating system level similar to TCP? that way it could get adopted much easily in different languages

in Argentina some people call facebook marketplace the "deep web", not sure if it has that reputation in other countries. Lots of stolen things being sold and also scams

this kind of surveillance is childish and a bit creepy too

They still have 62% pass rate in WPT so my guess is that there's still a lot to do to make it usable as a browser.

amazing!

Does anyone know about people doing similar reverse engineering but for javascript code in websites?

I'm using chrome on linux and noticed that this year cloudflare is very agressive in showing the "Verify you are a human" box. Now a lot of sites that use cloudflare show it and on…

After using the AI chatbots for some time, I think that they are not so useful for non programmers other than for doing small tools, that may be difficult to modify and polish by a…

it may be that google is checking the referer header.

fully agree here, using a browser for everything is the dumb way. You just usually use it to circumvent the blocking and then reuse the cookies to call the endpoints directly.

thanks, it doesn't seem like it's the direction it's going at the moment. If you look at the robots.txt of many websites, they are actually banning AI bots from crawling the site. …

what do you think would be the use cases for this project? being lightweight is awesome but usually you need a real browser for most use cases. Testing sites and scraping for examp…

I wanted to try a diffent approach which is to use chromium's network stack directly instead of patching curl to impersonate it. In this case you're using the real thing so it's a …

They use different SSL libraries/configuration. Chrome uses BoringSSL and other libraries may use OpenSSL or some other library. Besides that the SSL library may be configured with…

It replicates the browser at the HTTP/SSL level, not TCP. From what I know this is good enough to bypass cloudflare's bot detection.

In case anyone is interested, I created something similar but for python(using chromium's network stack) https://github.com/lagenar/python-cronet I'm looking for help to create the…

Hi HN! After being frustrated to need to run headless chrome/selenium in my small scale scrapers because of Cloudflare and Akamai performing TLS fingerprinting. I decided to create…