Viewing profile — myzie

The Chrome extension approach may shift some (most?) of the risk to the end user, since technically they are now the one scraping. Theoretically getdex would be relatively better o…

Related research on past litigation in this area for anyone that wants to go deeper: https://deepnoodle.ai/research/linkedin-legal-battles-tos-vi...

Currently, yes. However it's quite early and I'm exploring whether this is the best option. The reason I was posting here on HN is to see if anyone more technical may be interested…

Solo founder here looking for some input and feedback from the HN community. I'm building a SaaS to help with discovering and researching businesses. So far I have information on a…

https://github.com/diveagents/dive Dive orchestrates multi agent workflows in Go. Take a look and let me know what you think.

+1 to the article. Along these lines, I'm building Dive: https://github.com/diveagents/dive When building a SaaS with a Go backend, it's nice to be able to have the option of the a…

Risor is an embedded scripting library and CLI for Go. This release adds new modules for web crawling, background scheduling, and more. Happy scripting.

Just a quick release announcement for Risor, an embedded scripting library and CLI for Go. Plenty of additions relating to web crawling, background scheduling, and more. Happy scri…

I'm definitely with you that sites should be leveraging CDNs and similar. But I get that many don't want to do any work to support bots that they don't want to exist in the first p…

An aspect I find interesting is that these crawlers are all doing highly redundant work. As in, thousands of crawlers are running around the world, and each crawler may visit the s…

Nice. I was wondering if r53 latency-based routing would work as an optional add-on to this. I didn't look into it but was thinking it might not work because the latency based rout…

Oh I realized I was thinking of Cloudformation Stacksets, since those like you automate deployment of a Stack across multiple regions. https://docs.aws.amazon.com/AWSCloudFormation…

Aha, indeed. A few interesting notes on this. And thanks for the link to your Makefile. I see you're a Cloudformation Stacks user (good stuff), so you may know some of what I say b…

Cloudflare Workers are great in general. The way they route client requests to the nearest Cloudflare data center means that a single client will most often end up with a small num…

Source code for the testing is available here: https://github.com/pgEdge/cloudflare-pgedge-latency-tests

Risor is an embeddable scripting language for the Go ecosystem. This blog post introduces its opcodes and shows how it was influenced by CPython.

GitHub project here: https://github.com/risor-io/risor