I think Kagi Small Web filter would give you very similar results.
I'll check them out!
I built a 500k-domain search engine for makers in a weekend for $10
61–70 of 102 posts
Re: I built a 500k-domain search engine for makers in a weekend for $10
#62Here's my impressions of your algorithm: 1. read each site 2. rent a 4090 with https://vast.ai to run vllm 3. let llm model invent its own category and tag names freely 4. save 1KB of metadata each a. a small local language model that reads each one and writes a name, two or three sentences, a category, and a handful of tags. 5. `code is going up as open source` soon (TM)
They really needn't have specified "in a weekend" cause yeah we can tell. Since when has low effort become a selling point anyhow?
it was by no means low effort
Re: I built a 500k-domain search engine for makers in a weekend for $10
#63Reminds me that AltaVista's servers ran in 4G of RAM (there were famous, at the time, pics of the circuit boards - DEC was rightfully proud of this, 30 years ago) and that a modern AltaVista should run on a decent laptop :-)
Re: I built a 500k-domain search engine for makers in a weekend for $10
#64It takes a bit of setup and a huge download, but every time I need a good domain I follow this old post from Derek Sivers. I have Claude de-dupe it and turn it into a searchable database (on my machine), then have it search genres and terms I'm looking for. It's a task Claude is very well-suited to, from the technical implementation to back-and-forth about selections. [link]: https://sive.rs/com
Note -- if you do this, watch out for requesting access to "all tlds". They send you two emails per TLD -- one for your pending state, and one for your approved/rejected state. I suddenly had 1k+ emails flooding into my inbox, until I found the setting on their website to disable emails.
Re: I built a 500k-domain search engine for makers in a weekend for $10
#65It takes a bit of setup and a huge download, but every time I need a good domain I follow this old post from Derek Sivers. I have Claude de-dupe it and turn it into a searchable database (on my machine), then have it search genres and terms I'm looking for. It's a task Claude is very well-suited to, from the technical implementation to back-and-forth about selections. [link]: https://sive.rs/com
Holy over-engineering, Batman!
Re: I built a 500k-domain search engine for makers in a weekend for $10
#66Earlier quoted context omitted.
The number of times we've gone from cloud/server access via terminal to local compute back and forth is something that always makes me laugh a bit.
It's more of a pipeline than a back-and-forth. New abilities happen in the cloud first because they require specialized, higher capacity resources and then move towards being local as the resource usage gets optimized.
Outside insane GPU appliances, I really see cloud based things as a lock-in to subscription based offerings. The fallacy of always using the latest code isn't worth never ending subscription fees. I'll install it locally. I'll keep my data locally. I don't need to wait for things to upload/download. If there's an update that feels worthy, I'll purchased and install locally.
Re: I built a 500k-domain search engine for makers in a weekend for $10
#67Reminds me that AltaVista's servers ran in 4G of RAM (there were famous, at the time, pics of the circuit boards - DEC was rightfully proud of this, 30 years ago) and that a modern AltaVista should run on a decent laptop :-)
During AltaVista's prime, 32MB would have been a lot of memory for a typical computer.
Re: I built a 500k-domain search engine for makers in a weekend for $10
#68Earlier quoted context omitted.
[flagged]
- you are going to regret offloading this much of your brain's critical thinking to an external source in the long run - every night a good number of neuron connections in your brain are automatically severed because you did not use that ability - over long periods of time, it ll take you to a point where you wont be able to write a simple factorial program on your own without gpt telling you - i am not saying this t…
I am not offloading anything. I need way more critical thinking than I ever needed before to review solutions proposed by my digital slaves to evaluate whether they are garbage or good.
If you think that having slaves means you don’t need to be a good administrator, then you are sorely mistaken.
It requires more brainpower than it ever did to manage a project the size what used to do a 100 people team. All on your own.
The fact that I am arguing with all of you here and not blindingly follow the narrative should tell you all you need to know about my critical thinking prowess.
Re: I built a 500k-domain search engine for makers in a weekend for $10
#69Re: I built a 500k-domain search engine for makers in a weekend for $10
#70TS;DR: Too Sloppy; Didn't Read.
[flagged]
People don't like this because you move the responsibility of verification to the reader.
Does the program cheat? Does it just query a table is saved in some backend? Maybe, I don't know, you don't know, and since the author only pressed enter once no-one will know until/if someone runs into any issues.
When you can create information for free, and you want people to use this information you need to provide guarantees, proof, and understanding beyond what the autonomous model has done. Otherwise you just move the burden of verification to the reader.