Are submissioms manually reviewed by a human? Otherwise it can be abused for spam. Is it reindexed from time to time? Say, the submission looks okay, and then they change the content to something spammy. Maybe a Report button could be added in that case.
Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
31–40 of 121 posts
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#32I wonder if you could go through twitter posts and find idea posts.
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#33Earlier quoted context omitted.
I can see how it's a tricky problem. I wish html had more structure here (and people followed the structure, a whole other problem...). FWIW, my page has a "last updated" date on its now page but comes up as 1969 in aboutideasnow. Oh, now aboutideasnow shows no date at all.
The vast majority of indexed websites don't have a date unfortunately :( What's your website so I can take a look at the parsing?
https://mattgreer.dev/now
It says last updated today because I really did update it today :)
anyway, cool project!
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#34Last I checked bleepingcomputer, ifixit, vibilagare.se, psyche.co and libreboot.org aren't personal sites.
None of those actually have an /about page, yet your site says they do...
Another funny thing: just search 404 or not found and you'll get a lot of 404 pages
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#35Are submissioms manually reviewed by a human? Otherwise it can be abused for spam. Is it reindexed from time to time? Say, the submission looks okay, and then they change the content to something spammy. Maybe a Report button could be added in that case.
No, there are just some static rules to exclude missing pages and /ideas pages which don't actually talk about ideas: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a...
And yes it's re-scraped every few days.
How could a process of reviewing the pages look like? Maybe it can be implemented with GPT.
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#36Earlier quoted context omitted.
The vast majority of indexed websites don't have a date unfortunately :( What's your website so I can take a look at the parsing?
https://mattgreer.dev/now It says last updated today because I really did update it today :) anyway, cool project!
Ahh, I believe we're not trusting the current date at the moment because of spam potential: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a...
Which seems bad if you update your site and submit it afterwards. I'll remove this check for now.
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#37Last I checked bleepingcomputer, ifixit, vibilagare.se, psyche.co and libreboot.org aren't personal sites. None of those actually have an /about page, yet your site says they do... Another funny thing: just search 404 or not found and you'll get a lot of 404 pages
Yes :(
Do you have an idea of how to remove company websites in an automated way? I didn't want to manually review all 7k indexed websites.
This is the GPT prompt I used for filtering domains to add, but it gives false positives:
You are an API. Return a JSON array of booleans indicating whether each provided domain is someone's personal website. Use common sense. Make sure to return false for company websites.Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#38Neat idea! But where are all these websites coming from? People have personal websites AND they share random ideas? Btw I don’t have a website but here are some ideas I’d love to work on: Anything applying LLM to robots Device that rides on top of roomba and taps its bumper (to turn it) if it sees something bad. An employment agent for letting people try out new careers. Cheap simple pickleball out ball detection
Yes seems like a good number of people randomly decided to add /ideas to their website. /now is more of a standard, see nownownow.com
There are some good results for your third idea, maybe you can talk to those people :)
https://aboutideasnow.com/?q=employment+agent+for+letting+pe...
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#39Last I checked bleepingcomputer, ifixit, vibilagare.se, psyche.co and libreboot.org aren't personal sites. None of those actually have an /about page, yet your site says they do... Another funny thing: just search 404 or not found and you'll get a lot of 404 pages
Yes :( Do you have an idea of how to remove company websites in an automated way? I didn't want to manually review all 7k indexed websites. This is the GPT prompt I used for filtering domains to add, but it gives false positives: You are an API. Return a JSON array of booleans indicating whether each provided domain is someone's personal website. Use common sense. Make sure to return false for company websites.
Maybe change the API so that GPT can express uncertainty (make it a ternary value or even a confidence percentage), and then check the “uncertain” cases manually.
Re: Show HN: AboutIdeasNow – search /about, /ideas, /now pages of 7k+ personal sites
#40I wonder if you could go through twitter posts and find idea posts.
Hm or Fediverse https://mastodon.social/tags/idea