YaCy – your own search engine • Hacker News Board

Re: YaCy – your own search engine

#11

Post by gavmor » Thu, Aug 25, 2022, 7:30 PM UTC

pacifika wrote: post #5

Use this as a personal knowledge base. Indexed my blog. Indexed a bookmarks export. Indexed a knowledge base. Works well. It also convinced me of power user ui

That sounds promising! How often do you export your bookmarks, and in what format do you keep your knowledge base?

Re: YaCy – your own search engine

#12

Post by bobajeff » Thu, Aug 25, 2022, 7:41 PM UTC

I would like to use this. However, in the past when I've tried it I didn't like the results. It would be nice to hear about more competition in the P2P information retrieval (search engine) tech space. YaCy seems to be the only one I've consistently heard about over the years.

Re: YaCy – your own search engine

#13

Post by pacifika » Thu, Aug 25, 2022, 7:42 PM UTC

pacifika wrote: post #5

Use this as a personal knowledge base. Indexed my blog. Indexed a bookmarks export. Indexed a knowledge base. Works well. It also convinced me of power user ui

Firefox export as html then point yacy to it. My knowledge base is a bookstack instance

Re: YaCy – your own search engine

#14

Post by rpdillon » Thu, Aug 25, 2022, 7:45 PM UTC

Tijdreiziger wrote: post #10

rasulkireev wrote: post #2

Recently installed YaCy on my Synology via docker image the provide. Already saved about 10Gb of content interesting to me. Now, I have a personal Search Engine. Awesome.

Off-topic, but how do you like Synology? I'm familiar with one of their units for work, but I'm looking into a new NAS for my home, and I'm trying to decide between Synology or building my own and putting Nextcloud on it.

Not OP, but I've been using a Synology NAS since 2013 and it's a great product. I bought a router from them as well, which is also superb. I think it's a fabulous investment.

Re: YaCy – your own search engine

#15

Post by rasulkireev » Thu, Aug 25, 2022, 7:50 PM UTC

Tijdreiziger wrote: post #10

rasulkireev wrote: post #2

Recently installed YaCy on my Synology via docker image the provide. Already saved about 10Gb of content interesting to me. Now, I have a personal Search Engine. Awesome.

Off-topic, but how do you like Synology? I'm familiar with one of their units for work, but I'm looking into a new NAS for my home, and I'm trying to decide between Synology or building my own and putting Nextcloud on it.

Love it, have 0 complaints! I got DS220+

Re: YaCy – your own search engine

#16

Post by usefulcat » Thu, Aug 25, 2022, 7:52 PM UTC

Tijdreiziger wrote: post #10

rasulkireev wrote: post #2

Recently installed YaCy on my Synology via docker image the provide. Already saved about 10Gb of content interesting to me. Now, I have a personal Search Engine. Awesome.

Off-topic, but how do you like Synology? I'm familiar with one of their units for work, but I'm looking into a new NAS for my home, and I'm trying to decide between Synology or building my own and putting Nextcloud on it.

I used a small Synology NAS from 2012-2019, at which point I replaced it with small linux box because I wanted ZFS. Inability to support ZFS was really the only reason I replaced it; it was still working fine.

Re: YaCy – your own search engine

#17

Post by ThinkingGuy » Thu, Aug 25, 2022, 7:54 PM UTC

pacifika wrote: post #5

Use this as a personal knowledge base. Indexed my blog. Indexed a bookmarks export. Indexed a knowledge base. Works well. It also convinced me of power user ui

I keep everything on my home server: photos, music, home videos, movies, downloaded webpages, ebooks, instruction manuals, etc., all shared out over HTTP. Yacy basically gives me a centralized, private search engine for my house. Example searches: "Frigidaire manual" "living room collection:Photos" "London Philharmonic Orchestra collection:Music"

Of course, having things in an organized hierarchical file system, with good metadata, helps.

Re: YaCy – your own search engine

#18

Post by a5huynh » Thu, Aug 25, 2022, 7:57 PM UTC

Shameless self-plug, I've been building some similar that you can run locally as an app: https://github.com/a5huynh/spyglass

You can define some basic rules & it'll go out and crawl those particular sites. Or use one that someone else has built. It can also sync with your Chrome/Firefox bookmarks. Would love feedback from folks who get a chance to use it !

Re: YaCy – your own search engine

#19

Post by mtlynch » Thu, Aug 25, 2022, 8:01 PM UTC

I love the idea of this, but I tried to spin up my own instance and was immediately overwhelmed by the million little knobs and settings for it.

It seems like a lot of fun if you understand all the tuning, but I feel like the current state alienates most users who want to use it in simple scenarios.

Re: YaCy – your own search engine

#20

Post by alxjsn » Thu, Aug 25, 2022, 8:03 PM UTC

If you haven't heard of Brave Goggles (https://github.com/brave/goggles-quickstart) I highly recommend checking it out. Just being able to create the search index is a massive task, so being able to apply rules server-side to their "expanded recall set" will give you what most people building search engines want, which is to control the algorithm. We weren't able to do that until now since applying rules client-side doesn't work well on a small search result set.

Related: I created a tool to create Goggles using subreddits as a signal source for domains: https://github.com/forcesunseen/narwhalizer