Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaCy – your own search engine

yacy.net

Post reply on HN
Print view View original

41–50 of 95 posts

Re: YaCy – your own search engine

#41

Post by UberFly »

upupandup wrote: post #28
alxjsn wrote: post #20

If you haven't heard of Brave Goggles ( https://github.com/brave/goggles-quickstart ) I highly recommend checking it out. Just being able to create the search index is a massive task, so being able to apply rules server-side to their "expanded recall set" will give you what most people building search engines want, which is to control the algorithm. We weren't able to do that until now since applying rules client-sid…

I see Brave. I close tab. I don't trust them or anybody that pushes their offerings which are just crypto ponzi schemes.

It's just a different revenue model than the usual ad garbage. You don't have to use it.

Re: YaCy – your own search engine

#43

Post by metalliqaz »

upupandup wrote: post #28
alxjsn wrote: post #20

If you haven't heard of Brave Goggles ( https://github.com/brave/goggles-quickstart ) I highly recommend checking it out. Just being able to create the search index is a massive task, so being able to apply rules server-side to their "expanded recall set" will give you what most people building search engines want, which is to control the algorithm. We weren't able to do that until now since applying rules client-sid…

I see Brave. I close tab. I don't trust them or anybody that pushes their offerings which are just crypto ponzi schemes.

I thought Brave was just a web browser with built-in adblock, but after your comment I decided to look it up on wikipedia. Holey moley, what a nightmare.

Re: YaCy – your own search engine

#44

Post by tecoholic »

pacifika wrote: post #5

Use this as a personal knowledge base. Indexed my blog. Indexed a bookmarks export. Indexed a knowledge base. Works well. It also convinced me of power user ui

Self plug - If you want to skip bookmarking and go straight to indexing, I have a firefox extension for it - https://github.com/tecoholic/yacy-it

Re: YaCy – your own search engine

#45

Post by Tijdreiziger »

usefulcat wrote: post #37
Tijdreiziger wrote: post #25

Earlier quoted context omitted.

What software are you running, and how much time do you spend on maintenance?

Vanilla Ubuntu 18.04 LTS. Every couple of months or so I update all the packages and reboot. That's really all the maintenance I've ever done on it, apart from initial setup. I ought to set it up so that it can email me if a zfs scrub ever detects a problem, but I haven't done that yet.

Thanks! That's a valuable data point for my comparison.

By the way, do you run software like Nextcloud, or are you just using it as a storage tank?

Re: YaCy – your own search engine

#46

Post by Tijdreiziger »

justsomehnguy wrote: post #32
Tijdreiziger wrote: post #10

Earlier quoted context omitted.

Off-topic, but how do you like Synology? I'm familiar with one of their units for work, but I'm looking into a new NAS for my home, and I'm trying to decide between Synology or building my own and putting Nextcloud on it.

Grearly depends on what you are expecting from it. After $300 per unit S. has only two advantages: 1. Form-factor: you can build a comparable small enough unit from OTC/OTS parts but usually it costs at least $200 more 2. Basic functionality (ie filesharing eg with SMB) just works, with a nice webgui to configure it. If you need something more...

Expectations: file/photo sync, media server, ad blocking (Pi-hole). I saw that Synology has first-party apps for most of this (Synology Drive, Moments, Video).

Re: YaCy – your own search engine

#47

Post by Tijdreiziger »

wccrawford wrote: post #26
Tijdreiziger wrote: post #10

Earlier quoted context omitted.

Off-topic, but how do you like Synology? I'm familiar with one of their units for work, but I'm looking into a new NAS for my home, and I'm trying to decide between Synology or building my own and putting Nextcloud on it.

Also not OP. I've got a Synology 918+ that I've used for years, and as a file store, I'm quite pleased. I've tried running apps on it, and the ones that are available are decent, but I pretty quickly got to where I needed to SSH in to make certain things happen, and that felt weird for an appliance like this. I added Docker and ran a bunch of stuff on that, and that was kind of a pain. They don't make it easy to upda…

Thanks! So are you running the first-party Synology Drive, Moments, etc. for file/photo syncing, or do you run something like Nextcloud on your Linux box? Or do you not use software like that?

Re: YaCy – your own search engine

#48

Post by 10g1k »

Copernic used to be a great way to do this. Register every search engine you like in the local software, apply rules, search all the web search engines at once. Until they went 100% corporate, it was awesome.

Re: YaCy – your own search engine

#49

Post by andirk »

metalliqaz wrote: post #43
upupandup wrote: post #28

Earlier quoted context omitted.

I see Brave. I close tab. I don't trust them or anybody that pushes their offerings which are just crypto ponzi schemes.

I thought Brave was just a web browser with built-in adblock, but after your comment I decided to look it up on wikipedia. Holey moley, what a nightmare.

It's by far the best browser out there. Based on Chromium. Doesn't allow websites to abuse its technical capabilities (i.e. share your data via 3rd party ad servers). You can tip content creators. You can partake in the community and all the things Brave is building, or just use the browser in its default state. If you want a crypto + search laughing stock, check out https://coinmarketcap.com/currencies/presearch/ .

Re: YaCy – your own search engine

#50

Post by px43 »

AndyMcConachie wrote: post #42

I have about 100,000 PDFs that I want indexed and searchable. They're on a website and I want people to be able to visit the website and search through the PDFs. Should I use Yacy or Apache Solr? All opinions and rants welcome.

Use Google Drive, set up a publicly shared folder, and drop the PDFs there. If you want you can even make a fancy search UX with google's search API.

https://developers.google.com/drive/api/guides/search-files

Also, YaCy is an automated web crawler that throws data into Solr, so your question doesn't make much sense.

Post reply on HN