Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama Web Search

ollama.com

Post reply on HN
Print view View original

141–150 of 182 posts

Re: Ollama Web Search

#141

Post by _flux »

coffeecoders wrote: post #38

On a slightly related note- I've been thinking about building a home-local "mini-Google" that indexes maybe 1,000 websites. In practice, I rarely need more than a handful of sites for my searches, so it seems like overkill to rely on full-scale search engines for my use case. My rough idea for architecture: - Crawler: A lightweight scraper that visits each site periodically. - Indexer: Convert pages into text and cre…

I think a lot of time an exhaustive searchable index just of what I've browsed would be useful, though I suppose refresh feature would be useful.

Re: Ollama Web Search

#145

Post by Cheer2171 »

dcreater wrote: post #101
Cheer2171 wrote: post #91

Earlier quoted context omitted.

What reputation? People who actually know how to develop software or work with LLMs know ollama is a child's tricycle and to run the hell away from what is just a buggy shell around other people's inference engines. Ollama is beloved by people who know how to write 5 lines of python and bash to do API calls, but can't possibly improve the actual app.

Thats what I thought so as well - that it was for people like me who arent professional SWEs and thus im sad to see them go this way. But what ive found is people are using it for "on-prem" style deployment, have no idea if this is common but I wouldnt be surprised given the reality of AI startups + the abundance of ollama in training dataset leading to relatively greater vibe coding success rate

If people are using ollama for on prem deployment, for anything more than single user hobby use or backend for a UI proof of concept, then run as far away as you can from those people. Major red flag, immediately disqualifying.

Re: Ollama Web Search

#146

Post by UltimateEdge »

coffeecoders wrote: post #38

On a slightly related note- I've been thinking about building a home-local "mini-Google" that indexes maybe 1,000 websites. In practice, I rarely need more than a handful of sites for my searches, so it seems like overkill to rely on full-scale search engines for my use case. My rough idea for architecture: - Crawler: A lightweight scraper that visits each site periodically. - Indexer: Convert pages into text and cre…

Drew DeVault tried building something similar to this under the name SearchHut, but the project was abandoned [1]. I tried hacking on it a while ago (since it's built on Postgres and a bit of Go), but I ran out of steam trying to understand the Postgres RUM extension.

[1]: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

Re: Ollama Web Search

#147

Post by brabel »

blihp wrote: post #110
andrewmutz wrote: post #84

Ollama is a business? They raised money? I thought it was just a useful open source product. I wonder how they plan to monetize their users. Doesn't sound promising.

There are very few recently launched pure open source projects these days (most are at least running donation-ware models or funded by corporate backers), none in the AI space that I'm aware of.

Well the real open source project is llama.cpp which Ollama basically wrapped and made a nice interface on top of. Now they do more things as they want to be a real business, but llama.cpp is now doing most things people wanted from something like ollama, like serving a REST API compatible with OpenAPI, downloading and managing local LLMs… while remaining an actual open source project without VC money as far as I know.

Re: Ollama Web Search

#148

Post by brabel »

kordlessagain wrote: post #77
sorenjan wrote: post #7

I had no idea they had their own cloud offering, I thought the whole point of Ollama was local models? Why would I pay $20/month to use small inferior models instead of using one of the usual AI companies like OpenAI or even Mistral? I'm not going to make an account to use models on my own computer.

You make an account to use their hosted models AND to have them available via the Ollama API LOCALLY. I'm spending $100 on Claude and $200 on GPT5, so $20 bucks is NOTHING and totally worth having access to: Qwen3 235b Deepseek 3.1 671b (thinking and non thinking) Llama 3.1 405b GPT OSS 120b Those are hardly "small inferior models". What is really cool is that you can set Codex up to use Ollama's API and then have it…

How does it compare to AzureAI which has all the best models and you don’t need to sign up with anyone other than Azure itself?

Re: Ollama Web Search

#149

Post by simonw »

userbinator wrote: post #118
simonw wrote: post #115

Earlier quoted context omitted.

The reason I care about this is that different providers have different rules about how I can use the results. Brave: https://api-dashboard.search.brave.com/terms-of-service "Licensee shall not at any time, and shall not permit others to: store the results of the API or any derivative works from the results of the API" Exa: https://exa.ai/assets/Exa_Labs_Terms_of_Service.pdf "You may not [...] download, modify, copy,…

(IANAL) You can normally safely ignore such things.

My nightmare scenario is that I build my own crucial database of information partially derived from a search API... and then later get into legal trouble which forces me to delete that data, which is now intermingled with other information I've collected.

Re: Ollama Web Search

#150

Post by Havoc »

andrewmutz wrote: post #84

Ollama is a business? They raised money? I thought it was just a useful open source product. I wonder how they plan to monetize their users. Doesn't sound promising.

The launched a hosted platform a while back
Post reply on HN