What "Ollama account?" I am confused, I thought the point of Ollama was to self-host models.
Ollama Web Search
41–50 of 182 posts
Re: Ollama Web Search
#42On a slightly related note- I've been thinking about building a home-local "mini-Google" that indexes maybe 1,000 websites. In practice, I rarely need more than a handful of sites for my searches, so it seems like overkill to rely on full-scale search engines for my use case. My rough idea for architecture: - Crawler: A lightweight scraper that visits each site periodically. - Indexer: Convert pages into text and cre…
Have you ever tried https://marginalia-search.com ? I love it.
Re: Ollama Web Search
#43I had no idea they had their own cloud offering, I thought the whole point of Ollama was local models? Why would I pay $20/month to use small inferior models instead of using one of the usual AI companies like OpenAI or even Mistral? I'm not going to make an account to use models on my own computer.
Yeah it's been a steady pivot to profitable features. Wonderful to see them build a reputation through FOSS and codebase from free labor to then cash in.
What sort of monetization model would you like to see? What model would you deem acceptable?
Re: Ollama Web Search
#44On a slightly related note- I've been thinking about building a home-local "mini-Google" that indexes maybe 1,000 websites. In practice, I rarely need more than a handful of sites for my searches, so it seems like overkill to rely on full-scale search engines for my use case. My rough idea for architecture: - Crawler: A lightweight scraper that visits each site periodically. - Indexer: Convert pages into text and cre…
You could take a look at the leaked Yandex source code from a few years ago. I'd believe their architecture should be decent enough.
Re: Ollama Web Search
#45Does this work with (tool use capable) models hosted locally?
Hi - author of the post. Yes it does! The "build a search agent" example can be used with a local model. I'd recommend trying qwen3 or gpt-oss
Very cool, thank you!
Looking forward to try it with a few shell scripts (via the llm-ollama extension for the amazing Python ‘llm’) or Raycast (the lack of web search support for Ollama has been one of my biggest reasons for preferring cloud-hosted models).
Re: Ollama Web Search
#46Any tips on local/enterprise search? I like using ollama locally and I also index and query locally. I would love to know how to hook ollama up to a traditional full-text-search system rather than learning how to 'fine tune' or convert my documents into embeddings or whatnot.
You can use solr, very good full text search and it has an mcp integration. That’s sufficient on its own and straightforward to setup:
https://github.com/mjochum64/mcp-solr-search
A slightly heavier lift, but only slightly, would be to also use solr to also store a vectorized version of your docs and simultaneously do vector similarity search, solr has built in knn support fort it. Pretty good combo to get good quality with both semantic and full-text search.
Though I’m not sure if it would be relatively similar work to do solr w/ chromadb, for the vector portion, and marry the result stewards via llm pixie dust (“you are the helpful officiator of a semantic full-text matrimonial ceremony” etc). Also not sure the relative strengths of chromadb vs solr on that- maybe scales better for larger vector stores?
Re: Ollama Web Search
#47Earlier quoted context omitted.
Hi - author of the post. Yes it does! The "build a search agent" example can be used with a local model. I'd recommend trying qwen3 or gpt-oss
Very cool, thank you! Looking forward to try it with a few shell scripts (via the llm-ollama extension for the amazing Python ‘llm’) or Raycast (the lack of web search support for Ollama has been one of my biggest reasons for preferring cloud-hosted models).
Since we shipped web search with gpt-oss in the Ollama app I've personally been using that a lot more especially for research heavy tasks that I can shoot off. Plus with a 5090 or the new macs it's super fast.
Re: Ollama Web Search
#48Earlier quoted context omitted.
Based on the fact that there are very few up-to-date English-language search indexes (Google, Bing, and Brave if you count it), it must be incredibly costly. I doubt they are maintaining their own.
We need more indexes
Do we know what OpenAI uses? Have they built their own, or piggy back on moneybags $MS and Bing?
Re: Ollama Web Search
#49Earlier quoted context omitted.
Based on the fact that there are very few up-to-date English-language search indexes (Google, Bing, and Brave if you count it), it must be incredibly costly. I doubt they are maintaining their own.
We need more indexes
More competition in the space would be great for me as a consumer, but the problem is that the high fixed costs make starting an index difficult.
Re: Ollama Web Search
#50Earlier quoted context omitted.
We need more indexes
Do we know what OpenAI uses? Have they built their own, or piggy back on moneybags $MS and Bing?