What is the data retention policy for the free account versus the cloud account?
Ollama Web Search
51–60 of 182 posts
Re: Ollama Web Search
#52Any tips on local/enterprise search? I like using ollama locally and I also index and query locally. I would love to know how to hook ollama up to a traditional full-text-search system rather than learning how to 'fine tune' or convert my documents into embeddings or whatnot.
docling might be a good way to go here. Or consider one of the existing full text search engines like Typesense.
Re: Ollama Web Search
#53Earlier quoted context omitted.
I don't think ollama officially supports any proper tool use via api.
Huh, I was pretty sure I used it before, but maybe I’m confusing it with some other python-llm backend. Is https://ollama.com/blog/tool-support not it?
It depends on the model. Deepseek-R1 says it supports tool use, but the system prompt template does not have the tool-include callouts. YMMV
Re: Ollama Web Search
#54On a slightly related note- I've been thinking about building a home-local "mini-Google" that indexes maybe 1,000 websites. In practice, I rarely need more than a handful of sites for my searches, so it seems like overkill to rely on full-scale search engines for my use case. My rough idea for architecture: - Crawler: A lightweight scraper that visits each site periodically. - Indexer: Convert pages into text and cre…
YaCy (https://yacy.net) can do all this I think. Cloudflare might block you IP pretty soon though if you try to crawl.
Re: Ollama Web Search
#55Can someone tell me how much this costs and how this compares to Tavily etc
Re: Ollama Web Search
#56I had no idea they had their own cloud offering, I thought the whole point of Ollama was local models? Why would I pay $20/month to use small inferior models instead of using one of the usual AI companies like OpenAI or even Mistral? I'm not going to make an account to use models on my own computer.
Yeah it's been a steady pivot to profitable features. Wonderful to see them build a reputation through FOSS and codebase from free labor to then cash in.
As long as the software that runs locally gets maintained (and ideally improved, though if it is not I’ll simply move to something else), I find it difficult to be angry. I am more annoyed by software companies that offer a nerfed "community edition" whose only purpose is to coerce people into buying the commercial version.
Re: Ollama Web Search
#57I wish they would instead focus on local tool use. I could just use my own web search via brave api.
Hey! Author of the blogpost and I also work on Ollama's tool calling. There has been a big push on tool calling over the last year to improve the parsing. What's the issues you're running into with local tool use? What models are you using?
Hey, unrelated to the question you're answering but where do I see the rate limits for free and paid tiers?
Re: Ollama Web Search
#58I'd love to know what search engine provider they're using under the hood for this. I asked them on Twitter and didn't get a reply (yet) https://twitter.com/simonw/status/1971210260015919488 Crucially, I want to understand the license that applies to the search results. Can I store them, can I re-publish them? Different providers have different rules about this.
We work with search providers and ensure that we have zero data retention policies in place.
The search results are yours to own and use. You are free to do what you want with it. Of course you are bound by local laws of the legal jurisdiction you are in.
Re: Ollama Web Search
#59Earlier quoted context omitted.
> Some of the supported models are large and wouldn't fit on most local devices. Why would I use those models on your cloud instead of using Google's or Anthropic's models? I'm glad there are open models available and that they get better and better, but if I'm paying money to use a cloud API I might as well use the best commercial models, I think they will remain much better than the open alternatives for quite some…
When we started Ollama, we were told how open-source (open-weight wasn't a term back then) will always be inferior to the close-sourced models. This was 2 years ago (Ollama's birthday is July 18th, 2023). Fast forward to now, open models are quickly catching up, and at a significantly lower price point for most and can be customized for specific tasks instead of being general purpose. For general purpose models, abso…
Ya a lot of ppl don't realize you could spend 2k on a 5090 to run some of the large models.
Or spend 20 a month for models even a 5090 couldn't run. And not have to spend your own electricity, hardware, maintenance, updates etc.
Re: Ollama Web Search
#60Can someone tell me how much this costs and how this compares to Tavily etc
Taviy gives you 1k free requests a month.
Even with heavy ai usage I'm only at like 400/1000 for the month