Earlier quoted context omitted.
The API response actually contains the full HTML to include.
I'm not quite sure how I should handle that in my CLI tool!
Trafilatura to markdown? But yeah, likely to be clunky.
Web search on the Anthropic API
61–65 of 65 posts
Re: Web search on the Anthropic API
#62Earlier quoted context omitted.
> Google's pricing for a general search API As I discovered recently, and much to my surprise, Google does not offer a "general search API", at least not officially. There is a "custom search" API that sounds like web search, but isn't: it offers a subset of the index, which is not immediately apparent. Confusing and misleading labeling there. Bing offers something a bit better, but I recently ended up trying the Kag…
Do you have any references to the point that the Google Custom Search API is for a subset of the regular Google search index?
"References"? :-) This is a corporation we're talking about, and Google at that. Layers upon layers of obscurity, "strategic decisions" and discontinued products.
Try it and you'll see — there is no official Search API and the Custom Search API is quite poor and not usable in most scenarios.
Re: Web search on the Anthropic API
#63I Noticed a huge amount of latency using the web search on the api , is it me or with everyone ?
Generally when u see other providers like open ai's web search it takes usually 7-8 secs and same for pplx sonar api.
Any comments?
Re: Web search on the Anthropic API
#64Setting the allowed url to "youtube.com" results in tool usage failing (up to max_calls times). Does this mean there are certain sites that the search tool simply can't access?
Yes, it seems so. I’ve tried every possible way to get it to specifically search for YouTube videos and there’s just no way.
Even if you search for videos on a topic with hundreds of highly relevant YouTube videos, and explicitly ask it to find YouTube videos, it still says it found other relevant stuff, but not YouTube videos.
Re: Web search on the Anthropic API
#65Bing is shutting down API access as well and going to "Grounding with Bing Search" at $35/1k
https://azure.microsoft.com/en-us/updates?id=492574