Live data from Hacker News

Open Deep Research

github.com

71–80 of 83 posts

Re: Open Deep Research

#71
post #66
post #61

Earlier quoted context omitted.

As for them not getting traction - many projects just don’t advertise which tech they use. Also, having an open source alternative - even if slightly worse - gives projects an alternative if OpenAI decides to cut them off or sth. What I tell startups is to start off with whatever OpenAI/Anthropic have to offer, if they can, and consider switching into Open Source only if it allows for something they can’t do (often i…

> if it allows for something they can’t do (often in gen graphics) What makes gen graphics stand out?

Porn.

When I first looked into stable diffusion I wanted to see what people were making with it and there was a few sites that showed stuff people had generated and it was 70% porn 29% high fantasy wallpapers (numbers are illustrative). Recently I've been looking at different text generation inference platforms like tgi and vllm on reddit, and 1 in 5 posts in the localllm subreddits are "What's the best model for erotic role play?"

Re: Open Deep Research

#72
post #69

Earlier quoted context omitted.

> running things in production/self hosting is more annoying than just paying like 20-200/month This is an important point. As people rely more on AI/LLM tools, reliability will become even more critical. In the last two weeks, I've heavily used Claude and DeepSeek Chat. ChatGPT is much more reliable compared to both. Claude struggles with long-context chats and often shifts to concise responses. DeepSeek often has i…

> In the last two weeks, I've heavily used Claude and DeepSeek Chat. ChatGPT is much more reliable compared to both Which reliability problems did you face? I heard about connection issues due to too much traffic with Deepseek, but those would go away if you self-host the model.

Obviously the reliability problems would go away if you self-host but the "point" is most people rely on external providers because they can't locally run models of similar quality. So what do you do if deepseek cuts you off? For most getting 12? H100s (for the 671b) is essentially impossible.

Re: Open Deep Research

#73

Earlier quoted context omitted.

There’s a lot of runway left for obstacles that are easy for humans and hard/impossible for AI, such as direct manipulation puzzles. That's irrelevant. Humans totally hate CAPTCHAs and they are an accessibility and cultural nightmare. Just forget about them. Forget about making better ones, forget about what AI can and can't do. We moved on from CAPTCHAs for all those reasons. Everyone else needs to.

Agreed. When I open a link and get a Cloudflare CAPTCHA I just close the tab.

We eliminated all CAPTCHA use at Cloudflare in September 2023: https://blog.cloudflare.com/turnstile-ga/

Re: Open Deep Research

#74
post #31

Hi all! Aymeric (m-ric) here, maintainer of smolagents and part of the team who built this. Happy to see this interesting people here! Few points: - open Deep Research is not a production app, but it could easily be productionized (would need to be faster + good UX). - As the GAIA score of 55% (not 54%, that would be lame) says, it's not far from the Deep Research score of 67%. It's also not there yet: I think the ma…

> smolagents does code execution, which means "danger for your machine" if ran locally. We've railguardeed that a bit with our custom python interpreter, but it will never be 100% safe, so we're enabling remote execution with E2B and soon Docker. Those remote interfaces may also work with local VMs for isolation.

Yeah, that's what I was thinking: just throw the whole lot inside a Docker container and call it a day. Unless you're dealing with potentially malicious code that could break out of a container, that should isolate the rest of your machine sufficiently.

Alternatively, PyPy is actually fully sandboxable.

On Linux, you can also use `seccomp.` See, for instance, https://healeycodes.com/running-untrusted-python-code

Re: Open Deep Research

#75
post #40
post #31

Hi all! Aymeric (m-ric) here, maintainer of smolagents and part of the team who built this. Happy to see this interesting people here! Few points: - open Deep Research is not a production app, but it could easily be productionized (would need to be faster + good UX). - As the GAIA score of 55% (not 54%, that would be lame) says, it's not far from the Deep Research score of 67%. It's also not there yet: I think the ma…

> for now we've used a text browser developed by the Microsofit autogen team, congrats to them oh super cool! i've usually heard it the other way - people develop LLM-friendly web scrapers. i wrote one for myself, and for others there's firecrawl and expand.ai. a full "text browser" (i guess with rendering?) run locally seems like a better solution for local agents.

It’s basically a cli controlling selenium/webdriver driving Chrome + a few functions.

Re: Open Deep Research

#76
post #42

Earlier quoted context omitted.

>AI models have latency So do humans, or can my friend with cerebral palsy not use the internet any longer?

Totally different type of latency. A person with a motor disability dragging a puzzle piece with their finger will look very different from an AI model being called frame by frame.

Round 2: Begin

https://www.youtube.com/watch?v=WqnXp6Saa8Y

Re: Open Deep Research

#77

Earlier quoted context omitted.

My X feed is 90% AI Influencers like this saying "I'm blown away! Check this out.." Is this a new cottage industry? Are they making money?

Yea x and YouTube. Also the YouTube meta specifically seems to have moved to these sensationalist over exaggeration and over simplification. Really would be nice to have a sensibility filter somehow. It’s gonna come with ai.

I like AI Explained on Youtube for non-sensationalist and thoughtful takes: https://www.youtube.com/@aiexplained-official

Re: Open Deep Research

#78
post #72
post #69

Earlier quoted context omitted.

> In the last two weeks, I've heavily used Claude and DeepSeek Chat. ChatGPT is much more reliable compared to both Which reliability problems did you face? I heard about connection issues due to too much traffic with Deepseek, but those would go away if you self-host the model.

Obviously the reliability problems would go away if you self-host but the "point" is most people rely on external providers because they can't locally run models of similar quality. So what do you do if deepseek cuts you off? For most getting 12? H100s (for the 671b) is essentially impossible.

You use a Deepseek model not hosted by Deepseek, but another provider (e.g. DeepInfra currently). Hopefully a robust provider market will emerge and thrive, even if open models start thinning out.

Re: Open Deep Research

#79
post #43
post #31

Hi all! Aymeric (m-ric) here, maintainer of smolagents and part of the team who built this. Happy to see this interesting people here! Few points: - open Deep Research is not a production app, but it could easily be productionized (would need to be faster + good UX). - As the GAIA score of 55% (not 54%, that would be lame) says, it's not far from the Deep Research score of 67%. It's also not there yet: I think the ma…

I think using vision models for browsing is the wrong approach. It is the same as using OCR for scanning PDFs. The underlying text is already in digital form. So it would make more sense to establish a standard similar to meta-tags that enable the agentic web.

no, websites/pdfs were designed and laid out visually by humans for humans.

if you are just parsing the text you’ve lost a ton of information encoded in the layout/formatting.

that doesn’t even yet consider actual visual assets like graphs/images, etc

Re: Open Deep Research

#80

Earlier quoted context omitted.

Agreed. When I open a link and get a Cloudflare CAPTCHA I just close the tab.

We eliminated all CAPTCHA use at Cloudflare in September 2023: https://blog.cloudflare.com/turnstile-ga/

OK, what you now call turnstyle. If I get one of those screens I just close the tab rather than wait several seconds for the algorithm to run and give me a green checkbox to proceed.
Post reply on HN