Live data from Hacker News

AI Report #4: AutoGPT And Open-source lags behind Part 2

theaireport.substack.com

21–30 of 37 posts

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#21

I know a big part of the discussion around this link is around whether AutoGPT is viable or not, but I think a more interesting piece are the papers linked at the bottom (especially the "Tool Maker" one). This pattern of "well, maybe the LLM can do that too" is just so obvious but so meta and simultaneously brittle. "LLM can use tools" -> "The tools can, themselves, be LLM-based" -> "The LLM can create it's own tools…

Replace LLM with people and it makes a lot of sense.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#22

The amount of hype around AutoGPT is probably good for other people building similar things though. It allows people to build without all the grifter attention that AutoGPT gets.

I would say the same about GPT and LLMs in general. For me, it’s been nothing but garbage in, garbage out and a massive waste of my time, so far. Hopefully they’ll figure out how to do symbolic computation in the future so I can finally trust anything that it spits out.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#23
post #14

Earlier quoted context omitted.

Are you an OpenAI user who has a valid payment method attached to your account? I've notice they approve GPT-4 as long as you have a valid payment method and a reasonable justification, which in my case one liner.

There's a waiting list to use the GPT-4 API. https://openai.com/waitlist/gpt-4-api Anecdotally (and unsurprisingly), they seem to be prioritising those with "value-add" use cases in a variety of industries over individuals just wanting to play.

A waiting list that gave preferential treatment to YC companies, that is. This is according to a recent lawsuit that was filed against OpenAI.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#24

Has anyone actually done anything of use with autogpt? I tied it for 4 tasks and it would inevitably get stuck on each and produce absolutely nothing of value. These were fairly simple like research popular topics and write articles on them etc. It would do things like Google something, the result wasn’t relevant , try again , got an error from one of the pages and then seemingly started to do something completely in…

I think it's safe to say that if people were getting value out of this then we would be hearing about it a lot

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#25
post #4
post #3

Earlier quoted context omitted.

Were you using it with gpt3 or 4? Personally, I can’t get gpt4 api access despite being a PI at a well known research institution with a project that would be great publicity for OpenAI. My theory is that people are running it mostly with 3 and then saying it’s useless. It definitely is useless with 3.

I've used GPT4, and never got it really do anything useful.

Same here with GPT-4 via ChatGPT Plus

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#26
post #7
post #4

Earlier quoted context omitted.

I've used GPT4, and never got it really do anything useful.

Same here, tried both autoGPT and autoGPT.js with GPT-4, kept failing at even the simplest of tasks.

Same experience here, I really wanted it to work but it often got stuck in errors or infinite loops. Hoping it'll improve in the next few months.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#27
To all the AI hucksters - there was a decades long effort already tried, known as "5th generation programming languages" where they assumed the next level after high level programming languages would be to remove the human programmer completely.

basically, this effort ended up failing because, well, problem solving itself is inherently complex.

https://en.wikipedia.org/wiki/Fifth-generation_programming_l...

seems like the exact same thing happened with ChatGPT / AutoGPT / GPT4, and this will keep happening.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#28
I have never built an agent before, nor am I knowledgeable about the latest studies in this field. So what I am saying below is likely to be nonsensical.

I was thinking that perhaps we have been working with abstractions that are too low-level. Instead of providing a set of tools such as API calls or text splitters, wouldn't it be more reliable to give agents templates or workflows of successful tasks, such as trimming videos or booking restaurants?

These templates would consist of a set of function calls, or a graph of connected components in low-code tools like LangFlow. I believe auto agents already use a similar concept where they cache successful tasks for future reuse. The idea is to populate these caches with the most common use cases, and use retrieval if they become too large, so that we don't experience cache-miss most of the time and work with lower-level abstractions (tools) as the baseline. Templates, like prompts, should be portable (e.g. JSON) to avoid the need for everyone to reinvent the wheel. While this solution may not be as impressive as a full autonomous agent and may not work for a generalized case, it should produce a more predictable outcome, I think.

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#29
post #3

Earlier quoted context omitted.

Were you using it with gpt3 or 4? Personally, I can’t get gpt4 api access despite being a PI at a well known research institution with a project that would be great publicity for OpenAI. My theory is that people are running it mostly with 3 and then saying it’s useless. It definitely is useless with 3.

Are you an OpenAI user who has a valid payment method attached to your account? I've notice they approve GPT-4 as long as you have a valid payment method and a reasonable justification, which in my case one liner.

Yes. I think LangChain fills in a lot of the problems and it becomes more like programming. So instead of having it “reason” about the results and plans just code those in and sometimes call a LLM when it makes sense.

Right now it’s extremely chaotic since there’s no human correction in the process so the errors compound until you quickly reach incoherence

Re: AI Report #4: AutoGPT And Open-source lags behind Part 2

#30

Has anyone actually done anything of use with autogpt? I tied it for 4 tasks and it would inevitably get stuck on each and produce absolutely nothing of value. These were fairly simple like research popular topics and write articles on them etc. It would do things like Google something, the result wasn’t relevant , try again , got an error from one of the pages and then seemingly started to do something completely in…

That about matches my experience. It's a neat project but that's about it.

It’s a neat version 0.0001 of agentic AI. I’m sure one day it’ll be useful but not for a few years at least
Post reply on HN