Live data from Hacker News

Devin: AI Software Engineer

cognition-labs.com

431–440 of 604 posts

Re: Devin: AI Software Engineer

#433
post #228

Earlier quoted context omitted.

I think it requires years of proficiency in the field you are asking about in order to get openai to produce meaningful, useful output. I can make use of it, but sometimes it makes me think "how would a newbie even phrase an objection to this misunderstanding or omission?" Currently it seems gpts are pretty much not on par with the needs of non-experts.

You might be on to something here. It definitely seems to be the case because I'm using multiple different models as part of my everyday process and getting excellent results as a very experienced low level C++ systems engineer. What is worse is that seems to be leading to a self-amplifying feedback loop, where people not up to speed enough with the models try to use them, fail and give up making them fall even furth…

Very similar to my experience. I made it generate a novel neuroevolution algorithm with the data structures I imagined for recreational purposes, and to speed things up, it suggested "compiling" the graph by pre-caching short circuits into an unordered_map. A lot of fun was had. (it also calls me captain)

Re: Devin: AI Software Engineer

#434
post #153

Earlier quoted context omitted.

> the easiest thing to do is yell "they took er jerbs If the goal with AGI is to literally take all of our jobs (all jobs in all sectors) then what are you suggesting we can do instead?

The "goal" of AGI seems to be a pretty subjective thing, doesn't it? Idealistically, I could believe that the goal of AGI is to help humans build the future faster, and expand our footprint beyond what we currently believe is possible. Your pessimistic view of AGI is definitely valid, but it doesn't make it anything more than opinion, just like my view.

AGI is being developed by companies which have billions to fund it, such as Google, Meta, and Microsoft. Their goals are not subjective. These are ruthless for-profit entities that exist to increase shareholder returns.

Re: Devin: AI Software Engineer

#435

Earlier quoted context omitted.

It's worth pointing out that on their eval set for "issues resolved" they are getting 13.86%. While visually this looks impressive compared to the others, anything that only really works 13.86% of the time, when the verification of the work takes nearly as much time as the work would have anyway, isn't useful. The problem with this entire space is that we have VC hype for work that should ultimately still be being do…

Agreed, and I think that many of the problems that people think LLMs will become capable of, in fact require AGI. It may well turn out that LLMs are NOT the path to AGI. You can make them bigger and better, and address some of their shortcomings with various tweaks, but it seems that AGI requires online/continual learning which may prove impossible to retrofit onto a pre-trained transformer. Gradient descent may be t…

At least in theory we can achieve incremental learning by training from scratch every time we got some new training data. There are drawbacks with this approach such as inconsistent performance for different training runs and significantly higher training cost but it's achievable. Now the problem is if there exist methods more efficient than gradient descent? I think it's very clear now that there are no other algorithm in sight that could achieve the level of intelligence without gradient descent at its core, and the problem is just how gradient descent is used.

Re: Devin: AI Software Engineer

#439

Scott Wu! I met Scott at a competitive programming event a few years back. He is one of a very small group of people (going back to 1989) to get a perfect raw score at the IoI, the olympiad for competitive programming. https://stats.ioinformatics.org/people/2686 Glad to see that he's putting his (unbelievable) talents to use. To give you a sense, at the event where I met him, he solved 6 problems equivalent to Leetco…

I've participated in programming olympiads and worked with people of varying skill and I would say that overall the correlation between competitive programming and software engineering in a business environment is probably like 0.2 or less.

Re: Devin: AI Software Engineer

#440
post #390

Earlier quoted context omitted.

Your point being? The horses were replaced alright, carriage drivers are thriving ever since.

Lmao what are you talking/coping about? What happened to carriage drivers is pretty well-documented. Maybe ask one of these AI chatbots, they will summarize it for you.

They drive for Uber now
Post reply on HN