Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Devin: AI Software Engineer

cognition-labs.com

Post reply on HN
Print view View original

361–370 of 604 posts

Re: Devin: AI Software Engineer

#361

Post by ukuina »

senko wrote: post #113

As someone who works in this space ( https://pythagora.ai ), I welcome new entrants to this niche. Currently, mainstream AI usage in coding is at the level of assistants and glorified autocomplete. Which is great (I use GitHub Copilot daily), but for us working in the space it's obvious that the impact will be much larger. Besides us (Pythagora), there's also Sweep (mentioned by others in the comments) and GPT Engine…

Pythagora and similar frameworks are cool and very useful in the short term, but... Large-context models obviate the need for RAG and callgraph-augented generation.

Why would would Agents need multiple turns and a framework like Pythagora in a (near-future) world with GPT4-level of capability and 10M+ token context?

Re: Devin: AI Software Engineer

#362

Post by ukuina »

gerash wrote: post #190

we still don't have agents that can do simple things like: find a funny photo of my dog in my phone and post it as a story on instagram with 100% reliability. I would wait for that to happen first before thinking there can be an autonomous software engineer

This is where Large Action Models will shine.

Re: Devin: AI Software Engineer

#363

Post by senko »

pedalpete wrote: post #356

I'd really like it if Cognition Labs would put the resulting code from the demo into an open-source repository so we could examine it directly. When I was using chatGPT to help guide me through some coding tasks, I'd find it could create somewhat useful code, but where it fell down was that it would put things into variables which would be better put into a class. It is this structuring of a complete system which is…

> I'd really like it if Cognition Labs would put the resulting code from the demo into an open-source repository so we could examine it directly.

Yup. It's hard to evaluate things based on the demo.

We're building something similar (with an open source core), and publish our examples for everyone to check out, warts and all: https://www.pythagora.ai/examples

Re: Devin: AI Software Engineer

#364

Post by xcv123 »

QuiDortDine wrote: post #358
xcv123 wrote: post #302

Earlier quoted context omitted.

> Most writers have already realized that LLMs can't write in any meaningful way. I know a professional writer who is amazed by what LLMs are capable of already and, given the rate of progress, speculates they will take over many writing jobs eventually. > If you use GPT-4 day-to-day, you've probably encountered this sense of a capability wall before. Of course there is a wall with the current models. But almost ever…

> And do that several times until it's good enough Or just write the damn thing yourself.

What if this is a boring business text summary task that takes additional hours of my time at work? Why should I waste my time? I have better things to do. I can leave early while you sit there at work typing like a fool.

Re: Devin: AI Software Engineer

#365

Post by senko »

ukuina wrote: post #361
senko wrote: post #113

As someone who works in this space ( https://pythagora.ai ), I welcome new entrants to this niche. Currently, mainstream AI usage in coding is at the level of assistants and glorified autocomplete. Which is great (I use GitHub Copilot daily), but for us working in the space it's obvious that the impact will be much larger. Besides us (Pythagora), there's also Sweep (mentioned by others in the comments) and GPT Engine…

Pythagora and similar frameworks are cool and very useful in the short term, but... Large-context models obviate the need for RAG and callgraph-augented generation. Why would would Agents need multiple turns and a framework like Pythagora in a (near-future) world with GPT4-level of capability and 10M+ token context?

The problem is not (only) the context size, it's (for lack of a better word) focus. GPT4 can easily get lost in too much information and produce results that don't work well (duplicate code or just incoherently solving a problem), and it needs a lot of handholding.

Imagine GPT4 (or any other LLM) as a very eager but not very bright junior developer that just started to work with you. It's good, but it'll need a lot of situational management for it to not go wildly off the track.

What improved models will bring us in the future is making Pythagora and other such tools work better for large and more complex projects. The tipping point will come when for example you'll be able to load Pythagora in Pythagora and continue development. While we do build some auxiliary/external tools with Pythagora, the core is still handcrafted mostly by a human, and I'm pretty sure that's the case with other code gen tools as well.

Re: Devin: AI Software Engineer

#366

Post by theshackleford »

PodgieTar wrote: post #324
joshuahutt wrote: post #282

Earlier quoted context omitted.

Great point. I have no idea. What are your banking use cases? For me, it's mostly information I want. I don't really need a full app for that. I want to know: 1) How much money do I have? 2) Did a check I cashed clear yet? 3) Are there any unusual charges? How is my spending this month? 4) Anything I should look into? For actions I'd want to take: 1) Deposit check 2) Transfer money from account to account 3) Make a p…

This sounds like hell. Why on earth would you want that? Open the app, go to the account, enter the money with specificity, select the account to transfer it to, click the button. Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today?

> Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today?

If I could actually do that verbally, that would be a huge improvement. Too bad it doesn’t work like that.

Re: Devin: AI Software Engineer

#367

Post by gen220 »

MSFT_Edging wrote: post #67

Humans seek work that provides satisfaction and meaning in their life. For every technological advancement, artisans are the first to be made obsolete. Sure we have landfills full of unworn textiles, the market says its good, but overall, we keep destroying what allows humans to seek meaning. Our governments and society have made it clear, if you don't produce value, you don't deserve dignity. We have outsourced art…

I have the same questions.

I’ve decided the best thing I can do is vote with my wallet (i.e. as a consumer) and vote with my time (i.e. as a producer).

Consume commodities that are regenerative and products that are durable. Whenever possible, buy local to keep cash flows (wealth transfer) local.

Invest your time in contributing to products that encourage other people to do the same.

Yvon Chouniard said (I’m completely paraphrasing) something like “in the 21st century, the most powerful vehicle for transforming the world is the American corporation. Whether or not it should be, it is. If you think the world should be different, step 1 is starting a business”.

As a producer (engineer, for me), the best thing I can do is build tools to help people wean themselves off of Capital.

Re: Devin: AI Software Engineer

#368

Post by golergka »

feoren wrote: post #328
golergka wrote: post #167

Earlier quoted context omitted.

> What will be left? Where will we be? Just stranded without dignity or purpose, left to rot when we no longer produce value. Nobody stops you from paying $1000 for a shirt made by artisans right now. Do you want to? > Our governments and society have made it clear, if you don't produce value, you don't deserve dignity. It's not somebody else who decided that. It's you.

> > Our governments and society have made it clear, if you don't produce value, you don't deserve dignity. > It's not somebody else who decided that. It's you. No. The Republican National Convention cheered the idea of letting the poor and sick just die off in the streets. They cheered. Ron Paul asked "what are we supposed to do? Let our sick and poor just die cold in the streets?" and they cheered. Jobs are sacred i…

You are literally agreeing with me and yet phrase it as if we’re arguing about something? I’m confused.

Re: Devin: AI Software Engineer

#369

Post by isaac_okwuzi »

CipherThrowaway wrote: post #112
ThalesX wrote: post #73

As a developer but also product person, I keep trying to use AI to code for me. I keep failing, because of context length, because of shit output from the model, because of lack of any kind of architecture etc etc etc. I'm probably dumb as hell, because I just can't get it to do anything remotely useful, more than helping me with leetcode. Just yesterday I tried to feed it a simple HTML page to extract a selector, I…

Ditto. I started out excited about LLMs and eager to use them everywhere, but have become steadily disillusioned as I have tried to apply them to daily tasks, and seen others try and fail in the same way. Honestly, LLMs can't even get language right. They produce generic, amateurish copy that reads like it's written by committee. GPT can't perform to the level of a middle market copywriter or content marketer. I am c…

Are you saying LLMs are officially mid?

Re: Devin: AI Software Engineer

#370

Post by isaac_okwuzi »

notpachet wrote: post #322
reacharavindh wrote: post #268

Earlier quoted context omitted.

I actually agree with you that professional writers _can_ write/communicate much better than LLMs. However, I’ve read way too many articles or chapters in books that are so full of needless fluff before they get to the point. It’s almost as if they wanted to show off that they can write all that and somehow connect it to the main part of the article. I’m not reading the essay to appreciate the writer’s ability to nar…

Perhaps the pointless fluff you're describing is actually chaff: countermeasures strategically deployed ahead of time by IQ 180 writers in order to preemptively water down any future LLM's trained on their work. Then the humans can make a heroic return, write surgical prose like Hemingway to slice through the AI drivel, and keep collecting their paychecks. Bonus points if you can translate this analogy to software de…

lmfao :¬)
Post reply on HN