Live data from Hacker News

Magic AI Secures $117M to Build an AI Software Engineer

maginative.com

71–80 of 92 posts

Re: Magic AI Secures $117M to Build an AI Software Engineer

#72
post #67

Earlier quoted context omitted.

what will happen to their wages when all white-collar workers take up that career?

They can go back to work in the farms, or weave baskets, or pottery... Still not good? Ok, maybe this is too radical but hear me out: how about we take this incredible increase in productivity as an opportunity to start paving the way for a true post-scarcity future that can benefit most people, eliminate intellectual property and take everything produced by robots to fund UBI, instead of worrying about our cushy job…

> They can go back to work in the farms

yes I think feudalism 2.0 is how this will probably turn out

Re: Magic AI Secures $117M to Build an AI Software Engineer

#73
post #8

Earlier quoted context omitted.

As a software engineer, no, there's no reason to be worried. But what if you were a wordpress developer where a big chunk of your work can be automated?

Do you seriously think WP is just about blogs? I'd say majority of WP sites are now ecommerce, the amount of different plugins interacting based on local markets needs with custom tweaks, integrations to local courier APIs, payment systems and the general fudginess of the codebase I'll be very surprised if this can be automated. Your general FAANG proto pusher SWE will be the first to go.

Majority of WP sites are definitely not e-commerce. There are about 160M active domains and WP is estimated to run on 40% of the web. That's a whooping 60M+ web sites. I doubt more than 10M of them are e-commerce ones.

Re: Magic AI Secures $117M to Build an AI Software Engineer

#74
post #43

Earlier quoted context omitted.

Some random team at Berkeley beat them to it by a couple days: https://largeworldmodel.github.io/ . It's just a matter of throwing compute at it, nothing fancy. OpenAI could probably do 1M token context too but they haven't yet found a way to make it profitable (neither have Google; the most they actually offer customers is 256k).

GitHub CoPilot charges $10 for a subscription that it loses an average (!) of $20 a user on. https://www.theregister.com/2023/10/11/github_ai_copilot_mic... "Make it profitable" appears a secondary concern in the AI space.

I started using it recently. $30, 50, or even $100 a month is litterly nothing for most companies in wester world. They'll hike up the prices eventually.

Re: Magic AI Secures $117M to Build an AI Software Engineer

#75
post #2

Maybe I'm naive, but I just don't feel threatened by this at all. As a software engineer, I'd love to have an AI engineer automate the boring stuff so I can work on higher-level architecture concerns.

I am feeling the same. Paying 100EUR/month for a competent AI junior programmer which I could offload simple or repetitive tasks on would be absolute banger. But so far AI is hype and crap code.

Re: Magic AI Secures $117M to Build an AI Software Engineer

#77
post #20

Earlier quoted context omitted.

> cost you 1 trillion dollars How did you come up with this number? It seems pretty unrealistic. > There is a reason why we still have people working at McDonald's even though fully automating it has been possible for a couple of decades now. Maybe the low salary is the reason? If it is a bit more costly to automate certain aspects of manual labor, then the low salaries might remove the incentive to do so. This is no…

Aw look, hn is reinventing capitalism from first principles!

Fwiw my question was rethorical.

And it was meant to highlight that even if you have the tech (which we don't - the cheap tricks chatgpt or copilot do are impressive but still cheap tricks - are super expensive when it comes to actually training the models) it may not make economic sense to deploy them.

Even if it makes sense to deploy them the social unrest and volatility that will result in society may not end up well. (What's the point if all the consumers go away or they cannot actually buy the shit you're producing)

Re: Magic AI Secures $117M to Build an AI Software Engineer

#78
post #4

Earlier quoted context omitted.

I wasn't worried until Google showed up with a 1M token context with 99.9% recall...

Some random team at Berkeley beat them to it by a couple days: https://largeworldmodel.github.io/ . It's just a matter of throwing compute at it, nothing fancy. OpenAI could probably do 1M token context too but they haven't yet found a way to make it profitable (neither have Google; the most they actually offer customers is 256k).

I believe that is where they are implying they do it without increasing memory utilization dramatically.

If 1M context uses 32x the memory of 32k, its a non-starter. Even a smallish LLM like Mixtral uses 4-8gb of memory just for your prompt. You would have 256+GiB at 1M...

Re: Magic AI Secures $117M to Build an AI Software Engineer

#79
post #68
post #57

Earlier quoted context omitted.

Beyond the snark, this is basically it. It's the same reason the Roman Empire, despite all its technological prowess, never tried hard to automate relatively low-hanging-fruit tasks: because slaves were cheap, plentiful, and more flexible ("reprogrammable") than anything mechanical could ever be. If it costs $1m p/y to run a machine that cooks burgers and fries, or $30k for an employee who can do that _and_ cover som…

> If a machine costs 500k p/y Do you mean an AI programmer would cost $500k per year? If so I think you greatly overestimate the cost. Recently I did some text processing with GPT-4 turbo (128k context) and I reached the daily limit of 5 million tokens. IIRC it cost me around $70 bucks for the day. I think $70 is the hourly rate of a SE with $150k salary working 40 hours per week. Note that we are at early stages wit…

"IIRC it cost me around $70 bucks for the day."

Sure, for you that was the price. Enterprise cost would be way different.

"Note that we are at early stages with this tech, it will probably only get cheaper from here."

Haha people who pay for these ai tools can only hope...Ask any cloud provider, streaming service, or utility company if their prices are cheaper now than before.

As these ai tools get better, they will require more resources to run (according to altman's 7 trillion dollar request) and most likely drive up the costs.

But hopefully you are right though, as i believe we as humanity would be best served spending as little money and resources as possible on AI.

Re: Magic AI Secures $117M to Build an AI Software Engineer

#80
post #63

No matter which side of the debate you fall on, it would be interesting to discuss the practical impact and timeframe of any AI software engineer. I think a realistic timeframe is about 15 years from the time someone releases a viable tool to complete replacement of the last engineer. About half way through the pressure on salaries will become noticeable. I base this guess on how companies typically operate and how l…

Im still fuzzy on this whole ai thing (as a dev)

Would our industry create a new job role such as "prompt engineer" aka "ai engineer supervisor" ??

Or would this ai developer be able to read jira/kanban tickets, cooperate with other "teammates", deploy fixes, etc with no major oversight?

Generally curious.

Post reply on HN