When AI Costs More Than the Engineer
tomtunguz.com
When AI Costs More Than the Engineer
1–10 of 128 posts
Re: When AI Costs More Than the Engineer
#2Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
Re: When AI Costs More Than the Engineer
#3Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
I don't know, compute is compute. Arguably making complex software with LLMs isn't all that different from training a model to do a thing. You're throwing a lot of compute at the problem and hoping for a stochastic solution. The distinction will become even blurrier with time.
Though I agree it might be informative to split it by industry sector.
Re: When AI Costs More Than the Engineer
#4I'm not a VC guru but in my opinion you can't include the time and money it takes to grow a tree and mine the iron to compare the time it takes to hammer in a nail with a hammer versus using your fist.
Re: When AI Costs More Than the Engineer
#5A missing thread by the author for how Anthropic's training expenses becomes expenses for employee workplace expenses.
And this is before we start adding Anthropic engineer's ability to use it's tools/models for far less than market price.
Re: When AI Costs More Than the Engineer
#6Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
Apples and potatoes are both something people will need to eat if we want to see it from the human utility perspective, and they both require some land space to be allocated for their culture (though one can of course conjugate both culture).
If you want to take the DDG LLM summary at fate value, apples are lower in calories and sugar but higher in fiber compared to potatoes, which are richer in vitamins and minerals like potassium and vitamin B6. Overall, apples provide more dietary fiber, while potatoes offer more protein and essential nutrients.
Comparison rarely lead to one obvious all superior option that discard every other considerations.
Re: When AI Costs More Than the Engineer
#7Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
OpenAI and Anthropic aren't charities, so whatever cost they inccur for training will be passed down to the companies using the models. So you absolute should include it.
Re: When AI Costs More Than the Engineer
#8Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
I don't know, compute is compute. Arguably making complex software with LLMs isn't all that different from training a model to do a thing. You're throwing a lot of compute at the problem and hoping for a stochastic solution. The distinction will become even blurrier with time. Though I agree it might be informative to split it by industry sector.
AI training uses wildly more compute than most companies, who are generally building domain specific CRUD apps.
Compare AI costs per-engineer-salary-dollar, because more expensive engineers probably need more expensive AI.
Re: When AI Costs More Than the Engineer
#9Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
I don't know, compute is compute. Arguably making complex software with LLMs isn't all that different from training a model to do a thing. You're throwing a lot of compute at the problem and hoping for a stochastic solution. The distinction will become even blurrier with time. Though I agree it might be informative to split it by industry sector.
If you’re going to include AI training in costs, you should include education as part of the costs of an engineer …
Re: When AI Costs More Than the Engineer
#10Garbage. You can't include training by the companies that develop an llm in the comparison against companies that merely use the same llm. Apples and potatoes.
Exactly, it's like saying Shell is spending a fortune on fuel compared to what they spend on employees, if you count oil extraction costs as 'fuel'.