That presentation was super underwhelming. We got to watch them compare… the vibes? … of 4.5 vs o1. No wonder Sam wasn’t part of the presentation.
Sam tweeted "taking care of my kid in the hospital": https://x.com/sama/status/1895210655944450446 Let's not assume that he's lying. Neither the presentation nor my short usage via the API blew me away, but to really evaluate it, you'd have to use it longer on a daily basis. Maybe that becomes a possiblity with the announced performance optimizations that would lower the price...
I think it's pretty clear he's a liar in most facets of his life
They are pretty useful tools. Do yourself a favor and get a $100 free trial for Claude, hook it up to Aider, and give it a shot. It makes mistakes, it gets things wrong, and it still saves a bunch of time. A 10 minute refactoring turns into 30 seconds of making a request, 15 seconds of waiting, and a minute of reviewing and fixing up the output. It can give you decent insights into potential problems and error messag…
> A 10 minute refactoring That's when you learn Vim, Emacs, and/or grep, because I'm assuming that's mostly variable renaming and a few function signature changes. I can't see anything more complicated, that I'd trust an LLM with.
I'm a Helix user, and used Vim for over 10 years beforehand. I'm no stranger to macros, multiple cursors, codebase-wide sed, etc. I still use those when possible, because they're easier, cheaper, and faster. Some refactors are simply faster and easier with an LLM, though, because the LSP doesn't have a function for it, and it's a pattern that the LLM can handle but doesn't exactly match in each invocation.
And you shouldn't ever trust the LLM. You have to review all its changes each time.
They are pretty useful tools. Do yourself a favor and get a $100 free trial for Claude, hook it up to Aider, and give it a shot. It makes mistakes, it gets things wrong, and it still saves a bunch of time. A 10 minute refactoring turns into 30 seconds of making a request, 15 seconds of waiting, and a minute of reviewing and fixing up the output. It can give you decent insights into potential problems and error messag…
> a $100 free trial What?
I misremembered, because I was checking out all the various trials available. I think I was thinking of Google Cloud's $300 in credits, since I'm using Claude through their VertexAI.
GPT 4.5 pricing is insane: Price Input: $75.00 / 1M tokens Cached input: $37.50 / 1M tokens Output: $150.00 / 1M tokens GPT 4o pricing for comparison: Price Input: $2.50 / 1M tokens Cached input: $1.25 / 1M tokens Output: $10.00 / 1M tokens It sounds like it's so expensive and the difference in usefulness is so lacking(?) they're not even gonna keep serving it in the API for long: > GPT‑4.5 is a very large and comput…
"GPT-4.5 is not a frontier model, but it is OpenAI’s largest LLM, improving on GPT-4’s computational efficiency by more than 10x."[1] I don't get it, it is supposedly much cheaper to run? [1] https://cdn.openai.com/gpt-4-5-system-card.pdf (page 7, bottom)
I speed up my algo that takes a bag-o'-floats by 10x.
If I put 100x floats in my bag-o'-floats, its still 10x slower :(
(extending beyond that point and beyond ELI5: computational efficiency implies multiplying the floats is faster, but you still need the whole bag o' floats, i.e no RAM efficiency gained, so you're still screwed on big-O for the # of GPUs you need to use)
That was impressive. If it all came from just this short 4-line prompt, it's even more impressive. All we're missing now is a text-to-video (or text+audio and then audio-to-video) that can convincingly follow the style instructions for emphasis and pausing. Or are we already there yet?
Yes, that was the full prompt. Yesterday, I had Claude 3.7 write a full 80,000-word novel. My prompt was a bit longer, but the result was shockingly good. The new thinking mode is very impressive.
I had been sleeping on Claude's ability to write books until a couple of days ago I had it write a novel set in the Accelerando universe. It whipped up a very convincing complete multi-Act 13 chapter side plot about humans learning to interact with Economics 2.0. It was quite good though I'm sure cstross would be horrified.
> AI crash is gonna lead to decade long winter Possibly. I am reminded of the dotcom boom and bust back in the 1990s By 2009 things had recovered (for some definition) and we could tell what did and did not work This time, though, for those of us not in the USA the rebound will be lead by Chinese technology In the USA no-one can say.
> AI as it stands in 2025 is an amazing technology, but it is not a product at all. Here I'm assuming "AI" to mean what's broadly called Generative AI (LLMs, photo, video generation) I genuinely am struggling to see what the product is too. The code assistant use cases are really impressive across the board (and I'm someone who was vocally against them less than a year ago), and I pay for Github CoPilot (for now) but…
> I genuinely am struggling to see what the product is too. They're nice for summarizing and categorizing text. We've had good solutions for that before, too (BERT, et al), but LLM's are marginally nicer. > Is there a market of people clamoring to use/get anything GenAI related? No. LLM's are lame and uncool. Kids especially dislike them a lot on that basis alone.
> LLM's are lame and uncool. Kids especially dislike them a lot on that basis alone.
That's interesting and the first time I hear of this. Could you provide any links that might elucidate this?
I write code for a living. My entire profession is on the line, thanks to ourselves. My eyes are wide open on the situation at hand though. Burying my head in the sand and pretending what I wrote above isn't true, isn't going to make it any less true. I'm not sure what I can do about it, either. My job already doesn't look like it did a year ago, nevermind a decade away.
I keep telling coders to switch to being 1-person enterprise shops instead, but they don't listen. They will learn the hard way when they suddenly find themselves without a job due to AI having taken it away. As for what enterprise, use your imagination without bias from coding.
I don't understand what you're trying to say. What is an enterprise here - give me an example.
The price really is eye watering. At a glance, my first impression is this is something like Llama 3.1 405B, where the primary value may be realized in generating high quality synthetic data for training rather than direct use. I keep a little google spreadsheet with some charts to help visualize the landscape at a glance in terms of capability/price/throughput, bringing in the various index scores as they become ava…
> https://docs.google.com/spreadsheets/d/1foc98Jtbi0-GUsNySddv ... how do you do the different size circles and colored sequences like that? this is god tier skills
hey, thank you! bubble charts, annotated with text and shapes using the Drawing tool. Working with the constraints of Google Sheets is its own challenge.
also - love the podcast, one of my favorites. the 3:1 io token price breakdown in my sheet is lifted directly from charts I've seen on latent space.
The price really is eye watering. At a glance, my first impression is this is something like Llama 3.1 405B, where the primary value may be realized in generating high quality synthetic data for training rather than direct use. I keep a little google spreadsheet with some charts to help visualize the landscape at a glance in terms of capability/price/throughput, bringing in the various index scores as they become ava…
Hey, just FYI, I pasted your url from the spreadsheet title into Safari on macOS and got an SSL warning. Unfortunately I clicked through and now it works, so not sure what the exact cause looked like.
I appreciate the bug report! Unfortunately this is a familiar and sporadically recurring issue with Netlify, which I should really move off of…