The increases in context size are helping a lot. The step improvement in reasoning abilities and quality of answers is amazing to watch. I'm currently using chat gpt o1 preview a lot for programming stuff. It's not perfect but I can use a lot of what it generates and this is saving me a lot of time lately. It still gets stuff wrong and there's a lot of stuff it doesn't know.
I also am mildly addicted to perplexity.ai. Just a wonderful tool and I seem to be getting in the habit of asking it about anything that pops into my mind. Sometimes it's even work related.
I get that people are annoyed with all the hyperbolic stuff in the media on this topic. But at the same time, the trends here are pretty amazing. I'm running the 3B parameter llama 3.2 model on a freaking laptop now. A nice two year old M1 with only 16GB. It's not going to replace bigger models for me. But I can see a few use cases for running it locally.
My view is very simple. I'm a software developer. I grew up a few decades ago before there was any internet. I had no clue what a computer even was until I was in high school. Things like Knight Rider, Star Trek, Buck Rogers, Star Wars etc. all featured forms of AIs that are now more or less becoming science fact. C3PO is pretty dumb compared to chat gpt actually. You could build something better and more useful these days. That would mostly an art and crafts project at this point. No special skills required. Just use an LLM to generate the code you need. Nice project for some high school kids.
Which brings me to my main point. We're the old generation. Part of being old is getting replaced by younger people. Young people are growing up with this stuff. They'll use it to their advantage and they are not going to be held back by old fashioned notions about the way the things should work according to us old people. The thing with Luddites is that they exist in any generation. And then they grow tired, old, and then they die off. I have no ambition to become irrelevant like that.
I'm planning to keep up with young people as long as I can. I'll have to give that up at some point but not just yet. And right now that includes being clued in as much as I can about LLMs and all the developer plumbing I need to use them. This stuff is shockingly easy. Just ask your favorite LLM to help you get started.