I'm curious how the 6 months have looked from a non-programmer's perspective. What kind of co-working tools and similar optimizations have people from other fields experienced?
[deleted]
The last six months in LLMs in five minutes
61–70 of 631 posts
Re: The last six months in LLMs in five minutes
#62If you're a vulnerability researcher or a security person generally, there's a big inflection point from Spring of this year.
Can you be more specific?
Re: The last six months in LLMs in five minutes
#63Earlier quoted context omitted.
> But 'Drawing of a Proper Duck' is almost arbitrary because it may have nothing to do with the 'Specific Duck You Wanted'. That might be the case, but Simon's case "Generate an SVG of a pelican riding a bicycle" is very different. The model actually has to understand what parts of a pelican and bicycle come together in something like an anatomically plausible way. That's a higher level of abstraction than something…
"That's a higher level of abstraction" No, it's not because it's seen 'anatomy' for Pelicans, Animals - even how it's represented in Animals. If you try to get the AI to actually decompose it and start to 'draw pelicans' in very obscure ways, it will immediately fail. Try to get the AI to draw the pelican form a very odd angle - like underneath, to the right, one wing extended, one wing not ... 0% chance. Precisely b…
Are we a long way away?
https://chatgpt.com/share/e/6a0bf28b-e198-8012-9a88-c777d965...
Re: The last six months in LLMs in five minutes
#64Somewhere right now some human artist is being tasked with drawing illustrations of pelicans riding bicycles to be used as training data at a big AI lab.
Every modern image-generation model can generate a pelican on a bicycle trivially. The point of the test is to generate SVG text that represents an image, which is more complicated. Yes, there are ways to convert raster images to SVG for use in training data but it's not a good use of anyone's time.
> Every modern image-generation model can generate a pelican on a bicycle trivially.
Mistral seems to be the exception. Their new model from a few weeks ago is worse then selfhosted gemma.
Re: The last six months in LLMs in five minutes
#65Earlier quoted context omitted.
> But 'Drawing of a Proper Duck' is almost arbitrary because it may have nothing to do with the 'Specific Duck You Wanted'. That might be the case, but Simon's case "Generate an SVG of a pelican riding a bicycle" is very different. The model actually has to understand what parts of a pelican and bicycle come together in something like an anatomically plausible way. That's a higher level of abstraction than something…
"That's a higher level of abstraction" No, it's not because it's seen 'anatomy' for Pelicans, Animals - even how it's represented in Animals. If you try to get the AI to actually decompose it and start to 'draw pelicans' in very obscure ways, it will immediately fail. Try to get the AI to draw the pelican form a very odd angle - like underneath, to the right, one wing extended, one wing not ... 0% chance. Precisely b…
> Try to get the AI to draw the pelican form a very odd angle - like underneath, to the right, one wing extended, one wing not ... 0% chance.
Proof by existence?
https://gist.github.com/nlothian/50241d34a654fcf0caa280d4475...
Looks pretty good to me. ChatGPT in "Thinking" model.
Edit: I've added the Opus version on the same link.
Re: The last six months in LLMs in five minutes
#66I'm curious how the 6 months have looked from a non-programmer's perspective. What kind of co-working tools and similar optimizations have people from other fields experienced?
Claude in Office was a tipping point for nontechnical folks around me. Everyone’s slides decks are immaculate now. Finance isn’t needing nearly as much BI help. It’s pretty impressive.
Re: The last six months in LLMs in five minutes
#67I wonder how much the 'inflection point' is a thing vs marketing. I'm sure the models got somewhat better, but even now when I'm trying to 'vibe code' a game with the latest models (combination of Codex w/ gpt5.5 and gpt5.3-codex), they really do struggle. They definitely get something barebones up and running, but it's far from a fully fledged application.
It's real for me as a non coder previously uploading a python script asking it to add this function or that function used to break it now usually it just works at least with Claude and Chat Gpt models. Google Gemini still breaks stuff but rumors are their new flash model that will be announced soon is very good. I am usually working with data in csv files and generating spreadsheet pdf etc and the results for that ha…
That’s me. Built a scraper do dump stuff to a csv of a list of images for further ocr and openCV processing. Now I have a convenient list of hits once I run the batch that used to be a loooot of manual sifting.
Once I work out the kinks, I’ll be able to further automate it.
Would have taken 10-100x as long for me to build it without AI and the AI version is probably better.
But yeah, I have enough knowledge to know what prompts are needed and figure out those “oh, I think it’s running slow or failing because of xyz” and further prompt to improve it based on that what I think it should do instead.
And I know where to make slight changes without burning my allotments.
Re: The last six months in LLMs in five minutes
#68Earlier quoted context omitted.
It's very real. Just in the past 2 months or so IMO there's been a pretty big improvement in claude for local dev (although I think a lot of that is less model strength and more harness capability). 1m context is a huge difference (~30 min vs 2.5hr between compact significantly increases the scope of what I get the AI to do before it goes stupid). The other biggest difference I've noticed is a better balance of actua…
>1m context is a huge difference (~30 min vs 2.5hr between compact significantly increases the scope of what I get the AI to do before it goes stupid) I think the smart zone stays within the first 100k tokens, no mater if the context window is 240k or 1 million. I divide the work to fit within that 100k and use subagent for the tasks.
In my experience it's more like 400-500k tokens.
Re: The last six months in LLMs in five minutes
#69Earlier quoted context omitted.
"That's a higher level of abstraction" No, it's not because it's seen 'anatomy' for Pelicans, Animals - even how it's represented in Animals. If you try to get the AI to actually decompose it and start to 'draw pelicans' in very obscure ways, it will immediately fail. Try to get the AI to draw the pelican form a very odd angle - like underneath, to the right, one wing extended, one wing not ... 0% chance. Precisely b…
Are we a long way away? https://chatgpt.com/share/e/6a0bf28b-e198-8012-9a88-c777d965...
Link doesn't work - maybe not public?
Re: The last six months in LLMs in five minutes
#70I'm curious how the 6 months have looked from a non-programmer's perspective. What kind of co-working tools and similar optimizations have people from other fields experienced?
In business: using coworking tools to review and propose filing of emails; manage my files and folders; on a daily basis scour the intranet for interesting and relevant content.
Personal: my wife tutors in her native language to non-native primary and high school kids. They are all using these tools now generate fresh content for practice based on school lesson plans. The kids are improving much more quickly now than they were just a few months ago.