Earlier quoted context omitted.
In some domains (math and code), progress is still very fast. In others it has slowed or arguably stopped. We see little progress in "soft" skills like creative writing. EQBench is a benchmark that tests LLM ability to write stories, narratives, and poems. The winning models are mostly tiny Gemma finetunes with single-digit parameter counts. Huge foundation models with hundreds of billions of parameters (Claude 3 Opu…
It feels ironic if the only thing that the current wave of Ai enables (other than novelty cases) is a cutdown of software/coding jobs. I don't see it replacing math professionals too soon for a variety of reasons. From an outsiders perspective on the software industry it is like it's practioners voted to make themselves redundant - that seems to be the main takeaway of ai to normal non tech people ive chatted with. M…
I Am Tired of AI
881–890 of 1001 posts
Re: I Am Tired of AI
#882Earlier quoted context omitted.
Actually humans are much worse in this regard. The top performer on my team had a divorce and his productivity dropped by like a factor of 3 and quality fell of a cliff. Another example from just yesterday is I needed to solve a complex recurrence relation. A friend of mine who is good at math (math PhD) helped me for about 30 minutes still without a solution and a couple of false starts. Then he said try ChatGPT and…
I call absolute bullshit on that last one. There's no way ChatGPT solves a maths problem that a maths PhD cannot solve, unless the solution is also googleable in 30s.
Is anything googleable in 30s? It feels like finding the right combination of keywords that bypasses the personalization and poor quality content takes more than one attempt these days.
Re: I Am Tired of AI
#883The most depressing thing for me is the feeling that I simply cannot trust anything that has been written in the past 2 years or so and up until the day that I die. It's not so much that I think people have used AI, but that I know they have with a high degree of certainty, and this certainty is converging to 100%, simply because there is no way it will not. If you write regularly and you're not using AI, you simply…
> If you write regularly and you're not using AI, you simply cannot keep up with the competition. You're out. Only if you're competing on volume.
Re: I Am Tired of AI
#884Earlier quoted context omitted.
In some domains (math and code), progress is still very fast. In others it has slowed or arguably stopped. We see little progress in "soft" skills like creative writing. EQBench is a benchmark that tests LLM ability to write stories, narratives, and poems. The winning models are mostly tiny Gemma finetunes with single-digit parameter counts. Huge foundation models with hundreds of billions of parameters (Claude 3 Opu…
>But once a model is large enough to generate coherent sentences, persuasiveness kinda...stops. All large models are about equally persuasive. No runaway scaling laws are evident here. Isn't that kind of obvious? Even human speakers and writers have problems changing people's minds, let alone reliably.
Re: I Am Tired of AI
#885I'm tired of LLMs. Enough billions of dollars have been spent on LLMs that a reasonably good picture of what they can and can't do has emerged. They're really good at some things, terrible at others, and prone to doing something totally wrong some fraction of the time. That last limits their usefulness. They can't safely be in charge of anything important. If someone doesn't soon figure out how to get a confidence me…
I love how people are like "there's no use case" and there's already products on shelves. I see AI art everywhere, AI writing, customer support - already happened. You guys are naysaying something that already happened people already replaced jobs with LLMs and already profit due to AI. There are already startups with users where you provide a OPENAI_API_KEY, or customers where you provide theirs. If you can't see ho…
Is any of it adding value though? I can see that AI has made it easier to do SEO spam and make an excuse for your lack of customer support, just like IVR systems before it. But I don't believe those added any real value (they may have generated profits for their makers, but I think that was a zero- or negative-sum trade). Put it this way: is AI being used to generate anything that people are actually happy to receive?
Re: I Am Tired of AI
#886Earlier quoted context omitted.
In some domains (math and code), progress is still very fast. In others it has slowed or arguably stopped. We see little progress in "soft" skills like creative writing. EQBench is a benchmark that tests LLM ability to write stories, narratives, and poems. The winning models are mostly tiny Gemma finetunes with single-digit parameter counts. Huge foundation models with hundreds of billions of parameters (Claude 3 Opu…
It feels ironic if the only thing that the current wave of Ai enables (other than novelty cases) is a cutdown of software/coding jobs. I don't see it replacing math professionals too soon for a variety of reasons. From an outsiders perspective on the software industry it is like it's practioners voted to make themselves redundant - that seems to be the main takeaway of ai to normal non tech people ive chatted with. M…
If creating software becomes cheaper then that means I can transform all the ideas I’ve had into software cheaply. Currently I simply don’t have enough hours in the day, a couple hours per weekend is not enough to roll out a tech startup.
Imagine all the open source projects that don’t have enough people to work on them. With LLM code generation we could have a huge jump in the quality of our software.
Re: I Am Tired of AI
#887What do we value? What is our value system made up of?
This is, in my opinion, the Achille‘s heel of the current trajectory of the West.
We need to know what we are doing it for. Like the OP said, he is motivated by the human connectedness that art, music and the written word inspire.
On the surface, it seems we value the superficial smuckness of LLM-produced content more.
This is a facade, like so many other superficial artifacts of our social life.
Imperfect authenticity will soon (or sometime in the future) become a priceless ideal.
Re: I Am Tired of AI
#888Earlier quoted context omitted.
I feel like I’m being gaslit about these AI code tools. I’ve got the paid copilot through work and I’ve just about never had it do anything useful ever. I’m working on a reasonably large rails app and it can’t seem to answer any questions about anything, or even auto fill the names of methods defined in the app. Instead it just makes up names that seem plausible. It’s literally worse than the built in auto suggestion…
I'm in the same boat. I've tried a few of these tools and the output's generally been terrible to useless big and small. It's made up plausible-sounding but non-existent methods on the popular framework we use, something which it should have plenty of context and examples on. Dealing with the output is about the same as dealing with a code review for an extremely junior employee... who didn't even run and verify thei…
Exactly. And I’ve been telling myself „keep doing that, it lets them teach, otherwise they will never level up and be able to comfortably and reliably work on this codebase without much hand holding. This will pay off”. Which I still think is true to a degree, although less so with every year.
Re: I Am Tired of AI
#889Earlier quoted context omitted.
I don't use AI in my own blogging, but then, I don't particularly care whether or not someone reads my stuff (the ones that do, seem to like it). I have used it, from time to time, to help polish stuff like marketing fluff for the App Store, but I'd never use it verbatim. I generally use it to polish a paragraph or sentence. But AI hasn't suddenly injected untrustworthy prose into the world. We've been doing that, fo…
When I wrote about trust, I see that I made a mistake: most people seem to have understood it as being in regard to fake things. I just meant trust as in, it’s not AI-generated. Your comment about the fluff is exactly what I mean. I read some fluff that is AI-generated and some kind of disgust happens in my stomach, and I wish there was nothing written there at all. I just feel like it’s be best to not read anything…
As a lifelong engineer, I “grew up” with a somewhat antagonistic relationship with Marketing, so became used to disparaging their work, even if I had to change hats, myself, and act in a Marketing capacity.
I should have probably used the word “copy,” instead.
But you have a good point.
I think that one “legitimate” use for AI-generated text, will be for non-native speakers of a language, using it to correct their vocabulary.
For things like patents and papers, this is probably a good thing. AI can generate clear, concise vernacular. I often specify the reading level, in my prompts (usually tenth grade), so that the prose is accessible.
For things like presentation proposals; not so much. You may get a proposal that reads like it was written by an English professor, and the actual presentation is barely comprehensible.