It's depressing for sure. Definitely the cause of some suicidal thoughts. I wonder how many people will actually start harming themselves because the value of their skills and self-worth will be destroyed.
What it feels like to work in AI right now
581–590 of 768 posts
Re: What it feels like to work in AI right now
#582Earlier quoted context omitted.
LLMs are already running distributed on swarms of computers. A swarm of swarms is just a bigger swarm. So again, what is the actual difference you are imagining? Or is it just that distributed X is fashionable?
Significantly higher latency than you have within a single datacenter. Think "my GPU working with your GPU".
There are already LLMs hosted across the internet (Folding@Home style) instead of in a single data center.
Just because the swarm infrastructure hosting an LLM has higher latency across certain paths does not make it a swarm of LLMs.
Re: What it feels like to work in AI right now
#583One of the most frustrating thing is that GPT-4 training was finished 6 months ago. It might as well be a decade in the current movement of things. What that mean: - OpenAI has such a large head start that they are only worried about safety, world disruption and getting people used to AGI. - The ideas/project you have was tested by them months ago and is probably irrelevant already. - Insiders have a huge advantage.…
Vicuna is much better
Re: What it feels like to work in AI right now
#584Earlier quoted context omitted.
Significantly higher latency than you have within a single datacenter. Think "my GPU working with your GPU".
There are already LLMs hosted across the internet (Folding@Home style) instead of in a single data center. Just because the swarm infrastructure hosting an LLM has higher latency across certain paths does not make it a swarm of LLMs.
> There are already LLMs hosted across the internet (Folding@Home style)
Interesting, I haven't heard of that. Can you name examples?
Re: What it feels like to work in AI right now
#585The annoying thing about AI is that it can do stuff but with like 90% accuracy. This means that if you want to do something that takes 10 AI steps, your accuracy is down to 35%. This is also why Copilot can't really do computer programming.
Context size of 32K tokens probably changes it a little. I think external memory patterns or just simply brute force and GPT-5 will fix that.
Re: What it feels like to work in AI right now
#586From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…
Yeah it is tiring, currently.
But soon people will just enter one goal, "make me money" and the program will go on a loop, pausing only when making an important decision to get the approval of the owner
Also, the input buffer of LLMs is increasing. Soon we will be able to begin with "write me a full 3D game"
Re: What it feels like to work in AI right now
#587Earlier quoted context omitted.
There are already LLMs hosted across the internet (Folding@Home style) instead of in a single data center. Just because the swarm infrastructure hosting an LLM has higher latency across certain paths does not make it a swarm of LLMs.
> There are already LLMs hosted across the internet (Folding@Home style) Interesting, I haven't heard of that. Can you name examples?
I read about Petals (1) some time ago here on HN. There are surely others too, but I don't remember the names.
Re: What it feels like to work in AI right now
#588From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…
I’ve got a codebase written in the extreme programming paradigm that has become a linchpin for operating our enterprise.
I can fire up an AI to build out my missing unit tests in 10 minutes what would take a developer 3 weeks to accomplish.
Scale that for 155 different projects … that’s over a year of development time in about 24 hours of compute
Re: What it feels like to work in AI right now
#589as a student, it is not a weird but interesting time to be in this space. while the hype is like web3 from a year or two ago, the "advancements" are confusing when you look deeper.
while i have a lot to learn, i am struggling to find real innovations being made in all the fancy models today. i feel that the major component of the recent developments is that we now have more money and hardware to throw into the problem. there are some clever methods employed for gpt and image GANs, but the core part is still the same decades-old theory we can finally achieve at larger scale than ever.
i'd like to be enlightened about what i am not understanding here, but it has only made it more important to start from the fundamentals.