Live data from Hacker News

AI is stifling new tech adoption?

vale.rocks

361–370 of 442 posts

Re: AI is stifling new tech adoption?

#361
post #339

The answer to this seems obvious: continuous training of live models. No more "cutoff dates": have a process to continually ingest new information and update weights in existing models, to push out a new version every week. Note that I said "obvious", not "easy", because it certainly isn't. In fact it's basically an unsolved problem, and probably a fiendishly difficult one. It may involve more consensus-based approac…

Talking to non-technical, but otherwise well-informed people, there is a broad assumption that AIs already "learn" as they're used for inference. IME people are surprised to find training and inference to be entirely separate processes. Human intelligence doesn't have such a stark distinction between learning and applied learning.

Re: AI is stifling new tech adoption?

#362
post #210

It's pretty interesting and mildly shocking that everyone is just making the same 'who needs a new JS library' joke. What about closed source tooling? How do you expect an AI to ever help you with something it doesn't have a license to know about? Not everything in the world can be anonymously scraped into the yearly revision. If AI is going to stay we'll have to solve the problem of knowledge segmentation. If we sol…

>What about closed source tooling? How do you expect an AI to ever help you with something it doesn't have a license to know about? Not everything in the world can be anonymously scraped into the yearly revision. This is not a novel problem. Proprietary toolchains already suffer from decreased resources on public forums like Stack Overflow; AI did not create this knowledge segmentation, it is scraping this public inf…

> This is not a novel problem. AI did not create this knowledge segmentation, it is scraping this public information after all.

I think you misunderstand the situation. You as a person can be privy to private knowledge. Relying on AI enough that you can't use that private knowledge is the novel situation.

> I do not see why AI code generation further incentivizing the use of the open-source solution is a problem.

Maybe you don't get it and have never experienced it but there's a missive amount of development done against unreleased APIs or hardware. Game engines, firmware, etc. I doubt Apple is going to publish new SDKs for their new widgets long before any devs use them.

Re: AI is stifling new tech adoption?

#363

Earlier quoted context omitted.

Strong disagree here. I've been trying to learn Zig, and I'm thwarted enough by chatgpt giving me outdated information on Zig's unstable API that if I didn't have a strong incentive to learn it for it's cross compiler, I'd likely turn my efforts towards another language. This effect can greatly alter the adoption curve of a new tech, which can leave it dying on the vine. You're not wrong though, in that Stack Overflo…

Have you considered learning by reading documentation and tutorials, instead of asking the lie generator? I mean, how do you think people learned things before 2023?

What about a library that doesn’t have any documentation or tutorials, like the Soundfont lib for JUCE where the LLM was essentially I had to get a working product?

Re: AI is stifling new tech adoption?

#364

Earlier quoted context omitted.

Have you considered learning by reading documentation and tutorials, instead of asking the lie generator? I mean, how do you think people learned things before 2023?

What about a library that doesn’t have any documentation or tutorials, like the Soundfont lib for JUCE where the LLM was essentially I had to get a working product?

Where did the LLM get information for the Soundfront lib if there is no documentation, tutorials, answered questions or source code online?

Re: AI is stifling new tech adoption?

#365
post #317

Earlier quoted context omitted.

Strong disagree here. I've been trying to learn Zig, and I'm thwarted enough by chatgpt giving me outdated information on Zig's unstable API that if I didn't have a strong incentive to learn it for it's cross compiler, I'd likely turn my efforts towards another language. This effect can greatly alter the adoption curve of a new tech, which can leave it dying on the vine. You're not wrong though, in that Stack Overflo…

Having spent the past week deep in cursor, it's amazing for building out a basic web app.. but getting it to a point of productivity takes a while.. Command line install for latest svelte.. nope npx install is now deprecated, have to do it another way.. ok, let's go old school and read the docs. Great, it's up and running, but nope, Svelte has just hit V5 and the LLM isn't aware of the changes.. ok, do I drop back to…

The unfortunate truth is that the one true way these days is React, and if you're doing anything else you're in for a world of pain.

Re: AI is stifling new tech adoption?

#367

Earlier quoted context omitted.

Have you considered learning by reading documentation and tutorials, instead of asking the lie generator? I mean, how do you think people learned things before 2023?

What about a library that doesn’t have any documentation or tutorials, like the Soundfont lib for JUCE where the LLM was essentially I had to get a working product?

Let's dig into this for a second.

Which "Soundfont lib for JUCE" are you talking about? How did you find it in the first place? Why did you decide to use it if there was no documentation? How did you know it was appropriate or capable for your use case? How did you know it was mature, stable, or safe? Did you read the headers for the library? Did they have comments? Did you read the technical specification for the Soundfont format to understand how it modeled sample libraries?

I work in this stuff all the time, and I'm so very puzzled by what you're even suggesting here.

Re: AI is stifling new tech adoption?

#369

Earlier quoted context omitted.

What about a library that doesn’t have any documentation or tutorials, like the Soundfont lib for JUCE where the LLM was essentially I had to get a working product?

Where did the LLM get information for the Soundfront lib if there is no documentation, tutorials, answered questions or source code online?

Same place every LLM gets "information" -- plucking random bits from the latent space that are most likely to follow the input context.

Re: AI is stifling new tech adoption?

#370

Earlier quoted context omitted.

It seems self-evident it will, and it's largely self-reinforcing. Less documentation/examples of new tech -> New model doesn't have enough info on new tech to be useful -> Less uptake of new technology -> Less documentation/examples to build a corpus.... I do wonder if this problem could get solved by basically providing documentation explicitly written for LLMs to consume and produce more detailed "synthetic" docume…

> Less documentation/examples of new tech -> New model doesn't have enough info on new tech to be useful -> Less uptake of new technology -> Less documentation/examples to build a corpus.... Q: Could it be that those who aren't relying on ChatGPT (or similar) might have a significant competitive advantage?

Just a head start. The LLM retraining cycle could probably become shorter and shorter over time.
Post reply on HN