Live data from Hacker News

Anyone else witnessing a panic inside NLP orgs of big tech companies?

old.reddit.com

361–370 of 527 posts

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#361
post #316
post #304

Earlier quoted context omitted.

I was with that site until it compared the US budget to a household budget with a credit card. The average American family doesn't control the federal reserve or set interest rates and employs zero economists, so that seems like a dumb way to think about the problem.

I'll note that the US government, by design, does not control the Fed. International bankers control the Fed.

The Fed is appointed by the President. That's a heluva influence.

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#362

I see chatGPT as eliminating an awful lot of drudgery. For example, back in the 60's my dad was working on his book. The text was typed out double spaced, and he (and others) would make corrections. After a while, my mom would retype the whole thing. Imagine typing a whole book. Again and again and again. She'd type hour after hour. It's dehumanizing. And then came word processors. What a magical revolution! You coul…

It sounds like you’re giving a lot of human ‘occupations’ a whole lot of undeserved credit. There are stark differences between these two scenarios. Remixing existing ideas in an incredibly abstract way is not drudgery, it’s what a lot of people do, and get enjoyment out of.

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#363

Earlier quoted context omitted.

Imagine the devastation wrought by automatic looms, that put all the weavers out of a job! 97% of jobs used to be working on the farm. Now it's something like 2%.

Can't wait for the economy that is 97% twitch streamers because that's all what humans are left qualified for. /s

AI will take the twitch streaming jobs too

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#364
post #154

Wow - this is just wild. I've seen lots of arguments around "AI won't take everyone's job, it will just open up new areas for new jobs." Even if you take that with the benefit of the doubt (which I don't really think is warranted): 1. You don't need to take everyone's job. You just need to take a shitload of people's jobs. I think a lot of our current sociological problems, problems associated with wealth inequality,…

> Imagine if you spent your entire career working on NLP, and now find GPT-4 will run rings around whatever you've done. What do you do now? I have been doing NLP since 1993. Before ca. 1996, there were mostly rule-based systems that were just toys. They lacked robustness. Then statistical systems came up and things like spell-checking (considering context when doing it), part of speech tagging and eventually even pa…

Rich Socher had this to say about the transition to neural networks: "Chris Manning also, to his credit – when I came to him and I had all these ideas from the computer vision world and neural networks, I still remember that meeting – he said, "Look, I don't know anything about neural networks right now either, but I'm willing to learn, and we'll get through it together." And obviously he knew everything there is about NLP in general." Adapt or die.

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#365

The PR folks at my current company are in full panic mode on Linkedin, judging from the passive-aggressive tone of their posts (sometimes very nearly begging customers not to use ChatGPT and friends). They fully understand that LLMs are stealing lunch money from established information retrieval industry players selling overpriced search algorithms. For a long time, my company was deluded about being protected by ins…

How did GPS tracking companies survive Google and Google Maps? I think there will probably be many niches to explore even as the big names work hard to compete and eventually commoditize LLMs

Like TomTom?

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#367
post #149

Earlier quoted context omitted.

I think you and the one you're replying to are both very right. Yes, more of this money is going, instead of middle-class workers, straight to the capital class who own the "machines" that do the work people used to do. Except instead of it being a factory that makes industrial machines owned by some wealthy industrialist, the machines are things like Google and AWS and the owners are the small number of people with…

> but you could take lots of retail or clerical jobs, advance through hard work and support a family on those wages. Those are the days that are super gone Only in certain places, and only mostly due to crazy policies that made housing ridiculously unaffordable. I'm in an area where my barber lives on 10 acres of land he didn't inherit and together with his wife raises two children. This type of relaxed life is possi…

I am curious if your barber can afford health insurance plus out of pocket maximums for a family of four ($30k+ per year just in premiums plus $5k to $10k oop max), not to mention short and long term disability insurance in case he gets hurt and cannot work.

The only situation I can imagine would be if the wife has a government job with extremely generous health insurance subsidies.

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#369
post #149
post #135

Earlier quoted context omitted.

> I think a lot of our current sociological problems, problems associated with wealth inequality, etc., I see where you’re coming from, but is this really the main source of the inequality? Based on numbers relating to workers’ diminishing share of profits, it seems to be that the capital class has been able to take a bigger piece of the profit pie without sharing. In the past, companies have shared profits more wide…

I think you and the one you're replying to are both very right. Yes, more of this money is going, instead of middle-class workers, straight to the capital class who own the "machines" that do the work people used to do. Except instead of it being a factory that makes industrial machines owned by some wealthy industrialist, the machines are things like Google and AWS and the owners are the small number of people with…

Look .. I am one of the working class here. But I gotta point out. Our standard of living is far superior to someone living in 1970 when it comes to stuff/technology. The stuff is cheaper because of China/globalization. The tech is there because we outsourced production and kept specializing the work force.

I don't think UBI is the solution. Nor is squeezing people more than they are being squeezed. Efficiency and productivity are good things. What is wasteful are things like make-work programs like the DMV or other govt office. That crap needs to be automated away. Hospitals need more funding. Schools are unclear. I think schools would benefit from privatization. I don't think the same of hospitals. Not sure why.

Re: Anyone else witnessing a panic inside NLP orgs of big tech companies?

#370
post #154

Earlier quoted context omitted.

> Imagine if you spent your entire career working on NLP, and now find GPT-4 will run rings around whatever you've done. What do you do now? I have been doing NLP since 1993. Before ca. 1996, there were mostly rule-based systems that were just toys. They lacked robustness. Then statistical systems came up and things like spell-checking (considering context when doing it), part of speech tagging and eventually even pa…

> Another issue is that for many tasks, no much data is actually available. The big corps like Google/Meta etc. push the big ¨foundational¨ models because in the consumer space there is ample data available. But there are very important segments (notably in the professional space - applications for accountants, lawyers, journalists, pharmacologists - all of which I have conducted projects in/for), where training data…

Not as big a deal as you thin. Embedding chunking and retrieval already works well for any arbitrary outside knowledge (database, books, Codebase etc)
Post reply on HN