Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Samsung workers made a major error by using ChatGPT

techradar.com

Post reply on HN
Print view View original

11–20 of 26 posts

Re: Samsung workers made a major error by using ChatGPT

#11

Post by sterlind »

brundolf wrote: post #10
ftxbro wrote: post #3

The article says "now in the wild after being leaked" but then it says "the data is impossible to retrieve as it is now stored on the servers belonging to OpenAI." So did the source code leak out of OpenAI into the wild, or are they saying that OpenAI itself is "the wild"? As far as I see from the article, it's not accessible to the general public.

If ChatGPT is trained on the data and ChatGPT is accessible to the general public, then the data may as well be accessible to the general public

it seems unlikely to me that ChatGPT is directly trained on chat data. if it is, we should see it know information past its knowledge cutoff. afaik that hasn't happened.

I assume the chat logs are instead training a reward model, which itself is then used as the reward function during RLHF training.

Re: Samsung workers made a major error by using ChatGPT

#12

Post by eachro »

brundolf wrote: post #9

I think the market is going to explode (if it hasn't already) for on-prem, or at least private, LLMs on par with ChatGPT. This could be served by companies building their own, or by open-source projects, or by OpenAI or OpenAI's competitors As a side-effect, this feels like a bright spot in the potentially authoritarian trajectory that AI could take as labor becomes less and less valuable. It encourages development o…

Open source is a race to the bottom. Seems like the only obvious winner then is people selling the shovels aka NVIDIA.

Re: Samsung workers made a major error by using ChatGPT

#13

Post by bigyikes »

sterlind wrote: post #11
brundolf wrote: post #10

Earlier quoted context omitted.

If ChatGPT is trained on the data and ChatGPT is accessible to the general public, then the data may as well be accessible to the general public

it seems unlikely to me that ChatGPT is directly trained on chat data. if it is, we should see it know information past its knowledge cutoff. afaik that hasn't happened. I assume the chat logs are instead training a reward model, which itself is then used as the reward function during RLHF training.

These models have a very long lead time before they’re released to the public. Maybe GPT-5 is being trained on ChatGPT logs. I’m not sure we’d be able to detect if this was happening.

Re: Samsung workers made a major error by using ChatGPT

#14

Post by esafak »

eachro wrote: post #12
brundolf wrote: post #9

I think the market is going to explode (if it hasn't already) for on-prem, or at least private, LLMs on par with ChatGPT. This could be served by companies building their own, or by open-source projects, or by OpenAI or OpenAI's competitors As a side-effect, this feels like a bright spot in the potentially authoritarian trajectory that AI could take as labor becomes less and less valuable. It encourages development o…

Open source is a race to the bottom. Seems like the only obvious winner then is people selling the shovels aka NVIDIA.

More like a race to the top: you're forgetting all the applications that will be built on top of these open source models.

Re: Samsung workers made a major error by using ChatGPT

#16

Post by eachro »

esafak wrote: post #14
eachro wrote: post #12

Earlier quoted context omitted.

Open source is a race to the bottom. Seems like the only obvious winner then is people selling the shovels aka NVIDIA.

More like a race to the top: you're forgetting all the applications that will be built on top of these open source models.

I'm not so sure. Does anyone pay for pytorch, numpy, tensorflow? In the matter of weeks we've seen llama.cpp, alpaca.cpp released to the public. Barrier to entry in this market is quickly going to zero.

Re: Samsung workers made a major error by using ChatGPT

#17

Post by rvz »

This is exactly why Wall St. and the major banks have banned their employees using ChatGPT [0] [1] [2]. It is called regulation and compliance.

Some companies drinking the AI koolaid just seem to love learning the hard way.

[0] https://www.wsj.com/articles/jpmorgan-restricts-employees-fr...

[1] https://tech.co/news/wall-street-banks-ban-ai-chatgpt

[2] https://www.bloomberg.com/news/articles/2023-02-24/citigroup...

Re: Samsung workers made a major error by using ChatGPT

#18

Post by rvz »

eachro wrote: post #12
brundolf wrote: post #9

I think the market is going to explode (if it hasn't already) for on-prem, or at least private, LLMs on par with ChatGPT. This could be served by companies building their own, or by open-source projects, or by OpenAI or OpenAI's competitors As a side-effect, this feels like a bright spot in the potentially authoritarian trajectory that AI could take as labor becomes less and less valuable. It encourages development o…

Open source is a race to the bottom. Seems like the only obvious winner then is people selling the shovels aka NVIDIA.

Finally someone is thinking. Stable Diffusion is already at the finish line to the bottom, since their AI model is already open source. Many other open source LLMs and DALL-E 2 alternatives are available competing against O̶p̶e̶n̶AI.com.

They are all gradually catching up and O̶p̶e̶n̶AI.com cannot run their services for free forever or even close to free. Eventually the price hikes will come in.

But as long as the AI industry continues to use inefficient methods of training, fine-tuning and inference via using tons of GPU hardware, NVIDIA will continue to smile at relying on this for a long time until a true breakthrough in efficient training and inference methods in neural networks on everyday desktop or typical servers.

Re: Samsung workers made a major error by using ChatGPT

#19

Post by galleywest200 »

rvz wrote: post #17

This is exactly why Wall St. and the major banks have banned their employees using ChatGPT [0] [1] [2]. It is called regulation and compliance. Some companies drinking the AI koolaid just seem to love learning the hard way. [0] https://www.wsj.com/articles/jpmorgan-restricts-employees-fr... [1] https://tech.co/news/wall-street-banks-ban-ai-chatgpt [2] https://www.bloomberg.com/news/articles/2023-02-24/citigroup...

For what its worth, this is only via the ChatGPT interface. Their terms of service state that API calls are not processed in the same manner for review and are deleted after 30 days.

I suppose these companies can build their own, in-house, Chat application.

Re: Samsung workers made a major error by using ChatGPT

#20

Post by jerojero »

eachro wrote: post #16
esafak wrote: post #14

Earlier quoted context omitted.

More like a race to the top: you're forgetting all the applications that will be built on top of these open source models.

I'm not so sure. Does anyone pay for pytorch, numpy, tensorflow? In the matter of weeks we've seen llama.cpp, alpaca.cpp released to the public. Barrier to entry in this market is quickly going to zero.

Has Pytorch and numpy's quality gone down though?

These projects are funded by several organisations that rely on them for their operations. This is the same for Linux, just because the software is accesible for free doesn't mean it's not funded.

I really want to see governments putting more funding on open source as well, public money, public code. As they say.

Post reply on HN