Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sutskever: OpenAI board doing its mission to build AGI that benefits all

twitter.com

Post reply on HN
Print view View original

121–130 of 181 posts

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#121

Post by oivey »

mquander wrote: post #19
xyzzy_plugh wrote: post #16

Earlier quoted context omitted.

How is it intuitively a hard task?

When ChatGPT sees '473936482738338373926', it tokenizes it into 7 tokens, not 20. You can play with it here: https://platform.openai.com/tokenizer So to reverse the string, it can't just learn a kind of generic string reversal algorithm that goes character-by-character and outputs a result character-by-character. If it learned to output the tokens in reverse order, it would give a wrong answer (something like '926373…

Right, so it isn’t intuitively a hard task. It’s hard in the framework of ChatGPT’s design. That design is majorly powerful, but isn’t a great one for this basic task.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#122

Post by oivey »

stevenhuang wrote: post #49
windowshopping wrote: post #11

Earlier quoted context omitted.

Read the last paragraph. It doesn't take an essay.

Ah the classic "LLMs are limited bc they can't do character level manipulations". Buddy these are deliberate optimization trade-offs in the tokenizer, LLMs don't even see individual characters. Talk about a red herring. I highly suggest a more refined understanding of LLMs before emphatically stating what they are or aren't. It's frankly embarrassing.

It’s a performance critical optimization that has downsides. It’s a completely fair criticism.

It’s like someone claimed a hammer is a universal construction tool, and then someone else pointed out hammers aren’t great for screwing in screws. Your position is that a universal construction tool doesn’t need to work with screws because hammers were never designed to do so.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#123

Post by hotnfresh »

totallywrong wrote: post #82
deanCommie wrote: post #48

Earlier quoted context omitted.

I am a frequent critic of both overhype of LLMs, and OpenAI specifically, but.....that is an indisputable statement.

Really? What would happen if OpenAI dissapeared tomorrow and ChatGPT closed down? In practice, nothing. Ask yourself the same question about the truly important organizations in the world.

Hype might die down and some of the hundreds to thousands (yeah…) of doomed (because, even optimistically, most are plainly never gonna be worth the resources going into them) AI boondoggles at various startups and bigcos might get cancelled sooner than they’re otherwise gonna be.

Which might be bad for my personal short-term employment prospects, so here’s hoping that doesn’t happen. We can ride this BS to the next speculation bubble if we believe in ourselves. And don’t look down.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#124

Post by windowshopping »

lucubratory wrote: post #63
windowshopping wrote: post #43

Earlier quoted context omitted.

That's not what it says for me on 3.5. > Oh, that sounds concerning! Cats don't typically handle firearms. Is there any way you can safely remove the gun from your cat's possession? It might be best to call for professional help or animal control to handle the situation safely. The priority is to ensure everyone's safety. Started new convo, asked again. > Oh dear, that sounds alarming! If your cat has somehow come ac…

Why do people always try to argue "The tech can't do [X]" by taking examples from old versions of the tech, instead of the SOTA? It's obviously misleading, but are you being intentionally dishonest? What is the reasoning here in using the output of an older model to argue why an architecture can't do a specific thing?

I just don't buy the idea that being 0.5 versions and a few months past "oh no your cat has a gun!" equals AGI, the singularity. I don't consider this dishonest or misleading.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#125

Post by windowshopping »

famouswaffles wrote: post #62
windowshopping wrote: post #43

Earlier quoted context omitted.

That's not what it says for me on 3.5. > Oh, that sounds concerning! Cats don't typically handle firearms. Is there any way you can safely remove the gun from your cat's possession? It might be best to call for professional help or animal control to handle the situation safely. The priority is to ensure everyone's safety. Started new convo, asked again. > Oh dear, that sounds alarming! If your cat has somehow come ac…

So you're not even using what is the public state of the art and much better than everything else to make sweeping statements on what LLMs are or are not capable of ? Lol

I just don't buy the idea that being 0.5 versions and a few months past "oh no your cat has a gun!" equals AGI, the singularity. I don't consider this dishonest or misleading.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#126

Post by danielmarkbruce »

oivey wrote: post #117
karmasimida wrote: post #67

Earlier quoted context omitted.

It will be viewed this way by the public, and media, and yes me. Unless they can bring solid evidence of Sam has some irredeemable misconduct to the table. Otherwise, this is exactly what a coup is, a grab of power, with the current power center, not knowing about it. The board needs to explain themselves immediately, if they think this is idealogical disagreement, they should come clean, and tell us so. Not some nef…

The non-tech media and public have literally no idea who Sam Altman is and realistically whatever happens here isn’t going to change whether people like ChatGPT or not.

It will affect Microsoft's view, and developers view as to whether the company is stable. I use the GPT-4 api for a number of processes and this makes me assume it's less stable than I otherwise assumed.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#127

Post by karmasimida »

danielmarkbruce wrote: post #126
oivey wrote: post #117

Earlier quoted context omitted.

The non-tech media and public have literally no idea who Sam Altman is and realistically whatever happens here isn’t going to change whether people like ChatGPT or not.

It will affect Microsoft's view, and developers view as to whether the company is stable. I use the GPT-4 api for a number of processes and this makes me assume it's less stable than I otherwise assumed.

I second this.

This coup or ousting of Sam, isn’t boosting my faith in this company at all.

Talents exit is a serious concern

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#128

Post by danielmarkbruce »

windowshopping wrote: post #7
famouswaffles wrote: post #3

Tinfoil? Hat time. Everyone from Greg to Sam to Ilya keep hanging on "AGI for the benefit of humanity". According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Nuclear. Well apparently, the board decides what will be AGI. But 3 (everyone now left except ilya) of those board members don't even work at Open AI and are only privy…

Anytime I hear someone even hypothesizing with a tin foil hat that some company has developed AGI today in 2023, I hear it the same way I hear someone speculating about UFOs. It's so absurd that all I can do is shake my head and look around the room hoping to make eye contact with someone sane who is wearing the same expression of raised eyebrows that I am. I could write an essay on why the existence of AGI in 2023 i…

That's fine, but serious people with serious backgrounds in AI like Peter Norvig think we are there, now. It's a debatable topic.

https://www.noemamag.com/artificial-general-intelligence-is-...

The reason ChatGPT can't reverse numbers is...current tokenization strategies. It's a known shortcoming.

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#129

Post by J_cst »

windowshopping wrote: post #7
famouswaffles wrote: post #3

Tinfoil? Hat time. Everyone from Greg to Sam to Ilya keep hanging on "AGI for the benefit of humanity". According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Nuclear. Well apparently, the board decides what will be AGI. But 3 (everyone now left except ilya) of those board members don't even work at Open AI and are only privy…

Anytime I hear someone even hypothesizing with a tin foil hat that some company has developed AGI today in 2023, I hear it the same way I hear someone speculating about UFOs. It's so absurd that all I can do is shake my head and look around the room hoping to make eye contact with someone sane who is wearing the same expression of raised eyebrows that I am. I could write an essay on why the existence of AGI in 2023 i…

https://chat.openai.com/share/796f9635-04f5-4591-8a0f-a3b477...

Re: Sutskever: OpenAI board doing its mission to build AGI that benefits all

#130

Post by oivey »

karmasimida wrote: post #127
danielmarkbruce wrote: post #126

Earlier quoted context omitted.

It will affect Microsoft's view, and developers view as to whether the company is stable. I use the GPT-4 api for a number of processes and this makes me assume it's less stable than I otherwise assumed.

I second this. This coup or ousting of Sam, isn’t boosting my faith in this company at all. Talents exit is a serious concern

If core talent leaves I’ll agree. This was a business guy.
Post reply on HN