Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hi everyone yes, I left OpenAI yesterday

twitter.com

Post reply on HN
Print view View original

361–370 of 472 posts

Re: Hi everyone yes, I left OpenAI yesterday

#361

Post by passion__desire »

dustingetz wrote: post #248
passion__desire wrote: post #163

Earlier quoted context omitted.

Become the next 3blue1brown. He has inspired many. Here's a gem of educator. Check out his other videos. https://www.youtube.com/watch?v=dhYqflvJMXc

this is disrupting education. you can get a better undergraduate education in STEM on youtube than my paid education 20 years ago. I think those visualizations can even pull forward a bunch of stuff into high school.

This was the point I made earlier. Consider Richard Feynman lectures. Why didn't universities collectively took the decision to create pre-made/cooked lecture videos for topics that don't change and show these videos during normal lecture which otherwise would be the job of professor to revise / prepare the topics the night before and deliver. The professor spends so much time in doing the same thing again and again everyyear. This would have freed them to have more discussion, office hours and so on.

Re: Hi everyone yes, I left OpenAI yesterday

#362

Post by kj99 »

fwip wrote: post #341
kj99 wrote: post #269

Earlier quoted context omitted.

> AI shouldn't be a part of warfare, IMHO. Nor should nuclear weapons, guns, knives, or cudgels. But we don’t have a way to stop them being used.

Sure we do. We enforce it through the threat of warfare and subsequent prosecution, the same way we enforce the bans on chemical weapons and other war crimes. We may lack the motivation and agreement to ban particular methods of warfare, but the means to enforce that ban exists, and drastically reduces their use.

We lack the motivation precisely because of information warfare that is already being used.

Re: Hi everyone yes, I left OpenAI yesterday

#363

Post by altintx »

Jensson wrote: post #354
joenot443 wrote: post #290

Earlier quoted context omitted.

Wow - that earnestly gave me goosebumps. I'm a Googler myself and it's humbling seeing him casually describe, 10 years ago, a technology the industry was still in the early stages of developing, which has since taken the world by storm. What a rockstar.

Neural networks were already big 10 years ago, you have to go back 15 years to see before they started being popular. From wikipedia: > Between 2009 and 2012, ANNs began winning prizes in image recognition contests, approaching human level performance on various tasks, initially in pattern recognition and handwriting recognition. That was when Neural networks became a big thing every tech person knew about, 2014 it w…

NN were already a casual topic in my high school computer science class more than 20 years ago. I've always assumed they were already fairly common by that point. (~2000)

Re: Hi everyone yes, I left OpenAI yesterday

#364

Post by coolThingsFirst »

dustingetz wrote: post #248
passion__desire wrote: post #163

Earlier quoted context omitted.

Become the next 3blue1brown. He has inspired many. Here's a gem of educator. Check out his other videos. https://www.youtube.com/watch?v=dhYqflvJMXc

this is disrupting education. you can get a better undergraduate education in STEM on youtube than my paid education 20 years ago. I think those visualizations can even pull forward a bunch of stuff into high school.

You can’t sorry.

Re: Hi everyone yes, I left OpenAI yesterday

#365

Post by aantix »

lyapunova wrote: post #60

Let me say, he's a great teacher! I took a CV class with him. He should teach more, and take it seriously. Being a popular AI influencer is not necessarily correlated with being a good researcher though. And I would argue there is a strong indication that it is negatively correlated with being a good business leader / founder. Here's to hoping he chills out and goes back to the sorely needed lost art of explaining co…

He should start a Patreon account.

Re: Hi everyone yes, I left OpenAI yesterday

#366

Post by kj99 »

foolofat00k wrote: post #327
qeternity wrote: post #320

Earlier quoted context omitted.

> the researchers involved didn't care because they wanted to be successful and figured they could just try to blame others for the consequences of their actions Such an absurdly reductive take. Or how about just like nuclear energy and knives, they are incredibly useful, society advancing tools that can also be used to cause harm. It's not as if AI can only be used for warfare. And like pretty much every technology,…

I think you're missing the point. I don't think we should have prevented the development of this tech. It's just absurd to complain about things that we always knew would happen as though they're some sort of great surprise. If we cared about preventing LLMs from being used for violence, we would have poured more than a tiny fraction our resources into safety/alignment research. We did not. Ergo, we don't care, we ju…

You say ‘we’ as if everyone is the same. Some people care, some people don’t. It only takes a a few who don’t, or who feel the ends justify the means. Because those people exist, the people who do care are forced into a prisoners dilemma forcing them to develop the technology anyway.

Re: Hi everyone yes, I left OpenAI yesterday

#367

Post by ein0p »

Al-Khwarizmi wrote: post #240
ein0p wrote: post #189

Earlier quoted context omitted.

That’s the correct answer. Years ago I worked on inference efficiency on edge hardware at a startup. Time after time I saw that users vastly prefer slower, but more accurate and robust systems. Put succinctly: nobody cares how quick a model is if it doesn’t do a good job. Another thing I discovered is it can be very difficult to convince software engineers of this obvious fact.

Less compute also means lower cost, though. I see how most people would prefer a better but slower model when price is equal, but I'm sure many prefer a worse $2/mo model over a better $20/mo model.

That’s the thing I’m finding so hard to explain. Nobody would ever pay even $2 for a system that is worse at solving the problem. There is some baseline compute you need to deliver certain types of models. Going below that level for lower cost at the expense of accuracy and robustness is a fool’s errand.

In LLMs it’s even worse. To make it concrete, for how I use LLMs I will not only not pay for anything with less capability than GPT4, I won’t even use it for free. It could be that other LLMs could perform well on narrow problems after fine tuning, but even then I’d prefer the model with the highest metrics, not the lowest inference cost.

Re: Hi everyone yes, I left OpenAI yesterday

#368

Post by CuriouslyC »

Keyframe wrote: post #357
CuriouslyC wrote: post #329

Earlier quoted context omitted.

If you can't get GPT4 to do coding questions you're prompting it wrong or not loading your context correctly. It struggles a bit with presentational stuff like getting correct HTML/CSS from prompts or trying to generate/update large functions/classes, but it is stellar at producing short functions, creating scaffolding (tests/stories) and boilerplate and it can do some refactors that are outside the capabilities of a…

so, mundane trivial things and/like web programming? I got it eventually to answer what I needed but it always liked to skip part of the code, inserting // TODO: important stuff in the middle, hence 'laziness' attribute. Maybe it is just lazy, who knows. I know I am since I'm prompting it for stuff.

I wouldn't say mundane/trivial as much as well trodden. I get good code for basic shaders, various compsci algorithms, common straightforward sql queries, etc. If you're asking for it to edit 500 line functions and handle memory management in a language that isn't in the top20 of the TIOBE index you're going to have a bad time.

The todo comments can be prompted against, just tell it to always include complete runnable code as its output will executed in a sandbox without prior verification.

Re: Hi everyone yes, I left OpenAI yesterday

#369

Post by Jensson »

altintx wrote: post #363
Jensson wrote: post #354

Earlier quoted context omitted.

Neural networks were already big 10 years ago, you have to go back 15 years to see before they started being popular. From wikipedia: > Between 2009 and 2012, ANNs began winning prizes in image recognition contests, approaching human level performance on various tasks, initially in pattern recognition and handwriting recognition. That was when Neural networks became a big thing every tech person knew about, 2014 it w…

NN were already a casual topic in my high school computer science class more than 20 years ago. I've always assumed they were already fairly common by that point. (~2000)

They were a scientific curiosity at that point, the widespread use in the industry happened around 10-15 years ago.

Re: Hi everyone yes, I left OpenAI yesterday

#370

Post by jamal-kumar »

Copenjin wrote: post #270
weinzierl wrote: post #79

Earlier quoted context omitted.

Andrej Karpathy is badmephisto, a name you might have heard of if you're into cubing. http://badmephisto.com/

10 years ago: https://youtu.be/WhPjlnWbtS8?feature=shared&t=359

Him solving a rubix cube and riding a bike at the same time is a pretty impressive demonstration of motor coordination
Post reply on HN