Live data from Hacker News

Hi everyone yes, I left OpenAI yesterday

twitter.com

271–280 of 472 posts

Re: Hi everyone yes, I left OpenAI yesterday

#271
post #247

Earlier quoted context omitted.

I'm almost certain this is because you're getting use to chat bots. How would they honestly be getting worse? Initially it felt like the singularity was at hand. You've played with it, got to know it, the computer was taking to you, it was your friend, it was exciting then you got bored with your new friend and it wasn't as great as you remember it. Dating is often like this. You meet someone, have some amazing intim…

> I'm almost certain this is because you're getting use to chat bots. How would they honestly be getting worse? People say that, but I don't get this line of reasoning. There was something new, I learned to work with it. At one point I knew what question to ask to get the answer I want and have been using that form ever since. Nowadays I don't get the answer I want for the same input. How is that not a result of decl…

Could you share your findings re what questions to ask?

Re: Hi everyone yes, I left OpenAI yesterday

#273

Earlier quoted context omitted.

"allowing military use" That would actually increase their standing in my eyes. Not too far from where I live, Russian bombing is destroying homes of people whose language is similar to mine and whose "fault" is that they don't want to submit to rule from Moscow, direct or indirect. If OpenAI can somehow help stop that, I am all for it.

Yep. AI is, and will be used militarily. These virtue signaling games are childish.

It is indeed tragic that virtue is a childish trait among adults.

Re: Hi everyone yes, I left OpenAI yesterday

#274

Earlier quoted context omitted.

Google search got worse.

And Amazon search, youtube search. There do seem to be somewhat different incentives involved though, those examples are primarily about increasingly pushing lower quality content (ads, more profitable items, more engaging items) because it makes more money.

The incentive mismatch that I seem to be observing is that Wall Street is in constant need of new technical disruption. This means that any product that shows promise will be optimized to meet a business plan rather than a human need.

Re: Hi everyone yes, I left OpenAI yesterday

#275
post #267

Earlier quoted context omitted.

On the other hand, Israel is using AI to generate their bombing targets and pound Gaza strip with bombs non-stop [0]. And, according to UN, Turkey has used AI powered, autonomous littering drones to hit military convoys in Libya [1]. Regardless of us vs. them, AI shouldn't be a part of warfare, IMHO. [0]: https://www.theguardian.com/world/2023/dec/01/the-gospel-how... [1]: https://www.voanews.com/a/africa_possible-fi…

I would be very surprised if Turkey was capable of doing that. If they did, that's all Erdoğan would be talking about. Also it's a bit weird that the linked article's source is a Turkish name. (Economy and theology major too) I am not saying this is anything but it's definetely tingling my "something's up" senses.

Voice of America generally employs country's nationals for their reporting. There are some other resources:

    - NPR: https://www.npr.org/2021/06/01/1002196245/a-u-n-report-suggests-libya-saw-the-first-battlefield-killing-by-an-autonomous-d
    - Lieber Institute: https://lieber.westpoint.edu/kargu-2-autonomous-attack-drone-legal-ethical/
    - ICRC: https://casebook.icrc.org/case-study/libya-use-lethal-autonomous-weapon-systems
    - UN report itself (Search for Kargu): https://undocs.org/Home/Mobile?FinalSymbol=S%2F2021%2F229&Language=E&DeviceType=Desktop&LangRequested=False
    - Kargu itself: https://www.stm.com.tr/en/kargu-autonomous-tactical-multi-rotor-attack-uav
From my experience, Turkish military doesn't like to talk about all the things they have.

Re: Hi everyone yes, I left OpenAI yesterday

#276
post #96

Earlier quoted context omitted.

Running Ollama with a 80gb mistral model works as well if not better than ChatGPT 3.5. This is a good thing for the world IMO as the magic is no longer held just OpenAI. The speed at which competitors have caught up in even the last 3 months is astounding.

But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.

people do care in various ways

- price per thing you use it with matters (a lot)

- making sure that under no circumstances are the involved information leaked (included being trained on) matters a lot in many use cases, while OpenAI does by now have supports that the degree of you being able to enforce it is not enough for some use cases. In some cases this is a hard constraint due to legal regulations.

- geo politics matters, sometimes. Being dependent on a US service is sometimes a no go (using self hosted US software is most times fine, tho). Even if you only operate in the EU.

- it's much easier to domain adapt if the model is source/weight accessible in a reasonable degree, while GPT-4 has a fine tuning API it's much much less powerful a direct consequence of the highly proprietary nature of GPT-4

- a lot of companies are not happy at all if they become highly reliable on a single service which can change at any time in how it acts, the pricing model or it being available in your country at all. So basing your product on a less powerful but in turn replaceable or open source AI can be a good idea, especially if you are based in a country not at best terms with the US.

- do you trust Sam Altman at all? I do not and it seem short sighted to do so. In which case some of the points above become more relevant

- 3.5 level especially in combination with domain adoption can be "good enough" for some use cases

Re: Hi everyone yes, I left OpenAI yesterday

#277

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

Disagreeing here! I think we often overlook the value of excellent educational materials. Karpathy has truly revitalized the AI field, which is often cluttered with overly complex and dense mathematical descriptions. Take CS 231, for example, which stands as one of Stanford's most popular AI/ML courses. Think about the number of students who have taken this class from around 2015 to 2017 and have since advanced in AI…

I don’t think we disagree. Education is crucial and the value is enormous, but this hasn’t been what he was paid for in the past. I am hopeful that he finds a way to make this his job more directly than at Tesla or OpenAI as the whole world will benefit.

Re: Hi everyone yes, I left OpenAI yesterday

#278

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

Education and communication is important. It brings new people into the field, and helps grow those that are already part of the field, both of which are essential to long term growth and progress. Using phrases like “actual contribution” to refer to non-educational acts is entirely dismissive to the role that great educators play to in the march for progress. Where would you be today if such education was unavailabl…

His job at Tesla or OpenAI wasn’t as an educator though. I think a clearer version of my point is that most of his impact has come from activities he has done “on the side” and hasn’t gotten paid for from his job. I’m hopeful it can be his main gig now given that YouTube creators seem to be making more money.

Re: Hi everyone yes, I left OpenAI yesterday

#279

Let me say, he's a great teacher! I took a CV class with him. He should teach more, and take it seriously. Being a popular AI influencer is not necessarily correlated with being a good researcher though. And I would argue there is a strong indication that it is negatively correlated with being a good business leader / founder. Here's to hoping he chills out and goes back to the sorely needed lost art of explaining co…

My question is this, great educators like Karpathy make things from 'scratch' and explain in a way that I can understand. Is it a matter of the instructor ability to do this or it's a matter of the student(i.e. me) not having enough chops to understand material from elsewhere?

It's actually both!

A teacher can usually adapt the content depending on its audience, I would not teach the research in my field at the same level to professionals, PhDs, master students, bachelor students, amateurs, or even school students.

If what I'm teaching is fairly complex, it requires a lot of background that I could teach, but I would not have the time to do so, because it would be to the detriment of other students. So, while I usually teach 'from scratch', depending on my audience I will obfuscate some details (that I can answer separately if a question is asked) and usually I will dramatically change the speed of the lessons depending on the previous background, because I need to assume that the student has the prerequisite background to understand at that speed fairly complex material.

As an example, I gave some explanations to a student from zero to transformers, it took several hours with lots of questions, the same presentation to a teacher not in the field took me 1h30 and to a PhD in a related field took 25 minutes, the content was exactly the same, and it was from scratch, but the background in the audience was fairly different.

Re: Hi everyone yes, I left OpenAI yesterday

#280

Let me say, he's a great teacher! I took a CV class with him. He should teach more, and take it seriously. Being a popular AI influencer is not necessarily correlated with being a good researcher though. And I would argue there is a strong indication that it is negatively correlated with being a good business leader / founder. Here's to hoping he chills out and goes back to the sorely needed lost art of explaining co…

    He should teach more and take it seriously
Then he can go from being in the top .1% of income earners to the bottom .1%!

/s

Post reply on HN