Live data from Hacker News

Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

thebullshitmachines.com

291–300 of 652 posts

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#291
Fantastic course and website, thank you professors for this valuable contribution.

I would ask for exercises and practices attached to the course that one could do to penetrate the BS - this would be invaluable as we increasingly get bombarded by ai-generated media. Indeed what is learning and education except critical thinking skills ? An un-intended consequence of LLMs is that they have triggered this conversation.

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#292
post #221

(while I work at OAI, the opinion below is strictly my own) I feel like the current version is fairly hazardous to students and might leave them worse off. If I offer help to nontechnical friends, I focus on: - look at rate of change, not current point - reliability substantially lags possibility, by maybe two years. - adversarial settings remain largely unsolved if you get enough shots, trends there are unclear - ig…

How does this help the students with their use of these tools in the now, to not be left worse off? Most of the points you list seem like defending against criticism rather than helping address the harm.

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#293
post #288

Not sure why everyone rates this. It’s full of very confidently made statements like “the AI has no ground truth” (obviously it does, it has ingested every paper ever), it “can’t reason logically” which seems like a stretch if you ever read the CoT of a frontier reasoning model and “can’t explain how they arrived at conclusions” where - I mean just try it yourself with o1, go as deep as you like asking how it arrived…

the machine is fooling you with a mimicry of reasoning. and you are falling for it.

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#294
very well done. Thank you.

btw, typo in lesson 11: "(2) understand how an LMM can help them" .. instead of LLM

IMO, "understanding" is the notion most endangered and the one which loss is with most catastrophic consequences, from all the possibly affected ones. It has never been very favored, but now is even worse than ever - it is thinned and abandoned en-masse.

Check brothers Strugatsky's Snail_on_the_Slope [0] , there's very stringent monologue of Peretz on the topic, ~~ page 11 [1]

[0] https://en.wikipedia.org/wiki/Snail_on_the_Slope

[1] https://strugacki.ru/book_19/768.html

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#295
post #288

Not sure why everyone rates this. It’s full of very confidently made statements like “the AI has no ground truth” (obviously it does, it has ingested every paper ever), it “can’t reason logically” which seems like a stretch if you ever read the CoT of a frontier reasoning model and “can’t explain how they arrived at conclusions” where - I mean just try it yourself with o1, go as deep as you like asking how it arrived…

> obviously it does, it has ingested every paper ever

Do you have a citation for such a claim?

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#296
post #288

Not sure why everyone rates this. It’s full of very confidently made statements like “the AI has no ground truth” (obviously it does, it has ingested every paper ever), it “can’t reason logically” which seems like a stretch if you ever read the CoT of a frontier reasoning model and “can’t explain how they arrived at conclusions” where - I mean just try it yourself with o1, go as deep as you like asking how it arrived…

the machine is fooling you with a mimicry of reasoning. and you are falling for it.

What is reasoning if not a chain of logically consistent thoughts?

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#297
I like it. It's pretty basic but it is very good for a broad audience and covered things many people don't understand. I liked that you mentioned not to anthropomorphize the model. We would greatly benefit from 50+ year old policymakers and more taking the course even more than 19 year old freshmen.

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#299

Earlier quoted context omitted.

the machine is fooling you with a mimicry of reasoning. and you are falling for it.

What is reasoning if not a chain of logically consistent thoughts?

fair, but "logically consistent thoughts" is a subject of deep investigation starting from the early euclidean geometry to the modern godel's theorems.

ie, that logically consistent thinking starts from symbolization, axioms, proof procedures, world models. otherwise, you end up with persuasive words.

Re: Modern-Day Oracles or Bullshit Machines? How to thrive in a ChatGPT world

#300
post #221

(while I work at OAI, the opinion below is strictly my own) I feel like the current version is fairly hazardous to students and might leave them worse off. If I offer help to nontechnical friends, I focus on: - look at rate of change, not current point - reliability substantially lags possibility, by maybe two years. - adversarial settings remain largely unsolved if you get enough shots, trends there are unclear - ig…

I read the whole course. Lesson 16, “The Next-Step Fallacy,” specifically addresses your argument here.
Post reply on HN