AI Homework
stratechery.com
AI Homework
1–10 of 296 posts
Re: AI Homework
#2Oh thank God, I took a lot of poli-sci classes in college and read that ChatGPT output going, "holy shit, did I totally mis-remember Hobbes' whole deal, was all that time totally wasted if I've got the wrong idea about something that basic?" but no, ChatGPT was just wildly wrong. Phew.
Re: AI Homework
#3Oh thank God, I took a lot of poli-sci classes in college and read that ChatGPT output going, "holy shit, did I totally mis-remember Hobbes' whole deal, was all that time totally wasted if I've got the wrong idea about something that basic?" but no, ChatGPT was just wildly wrong. Phew.
I had no idea, and for me it was another wake up call not to believe everything I read, especially on the internet. I thought it was very well written, made perfect sense, and what motive would there be to lie or misattribute? So I believed and thought I had learned something.
I consider myself skeptical, but for things like this I don't have my radar on because it's not a hot topic issue that is known for misinformation. Now I feel like I have to be concerned and have my radar on (guard up) all the time, even if it's not about something controversial. I don't feel good about that.
Re: AI Homework
#4I finally went ahead and tried ChatGPT this morning (along with everyone else seemingly - it is now heavily rate-limited!) and I am truly blown away. I ask questions about various things (in my case, embedded systems development on the PineNote) and it gives the same quality of answers I would expect from a median coworker. Sure they're maybe not 100% correct, but most coworker answers aren't 100% correct either. They're at least in the right ballpark, and very rarely do we achieve detailed of knowledge of something from a single source - it's all about taking in info from various places and integrating them (conflicts and all) to derive a more-and-more-detailed grasp of the things we're learning about. The ability to ask questions about a specific thing (example: What are waveform files for e-ink screens? Followup: Is it possible to damage e-ink screens by modifying wave form files?) very quickly without having to sift through mountains of blogs and random Q/A websites and documentation and textbooks for the answer is incredibly useful.
Re: AI Homework
#5I finally went ahead and tried ChatGPT this morning (along with everyone else seemingly - it is now heavily rate-limited!) and I am truly blown away. I ask questions about various things (in my case, embedded systems development on the PineNote) and it gives the same quality of answers I would expect from a median coworker. Sure they're maybe not 100% correct, but most coworker answers aren't 100% correct either. The…
Youre commenting on an article where the answer was not even just a little wrong - it was completely wrong. Sometimes it’s “in the ballpark” - which is apparently t good enough these days - but often times it is just confidently entirely correct. How are you able to use such a tool as you propose practically?
Re: AI Homework
#6I finally went ahead and tried ChatGPT this morning (along with everyone else seemingly - it is now heavily rate-limited!) and I am truly blown away. I ask questions about various things (in my case, embedded systems development on the PineNote) and it gives the same quality of answers I would expect from a median coworker. Sure they're maybe not 100% correct, but most coworker answers aren't 100% correct either. The…
Youre commenting on an article where the answer was not even just a little wrong - it was completely wrong. Sometimes it’s “in the ballpark” - which is apparently t good enough these days - but often times it is just confidently entirely correct. How are you able to use such a tool as you propose practically?
I could easily imagine an ordinary person giving this exact same wrong answer (confusing Hobbes and Locke) - we're talking about value-over-replacement here!
In the process of learning things we take in wrong information all the time. A lot of it is even intentionally wrong, in the sense of being simplified. These are rarely large obstacles to true understanding. Sometimes they're even beneficial, as correcting prior beliefs can drive home the more accurate belief with greater force.
Re: AI Homework
#7There has been a lot of "well, we had a good run" comments on ChatGPT threads from engineers lately. I get where this sentiment is coming from, but I also think that the article paints a good picture of how we must "pivot" as a species to avoid faceplanting completely. Zero Trust Homework sounds like a strategy we will be forced to implement:
the system will frequently give the wrong answers (and not just on accident — wrong answers will be often pushed out on purpose); the real skill in the homework assignment will be in verifying the answers the system churns out — learning how to be a verifier and an editor, instead of a regurgitator.
Re: AI Homework
#8I love talking to GPT, but I've tried using it for some serious stuff (research, biz-dev) and less than serious stuff (Dungeons & Dragons) and the magic is still there but it has obvious blind spots which might be solved in the future but we're talking about the present.
I am wholly amused how everyone got on that dude from Google that accused the AI of being sentient and Google about not caring, and now you have huge names in the tech industry kinda drooling over this with what I believe to be the same passion.
One was ridiculed, the others will continue to be our 'heroes'.
Re: AI Homework
#9Earlier quoted context omitted.
Youre commenting on an article where the answer was not even just a little wrong - it was completely wrong. Sometimes it’s “in the ballpark” - which is apparently t good enough these days - but often times it is just confidently entirely correct. How are you able to use such a tool as you propose practically?
I could easily imagine an ordinary person giving this exact same wrong answer (confusing Hobbes and Locke) - we're talking about value-over-replacement here! In the process of learning things we take in wrong information all the time. A lot of it is even intentionally wrong, in the sense of being simplified. These are rarely large obstacles to true understanding. Sometimes they're even beneficial, as correcting prior…
If this were a test question, the response given would be marked wrong, likely with no partial credit awarded. It's that egregiously wrong, even if the attribution is perhaps understandable.
Re: AI Homework
#10Over these last couple quarters in school I have consistently put some of my homework questions into GPT-3. Actually cancelled my Chegg (boooooo) subscription because of it.