I would think you'd want to make something a little more bespoke to make it a fully-fledged feature, like interactive quizzes that keep score and review questions missed afterwards.
Study mode
311–320 of 828 posts
Re: Study mode
#312Earlier quoted context omitted.
>Now, everyone basically has a personal TA, ready to go at all hours of the day This simply hasn't been my experience. Its too shallow. The deeper I go, the less it seems to be useful. This happens quick for me. Also, god forbid you're researching a complex and possibly controversial subject and you want it to find reputable sources or particularly academic ones.
“The deeper I go, the less it seems to be useful. This happens quick for me. Also, god forbid you're researching a complex and possibly controversial subject and you want it to find reputable sources or particularly academic ones.” These things also apply to humans. A year or so ago I thought I’d finally learn more about the Israeli/Palestinians conflict. Turns out literally every source that was recommended to me by…
I've anecdotally found that real world things like these tend to be nuanced, and that sources (especially on the internet) are disincentivised in various ways from actually showing nuance. This leads to "side-taking" and a lack of "middle-ground" nuanced sources, when the reality lies somewhere in the middle.
Might be linked to the phenomenon where in an environment where people "take sides", those who display moderate opinions are simply ostracized by both sides.
Curious to hear people's thoughts and disagreements on this.
Re: Study mode
#313Re: Study mode
#314I'll personally attest: LLM's have been absolutely incredible to self learn new things post graduation. It used to be that if you got stuck on a concept, you're basically screwed. Unless it was common enough to show up in a well formed question on stack exchange, it was pretty much impossible, and the only thing you can really do is keep paving forward and hope at some point, it'll make sense to you. Now, everyone ba…
I'll personally attest anecdotes mean little in sound arguments. When I got stuck on a concept, I wasn't screwed: I read more; books if necessary. StackExchange wasn't my only source. LLMs are not like TAs, personal or not, in the same way they're not humans. So it then follows we can actually contemplate not using LLMs in formal teaching environments.
Re: Study mode
#315Earlier quoted context omitted.
I've found it excels at some things: 1) The broad overview of a topic 2) When I have a vague idea, it helps me narrow down the correct terminology for it 3) Providing examples of a particular category ("are there any examples of where v1 in the visual cortex develops in a disordered way?") 4) "Tell me the canonical textbooks in field X" 5) Posing math exercises 6) Free form branching--while talking about one topic, I…
These things are moving so quickly, but I teach a 2nd year combinatorics course, and about 3 months ago I tried th latest chatGPT and Deepseek -- they could answer very standard questions, but were wrong for more advanced questions, but often in quite subtle ways. I actually set a piece of homework "marking" chatGPT, which went well and students seemed to enjoy!
Re: Study mode
#316Earlier quoted context omitted.
I've found it excels at some things: 1) The broad overview of a topic 2) When I have a vague idea, it helps me narrow down the correct terminology for it 3) Providing examples of a particular category ("are there any examples of where v1 in the visual cortex develops in a disordered way?") 4) "Tell me the canonical textbooks in field X" 5) Posing math exercises 6) Free form branching--while talking about one topic, I…
>When I have a vague idea, it helps me narrow down the correct terminology for it so the opposite of Stack Overflow really, where if you have a vague idea your question gets deleted and you get reprimanded. Maybe Stack Overflow could use AI for this, help you formulate a question in the way they want.
Re: Study mode
#317Earlier quoted context omitted.
>Now, everyone basically has a personal TA, ready to go at all hours of the day This simply hasn't been my experience. Its too shallow. The deeper I go, the less it seems to be useful. This happens quick for me. Also, god forbid you're researching a complex and possibly controversial subject and you want it to find reputable sources or particularly academic ones.
“The deeper I go, the less it seems to be useful. This happens quick for me. Also, god forbid you're researching a complex and possibly controversial subject and you want it to find reputable sources or particularly academic ones.” These things also apply to humans. A year or so ago I thought I’d finally learn more about the Israeli/Palestinians conflict. Turns out literally every source that was recommended to me by…
That’s the single most important lesson by the way, that this conflict just has two different, mutually exclusive perspectives, and no objective truth (none that could be recovered FWIW). Either you accept the ambiguity, or you end up siding with one party over the other.
Re: Study mode
#318It is surprising that it is prompt based model and not RLHF. I am not an LLM guy but as far as I understand, RLHF did a good job converting a base model into a chat model (instruct based), a chat/base model into a thinking model. Both of these examples are about the nature of the response, and the content they use to fill the response. There are so many differnt ways still pending to see how these can be filled. Gene…
Re: Study mode
#319I'm currently learning Janet and using ChatGPT as my tutor is absolutely awful. "So what is the difference between local and var if they are both local and not global variables (as you told me earlier)?" "Great question, and now you are really getting to the core of it, ... " continues to hallucinate. It's a great tutor for things it knows, but it really needs to learn its own limits
Re: Study mode
#320Earlier quoted context omitted.
>Now, everyone basically has a personal TA, ready to go at all hours of the day This simply hasn't been my experience. Its too shallow. The deeper I go, the less it seems to be useful. This happens quick for me. Also, god forbid you're researching a complex and possibly controversial subject and you want it to find reputable sources or particularly academic ones.
My core problem with LLMs is as you say; it's good for some simpler concepts, tasks, etc. but when you need to dive into more complex topics it will oversimplify, give you what you didn't ask for, or straight up lie by omission. History is a great example, if you ask an LLM about a vaguely difficult period in history it will just give you one side and act like the other doesn't exist, or if there is another side, it…
People _do_ just wake up and decide to be evil.