Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How I use LLMs to learn complex topics

laurentiugabriel.github.io

Post reply on HN
Print view View original

71–80 of 572 posts

Re: How I use LLMs to learn complex topics

#71

Post by hn_throwaway_99 »

wxw wrote: post #31

> What you get is a beautiful animation that is 100% accurate and free of hallucinations. I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.

Completely agree. While I didn't set things up to have AI review its output in a loop, my experience trying to build a specific acoustic testing rig with Opus 5 also aligns with the other "it's turtles all the way down" comment.

Opus 5 first built me a detailed plan, but a couple important details were either obviously wrong or felt unnecessary. I went back and forth asking for sources and more information probably like 4 times and every time it did the "in looking at things in more detail it appears my previous advice was incorrect" spiel. It just became exhausting at some point because it feels like it really lays bare how LLMs are just minimizing that loss function but don't actually "understand" anything. It was really useful as a search engine (it correlated some highly relevant source docs), but I just couldn't trust it to believe it was actually done at any step.

Re: How I use LLMs to learn complex topics

#73

Post by rl3 »

8bitsout wrote: post #48

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

>I really don't want to read anything generated by something like Opus 5 at this point.

Personally, I find that its generated prose tends to have an undue weight to it, almost as if every topic I ask about somehow bears a heavy burden, or is otherwise load-bearing, to use its parlance.

Quite puzzling, really.

Re: How I use LLMs to learn complex topics

#74

Post by tempacct2cmmnt »

wxw wrote: post #31

> What you get is a beautiful animation that is 100% accurate and free of hallucinations. I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.

Agreed. Given how many significant errors LLMs make in my topic of expertise, despite my taking multiple error checking steps, the idea of catching 100% of hallucinations because you told the LLM to check itself is hilarious. It’s just a wild lack of insight: “I’m using the LLM to teach me something I don’t know about, I definitely have the knowledge base to spot any errors that might remain!”

Re: How I use LLMs to learn complex topics

#75

Post by a3w »

wxw wrote: post #31

> What you get is a beautiful animation that is 100% accurate and free of hallucinations. I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.

I thought after reading the title that the text was about learning something, yet the actual text seems to be about having a system do something for me.

Re: How I use LLMs to learn complex topics

#77

Post by w10-1 »

Gamifying the presentation could make topics more accessible to others. For me the overhead wouldn't help with my own learning. Also I've been burned by just learning things mechanistically (e.g., coding, applying algebraic rules), so I'm leery of learning just by making flashcards or models of the topic.

I find LLM's do great for learning when I ask what are the principles, how the main applications work, what are the key drawbacks, where are the growth plates in the field, etc. - the kind of thing a good advisor points to. Sometimes I have to ask it explicitly to use topological order of topics and show relations, which often highlights the gradient changes in the learning curve. For pruning, it's surprisingly good applying philosophical heuristics - Occam's razor, or Derrida's differance (the difference that makes a difference), etc.

And finally, no learning is effective without problem sets, and for those LLM's at times get me over blocking issues.

The degenerate case is memorizing the glib phrases regurgitated back to me; they're helpful and functional enough to get me into real trouble!

Re: How I use LLMs to learn complex topics

#79

Post by roywiggins »

rl3 wrote: post #73
8bitsout wrote: post #48

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

> I really don't want to read anything generated by something like Opus 5 at this point. Personally, I find that its generated prose tends to have an undue weight to it, almost as if every topic I ask about somehow bears a heavy burden, or is otherwise load-bearing , to use its parlance. Quite puzzling, really.

It has a sort of metronomic quality. It never slows down or speeds up or modulates its tone. It plods forward at a relentless pace and never has a light touch with anything.

I think this is one reason why LLM text is pretty exhausting to read for long stretches.

Re: How I use LLMs to learn complex topics

#80

Post by gb2d_hn »

copperx wrote: post #53
8bitsout wrote: post #48

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

It's much better to feed the book to the LLM and ask questions as you read along, instead of asking the LLM to basically write a custom book for you from scratch.

I came across the socratic method recently, and have used it to learn a couple of topics that I was having trouble getting to stick. There are some SKILL.md's available for it. It works for concepts as opposed to facts, and causes the model to guide you to answers through your own reasoning, which is both much more engaging than reading a wall of LLM text and helps the information stick.
Post reply on HN