Live data from Hacker News

How I use LLMs to learn complex topics

laurentiugabriel.github.io

241–250 of 574 posts

Re: How I use LLMs to learn complex topics

#241

Earlier quoted context omitted.

What do you mean by this?

It’s a reference to Bernard Shaw, who once said that if we ever created a truly artificial mind it would be inside a turtle’s shell. Sturgill Simpson covered the track on his seminal work, Xeno’s Paradox.

Might be a reference to the story at the beginning of A Brief History of Time, attributed to Bertrand Russell’s audience member.

Full story in the book

Re: How I use LLMs to learn complex topics

#242
post #31

> What you get is a beautiful animation that is 100% accurate and free of hallucinations. I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.

Completely agree. While I didn't set things up to have AI review its output in a loop, my experience trying to build a specific acoustic testing rig with Opus 5 also aligns with the other "it's turtles all the way down" comment. Opus 5 first built me a detailed plan, but a couple important details were either obviously wrong or felt unnecessary. I went back and forth asking for sources and more information probably l…

A second agent reviewing it adversarially resolves some context rot. Whatever they trained these LLMs on will just infinitely double down so I break it with 1 layer of checking and then a judge who looks at facts, since the checker is adversarial.

I know it sounds silly but 1 layer ends uo being way worse than 2.

Re: How I use LLMs to learn complex topics

#243

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

Good to know other people who get migrane reading LLMs dense prose. I started reading books again recently, since everything online is polluted by LLM prose. What i realise, is that a human author, especially a teacher understands the learning pathways of new learners, they motivate the learning, and start from simplest concepts (a spherical cow), and then building all the complexities. This helps us to emphasize on…

Also they tend to assemble complex jargon in obtuse or meaningless ways, which makes reading and parsing and understanding much more difficult. Tends to reveal that LLMs fundamentally do not have "understanding", just likely word generation

Re: How I use LLMs to learn complex topics

#244

If you're using LLMs to learn or for research, and at some point you don't end up engaging with an actual resource (books, papers, lectures, web pages, etc) then you're playing yourself.

Sorta. If its response is grounded in actual material, and you're thorough, it's not so risky. As with all learning, trusting one source is a risk in itself. Hell, I didn't even trust my physics textbooks in college. Physics.

Re: How I use LLMs to learn complex topics

#245

Earlier quoted context omitted.

I've (elsewhere) written about this diminishing return effect on LLM utility in relation to increasing expertise. The question: what's the net positive gain of turning people who know nothing in a given field into sub-novices, while weighing actual experts down with work slop and marginal returns? And I wonder what the true cost is of arming so many novices with that level of dangerous knowledge.

The fact that some people get genuine value from LLMs when learning doesn’t contradict the fact that they’re Dunning-Krueger “expertise” generators. The fact that the person learning from them is in charge of ensuring they aren’t full of shit, which they frequently are, is an inescapable flaw in this process. I honestly think that reduces the value of these things to just above what you can find out with a search eng…

Sounds about right.

Tangentially, but related: I'm old enough to remember when the spirit of your comment was pervasive on HN.

Re: How I use LLMs to learn complex topics

#246
post #21

What’s everyone’s opinion on learning new tech things in this day and age? My opinion swings between positive and depressing vision of the future. I still learn new stuff, but I’m afraid it won’t have any value in a year or so. For example, I’m pretty good at optimizing low level stuff, but right now you can just ask LLMs to do so and they are pretty good at it. They will profile the code and suggest reasonable optio…

I sometimes get vague ideas for solving maths/science problems. They never pan out but i can talk in detail on group theory and advanced maths and science topics due to investigating such vague ideas over the years. These days the LLM shoots the ideas down instantly and honestly correctly, i know enough to know "yeah that's right, oh well" and move on. Which actually takes away a huge avenue of learning. I'm pretty t…

I felt this. I had a feeling for a long time that spider solitaire was somehow related to knot theory (legal moves being Reidemeister move equivalents and untangling). Llm shot this idea down very quickly! It was freeing actually.

Re: How I use LLMs to learn complex topics

#247

I've had success using the socratic method. I give Claude some topic (say, how the intricacies of the bond market works, the content from which are screenshots of pages from a textbook), and then I go on a walk chatting with it in voice mode. Claude is the expert, I am the student. Claude asks me questions, leading me to an answer logically. I come back with questions, and we back and forth. LLMs arent like they were…

can you share ane example of one of your prompts? I have tried to convert some text into the socratic method and haven't succeeded yet.

Re: How I use LLMs to learn complex topics

#248
The author says it's "100% accurate and free of hallucinations" but I am sceptical. Although I don't know much about chip production, when I ask LLMs about advanced topics like memory order LLMs tend to hallucinate more than entry-level questions. But the point is that I didn't found that LLM hallucinated before knowing it deeper. It's possible that LLM hallucinates but you don't find out because you are just learning it.

Re: How I use LLMs to learn complex topics

#249

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

[dead]

Re: How I use LLMs to learn complex topics

#250

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

> LLM prose is annoyingly dense, and the useful information gets lost in a bunch of noise

This is my biggest gripe with reading AI-generated text as well (ignoring the meta issue of whether it's worth taking the time to read something that an author didn't think was worth the time to write). It's gotten to the point that weird AI-style analogies just take me completely out of the text and kill my interest.

And I can usually tolerate a lot of purple prose.

Post reply on HN