Live data from Hacker News

How I use LLMs to learn complex topics

laurentiugabriel.github.io

151–160 of 574 posts

Re: How I use LLMs to learn complex topics

#151

Earlier quoted context omitted.

What do you mean by this?

It’s a reference to Bernard Shaw, who once said that if we ever created a truly artificial mind it would be inside a turtle’s shell. Sturgill Simpson covered the track on his seminal work, Xeno’s Paradox.

an LLM tells me there is no evidence that Bernard Shaw ever said any such thing :)

Re: How I use LLMs to learn complex topics

#152

Earlier quoted context omitted.

What do you mean by this?

If the output can't be trusted, and you use another llm whose output can't be trusted to check the untrusted output of the first llm, then you're back where you started.

Yeah this seems to me similar to how the mortgage backed security risk concentration occurred leading up to the global financial crisis. Whereby the risk from exposure to low grade / risky single mortgages was eliminated via diversification but the diversification was simply packaging all of the risky MBS’s together and in no way diversified or de-risked the entire portfolio

Re: How I use LLMs to learn complex topics

#153

Earlier quoted context omitted.

What do you mean by this?

If the output can't be trusted, and you use another llm whose output can't be trusted to check the untrusted output of the first llm, then you're back where you started.

Not really. Take hallucinations for example. If they are 1 in 100 (actually they are much rarer, but for the sake of argument), then the chances that 2 LLMs or even just 2 runs of the same LLM have the same hallucination is, well, a lot less than 1 in 100.

Re: How I use LLMs to learn complex topics

#154
This animation is worse than useless. I've taught a lot of students. This is not learning, it's stamp collecting.

You're just memorizing a nonsensical recipe. What are the constraints? Why do we do X rather than Y? How does a particular thing scale? etc.

All you're doing is fooling yourself into thinking that you've acquired some knowledge. When in reality you haven't even learned the basic mental model to reason about this stuff.

You've learned something when you have a mental model that makes correct predictions. Until then you've memorized it at best, and as with most memorized things it will decay exponentially and will be gone from your memory soon enough.

Re: How I use LLMs to learn complex topics

#155

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

> LLM prose is annoyingly dense It's just long. It just doesn't shut up. It's overly verbose. And you can't tell it to be concise or you degrade its quality. If I ask what an integral is, the correct answer is that it is the continuos analog of a sum, generally used to calculate areas and volumes. It should really be a single sentence, and then let me ask more about the terms I don't understand, and here's the beauty…

I call that vomit shotgun answers, text from which you have to filter out all the extra info the LLM wasn’t asked for. Luckily you can control that behavior and make it behave closer to what you want. Just ask the LLM how to ask for it.

Re: How I use LLMs to learn complex topics

#156
post #31

> What you get is a beautiful animation that is 100% accurate and free of hallucinations. I'm not sure I follow how this is actually guaranteed? The fact-checking process mentioned just seems to involve asking AI to review its own work.

even if you say use RAG or something to a source you can trust, there's no guarantee the agent will still use exactly what the source has.

i can't even get agents to remember core instructions like "use jq instead of writing a python script to parse some json"..

Re: How I use LLMs to learn complex topics

#157
post #80

Earlier quoted context omitted.

I came across the socratic method recently, and have used it to learn a couple of topics that I was having trouble getting to stick. There are some SKILL.md's available for it. It works for concepts as opposed to facts, and causes the model to guide you to answers through your own reasoning, which is both much more engaging than reading a wall of LLM text and helps the information stick.

I was so annoyed I made a Socratic wrapper based on predefined curriculum: https://adaptive.bounded.cc Trying to diagrams/animations didn't yield good results even with frontier models. But pure text, any model does a decent job.

I didn't expect this to be hit by hundreds of request per minute.

So it may be very slow or become unavailable, back end can't handle that, no caching whatsoever.

Re: How I use LLMs to learn complex topics

#158

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

So you want it to teach you and take notes for you?

Re: How I use LLMs to learn complex topics

#159

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

To get rid of the llm prose issue you can take a representative sample of its prose (say a question and its answer), rewrite the answer in the way you'd prefer, and add that to the system prompt; I did this to get my LLMs to compress down what they say, and now everything they say is very dense and to the point

Re: How I use LLMs to learn complex topics

#160

I thought LLMs were a great tool for learning new topics - perhaps even complex ones. But overtime, I have had several frustrations with this. First, I get exhausted reading LLM prose. I really don't want to read anything generated by something like Opus 5 at this point. Second, as I dive deeper, I need a way to organize the information in a useful way as I begin to branch out in many different directions. I have tri…

I've decided that the main thing I'm building is my own mental model. You can take notes, create docs, put graphs and websites together, but unless I'm just trying to generate some reference material the only real objective is to develop the understanding and intuitions inside my own brain. So I have the LLM offer a very short explanation of something, and from there's it's just me asking questions. Anything that fee…

I do this too. I use Claude. I picked a voice I like. I go on a three mile walk. I will ask it questions about a topic that I want to learn about. If it starts telling me more than I want to hear right then, I will say "stop". It doesn't get offended. I then ask it something else. I find this very effective. I control it so it only explains to me what I want explained. If what it says sparks questions on a related topic I jump to a brand new topic. No personal tutor could keep up with this or adjust to exactly how I want to be addressed like Claude does. I'm very excited about the progress I'm making mastering new topics.

And yes, it is not that it is just presenting the facts. By me taking control of the direction the questions and answers go, I can flesh out my mental model. I won't retain every little thing it tells me. But I am much farther ahead than before.

Post reply on HN