21–30 of 100 posts
I wonder it this one might be a bit more accessible, although I guess the R/Python examples are helpful on the latter.
I was also recently impressed by Zhaos "Mathematical Foundation of Reinforcement Learning", free textbook and video lectures on YT : https://github.com/MathFoundationRL/Book-Mathematical-Founda...
If you dont have a lot of time, at least glance at Zhaos overview contents diagram, its a good conceptual map of the whole field, imo .. here :
https://github.com/MathFoundationRL/Book-Mathematical-Founda...
and maybe watch the intro video.
Seems similar, or at least partially overlap, with what I would say is the best reference on the subject, an Introduction to Statistical Learning from Gareth James et al [1]. I wonder it this one might be a bit more accessible, although I guess the R/Python examples are helpful on the latter. [1] https://www.statlearning.com/
and frankly i would not recommend islr anymore today, too dated
This document is the lecture notes.
I think we’ll need a GUI for the models to democratize interpretability and let even gamers explore them. Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans. Simpler example: represent an LLM as a green field with objects, where humans are the only agents: You stand near a monkey, see chewing mouth nearby, go there (yo…
Maybe this is why tokens and language are so useful for humans ? they might be the closest analog we have.
This is great. Is it available as a printed book?
From a brief search I see that it isn't (or it least not yet), but seeing how well-formatted the pdf is, and the fact that it's CC-licensed, you could print it yourself, or perhaps talk with them to organize a batch. Though I personally prefer to read these sorts of books directly from pdf, and am grateful to them for sharing it on arxiv.
Seems similar, or at least partially overlap, with what I would say is the best reference on the subject, an Introduction to Statistical Learning from Gareth James et al [1]. I wonder it this one might be a bit more accessible, although I guess the R/Python examples are helpful on the latter. [1] https://www.statlearning.com/
not really, islr is a pretty basic book - this is about more advanced techniques to propagate probability estimates rather than point-wise and frankly i would not recommend islr anymore today, too dated
Books suck (imho). We need a new format to teach and learn this deep technical stuff. Not youtube, something interactive with exercises and engagement.
Current gen of LLM programming AIs might make it less leg-work to make these
I think we’ll need a GUI for the models to democratize interpretability and let even gamers explore them. Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans. Simpler example: represent an LLM as a green field with objects, where humans are the only agents: You stand near a monkey, see chewing mouth nearby, go there (yo…
I had a mind-bending Salvia trip at eighteen that went sort of like that. My mind turned into an infinitely large department store where each aisle was a concurrent branch of thought, and the common ingredient lists above each aisle were populated with words, feelings and concepts related to each branch. The PA system replaced my internal monologue, which I no longer had, but instead I was hearing my thoughts externa…
Many of these directives are contradictory. The coexistence of these contradictory programs is what we call inner conflict. This conflict causes us to constantly check ourselves while we are caught in the opposition of polarity. Another metaphor would be like a computer with many programs running simultaneously. The more programs that are running, the slower the computer functions. This is a problem then. With all the programs running that are demanded of our consciousness in this modern world, we have problems finding deep integration.
To complicate matters, the programs are reinforced by fear. Fear separates, love integrates. We find ourselves drawn to love and unity, but afraid to make the leap.
What I found to be the genius of LSD is that it really gets you high, higher than the programs, higher than the walls that mask and blind one to the energy destroying presence of many contradictory but hidden programs. When LSD is used intentionally it enables you to see all the tracks laid down, to explore each one intensely. It also allows you to see the many parallel and redundant programs as well as the contradictory ones.
It allows you to see the underlying unity of all opposites in the magic play of existence. This allows you to edit these programs and recreate superior programs that give you the insight to shake loose the restrictions and conflicts programmed into each one of us by our parents, our religion, our early education, and by society as a whole.”
~ Nick Sand, 2001, Mind States conference, quoted in Casey Hardison's obituary
Earlier quoted context omitted.
not really, islr is a pretty basic book - this is about more advanced techniques to propagate probability estimates rather than point-wise and frankly i would not recommend islr anymore today, too dated
What would you (or other informed parties) recommend?
for something more directly comparable to the niche ISLR filled, Bishop’s books are generally better - although I can’t recall their title