Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

LLM Visualization

bbycroft.net

Post reply on HN
Print view View original

131–138 of 138 posts

Re: LLM Visualization

#131

Post by stevenbedrick »

BOOSTERHIDROGEN wrote: post #62
albertzeyer wrote: post #55

Earlier quoted context omitted.

The audience of this paper are other researchers who already know the concept of attention, which was very well known already in the field. In such research papers, such things are never explained again, as all the researchers already know this or can read other sources, which are cited, but focus on the actual research questions. In this case, the research question was simply: Can we get away by just using attention…

What books cover exclusively about this topic ? Thanks

To add to the excellent resources that have already been posted, Chapter 9 of Jurafsky and Martin's "Speech and Language Processing" has a nice overview of attention, and the next chapter talks specifically about the Transformer architecture: https://web.stanford.edu/~jurafsky/slp3/

Re: LLM Visualization

#132

Post by bbycroft »

SiempreViernes wrote: post #112

Anyone know if there is a name for this 3D control schema? This feels like one of the most intuitive setups I've ever used.

Author here! Thanks, you'll find the code in https://github.com/bbycroft/llm-viz/blob/main/src/llm/Canvas... I don't know a name for it, I just made it up.

But for me it's really broken haha

1) When you zoom, the cursor doesn't stay in the same position relative to some projected point 2) Panning also doesn't pin the cursor to a projected point, there's just a hacky multiplier there based on zoom

The main issue is that I'm storing the view state as target (on 2D plane) + euler angles + distance. Which is easy to think about, but issues 1 & 2 are better solved by manipulating a 4x4 view matrix. So would just need a matrix -> target-vector-pair conversion to get that working.

Re: LLM Visualization

#133

Post by bbycroft »

johnklos wrote: post #87

Am I the only one getting "Application error: a client-side exception has occurred (see the browser console for more information)." messages?

My bad, this is likely WebGL2 support, as others have pointed out. Now I show a message on the canvas area if that's the case.

I wasn't expecting it to get quite this popular, so hadn't handled this (rather major) edge case.

Re: LLM Visualization

#134

Post by wills_forward »

blackbear_ wrote: post #111
nocoder wrote: post #94

Earlier quoted context omitted.

What a nice comment!! This has been a big failing of my mental model. I always believed if I was smart enough I should understand things without effort. Still trying to unlearn this....

That is a surprisingly common fallacy actually; I think you will find this book quite helpful to overcome it: https://www.penguinrandomhouse.com/books/44330/mindset-by-ca...

Aw thanks for such encouragement all

Re: LLM Visualization

#135

Post by SiempreViernes »

bbycroft wrote: post #132
SiempreViernes wrote: post #112

Anyone know if there is a name for this 3D control schema? This feels like one of the most intuitive setups I've ever used.

Author here! Thanks, you'll find the code in https://github.com/bbycroft/llm-viz/blob/main/src/llm/Canvas... I don't know a name for it, I just made it up. But for me it's really broken haha 1) When you zoom, the cursor doesn't stay in the same position relative to some projected point 2) Panning also doesn't pin the cursor to a projected point, there's just a hacky multiplier there based on zoom The main issue is th…

You know what, I think the panning being pinned to a specific plane is actually great, it means you actually pan across the surface of the object instead of mostly moving it out of the viewport like in this example:

https://connectivity.brain-map.org/3d-viewer?v=1&types=PLY&P...

This pinning to one single plane works really well in this particular case because what you are showing is mostly a flat thing anyway, so you don't have much reason to put the view direction close to the plane. A straightforward extension of this behaviour would be to add a few more planes, like one for each of the the cardinal directions and just switch which plane is the one the panning happens in, might be interesting to try for a more rounded object.

To me the zoom seems to do what is expected, zooming around the cursor position tends to be disorientating in 3D anyway, though maybe I didn't understand what problem you complained about.

Re: LLM Visualization

#136

Post by SiempreViernes »

bbycroft wrote: post #132
SiempreViernes wrote: post #112

Anyone know if there is a name for this 3D control schema? This feels like one of the most intuitive setups I've ever used.

Author here! Thanks, you'll find the code in https://github.com/bbycroft/llm-viz/blob/main/src/llm/Canvas... I don't know a name for it, I just made it up. But for me it's really broken haha 1) When you zoom, the cursor doesn't stay in the same position relative to some projected point 2) Panning also doesn't pin the cursor to a projected point, there's just a hacky multiplier there based on zoom The main issue is th…

Should add I'm using keyboard and mouse, haven't tested it with a touch interface.

Re: LLM Visualization

#137

Post by 3abiton »

itslennysfault wrote: post #126
flockonus wrote: post #64

Twitter thread by the author sharing some extra context on this work: https://twitter.com/BrendanBycroft/status/173104295714982714...

Thanks for sharing. This is a great thread. Since X now hides replies for non-logged in user here is a nitter link for those without an account (like me) that might want to see the full thread. https://nitter.net/BrendanBycroft/status/1731042957149827140

I wish it could integrate other open source LLMs in the backend, but this is already an amazing viz.
Post reply on HN