Viewing profile — tylerneylon

In case anyone is curious about _why_ light bends when it enters a lens: First, light apparently slows down in some materials because the photons are constantly interacting with el…

I have been a similar situation before. Yes, walk away — and learn what you can. There's one easy part of your situation, which is that your immediate next step is clear. I think i…

PS After I wrote my comment, I realized: of course, AI could one day get better at the things that make it not-perfect in pure math today: * AI could get better at thinking intuiti…

I agree with the overt message of the post — AI-first folks tend to think about getting things working, whereas math-first people enjoy deeply understood theory. But I also think t…

If I understand this correctly, the argument seems to be that when an LLM receives conflicting values, it will work to avoid future increases in value conflict. Specifically, it wi…

Essentially all modern machine learning techniques have internal mechanisms that are very closely aligned with certainty. For example, the output of a binary classifier is typicall…

PS My comment above is aimed at hn readers who are curious about LLM uncertainty. To the authors of the post / repo: looks cool! and I'd be interested to see some tests on how well…

I couldn't figure out if this project is based on an academic paper or not — I mean some published technique to determine LLM uncertainty. This recent work is highly relevant: http…

Thank you!

I like the font, images, and layout of this article. Does anyone happen to know if a tool (that I can also use) helped achieve this look? Or if not, does anyone know how to reach t…

Here's some context and a partial summary (youoy also has a nice summary) -- Context: A random forest is an ML model that can be trained to predict an output value based on a list …

I have a question for fellow color science nerds. I've been reading through Guild's original data: https://royalsocietypublishing.org/doi/pdf/10.1098/rsta.1932... However, I'm havi…

This page is also a beautiful explanation of color spaces, with chromaticity explained toward the end: https://ciechanow.ski/color-spaces/ Note that many of the diagrams are intera…

Thanks!

There's a ton missing from the article, and certain social training or skills are a big part of that. Although it's not spelled out in the article, I'm hoping that the feature of a…

Author here: I'm grateful for the comments; thanks especially for interesting references. Context for the article: I'm working on an ambitious long-term project to write a book abo…

The idea of "agency" I have in mind is simply the option to take action at any point in time. I think the contradiction you see is that the model would have to form a completion to…

Thanks for the reference! I've added this to my research list.

Replying to: How would a model intelligently switch between listening or speaking modes? What data would you train on? (I'm the author of the parent article.) It's a fair question,…

I'm a fan of most of what Knuth has done, and in particular I love the high quality _output_ of the TeX family. But TeX's language is extremely difficult to use. I suspect this is …

If you’re wondering why there’s no demo graphic, it’s because this idea is meant to produce correct results (in a bug-robust way), not anything different. One thing that can go wro…

Not sure if this is a common problem, but I built a tool to help me quickly understand the main schema, and where most of the data is, for a new JSON file given to me. It makes the…

Awesome video. This helps to show how the Q*K matrix multiplication is a bottleneck, because if you have sequence (context window) length S, then you need to store an SxS size matr…

I had heard that IV might be considered sacrilegious, as the god Jupiter would have once been spelled IVPPITER, as I was used for modern J and V for modern U.

This lecture covers Knuth's latest (and simplest-so-far) algorithm to solve the XCC problem; I'll describe XCC below. The XCC problem is designed to solve problems that are NP-hard…