Viewing profile — jbay808

Yes, exactly. And it's the compression that makes this happen. If it was just curve-fitting then the LLM really would act like a stochastic parrot, and it wouldn't generalize; also…

Imagine you're curve-fitting a bunch of data points on, say, the orbital motion of planets and asteroids. You get tons and tons of data on these orbital motions, and then put it in…

If the proof of concept takes an hour to code up, or proving the market exists just takes a bit of googling, then sure, you can prepare that before the first meeting where you sugg…

You must have very different kinds of meetings than I do. Unless you're going into that meeting with a rehearsed PowerPoint presentation, or there's a strict agenda that doesn't al…

You can fire the shot and then patch the hole at the same time, proposing solutions to the same problem you pointed out, rather than just shooting and letting one person handle def…

Definitely impressive as a proof of concept. A lot of the other problems can be solved with iteration. There are some IP67-rated drone motors meant to both fly and run underwater (…

You can do a lot with chaos. One of the things it lets you do is find an unforced trajectory from the vicinity of any state to the vicinity of any other (accessible) state. Sensiti…

You have to account for the energy required to break the bonds of the CH4, though. This means if you burn methane the usual way you get (CH4 + 2O2 --> CO2 + 2H2O + 803 kJ/mol); if …

Interesting to see this on the HN front page. On the subject of methane pyrolysis, it turns out if you look at the Gibbs free energy calculation, about half of the energy of methan…

It's mainly the laser itself that is the expensive part. If you only care about resolution it's easy, you just need a single-mode laser. But if you care about accuracy it's very di…

Thanks, it should be fixed now!

This one still keeps me up at night, especially the figure on the 6th page. https://web.archive.org/web/20180513182952/http://burro.case... The short summary of this hypothesis is …

I disagree with the assertion that "VLMs don't actually see - they rely on memorized knowledge instead of visual analysis". If that were really true, there's no way they would have…

If I were given five seconds to glance at the picture of a lion and then asked if there was anything unusual about it, I doubt I would notice that it had a fifth leg. If I were ask…

This might be a great alternative to beryllium copper for the spring contact element in high-current electrical connectors.

Can you say more precisely what you mean?

I mean that needing to scan the full context of tokens before the nth is inherent to the problem of sorting. Transformers do scan that input, which is good; it's not surprising tha…

> I don’t really understand what you’re testing for? For this hypothesis: The intelligence illusion is in the mind of the user and not in the LLM itself. And yes, the notion was pr…

It might seem like you could sort with just pairwise correlations, but on closer analysis, you cannot. Generating the next correct token requires correctly weighing the entire cont…

I was interested in this question so I trained NanoGPT from scratch to sort lists of random numbers. It didn't take long to succeed with arbitrary reliability, even given only an i…

Yes, this is how frequency-doubled lasers work (eg. 532 nm green laser pointers, which are generated as a harmonic from a 1064 nm Nd:YVO4 laser by a nonlinear KTP crystal).

That's a great question! I have no idea. At low frequencies it should be very easy, because the sound is just a pressure measurement, so you can compare against a calibrated pressu…

This project might be exactly what you're looking for: https://github.com/peterdsharpe/AeroSandbox

This is correct, although in my experience the distribution is often more like a lognormal than a Gaussian: https://thesearesystems.substack.com/p/task-estimation-conqu...