Viewing profile — mungoman2

Well, was the contract terminated? Saying no will sometimes have consequences, and the counterpart is sometimes unreasonable.

Similarly curious about this. The intuition I extracted: Let’s say we have 10 requests, where 9 of them take 1 second to complete but one that takes 100 seconds. The average time t…

In this case it could be solved by not letting the LLM consume the transaction message. Effectively the same as preventing user supplied info going to the first argument of printf(…

Curious about this take, how do you mean? I understand the point of distorted facts, but what I’m not sure how things are improved by basically having no trust in any facts?

This looks very interesting. Possible to get those rates without exotic hardware. But I have to say that the comparison is not really fair. Comparison is done with a 2 B model vs f…

Wow, this is really fascinating. And it reads like the intro of a sci-fi short.

This looks very cool, but it's not clear what it means. I wonder if it is captivating simply because it syncs cool graphics to audio, like those Winamp visualization filters in the…

Very interesting! Will definitely try this. Feedback: I think it would be beneficial to clarify that there is a trial at the top of the page. Currently we have download and buy but…

Naively it seems odd that running multiple checks in parallel is faster than just running the autoregressive model multiple times in series. It’s the same amount of compute right? …

This is an amazing idea, and congrats on getting so far through it. I personally would be wary about fire. Custom electronics without experience, and then putting (assuming here) h…

This is very interesting and exciting, but IMHO the comparisons read as a bit disingenuous with the other models at 16 bit weights. The 16 bit releases of the others models are not…

Instead of anchoring the sun and thus noon at the top it would be interesting to have the sun move around the clock face as the year progresses. Noon then moves around as the year …

What they're saying is that the error for a vector increases with r, which is true. Trivially, with r=0, the error is 0, regardless of how heavily the direction is quantized. Large…

This is cool. It makes storage of the KV cache much smaller, making it possible to keep more of it in fast memory. Bandwidth-wise it is worse (more bytes accessed) to generate and …

Well, the spec can of course define constraints of how the function is implemented.

Really good. I’ve struggled with the same thing. > Instead of expecting it to understand my requests, I almost always build tooling first to give us a shared language to discuss th…

Tbh shrinking the image is probably the cheapest operation you can do that still lets every pixel influence the result. It’s just the average of all pixels, after suitable color co…

This is a very fun idea. Would also be very interesting to see if one could have a system where talking to an NPC could alter the world. One maybe obvious way would be that asking …

Not sure what the uptime is meant to signal. People have quite low uptime as well…

I think you’re implying that it would be useful to have the LLM predict the end of the speaker’s speech, and continue with its reply based on that. If, when the speaker actually st…

But renewable is already cheaper than fossil fuels. Why don't we see this already?

IMHO, this is not really about AI, it's about setting boundaries and not overwork yourself.

Good article. Would have liked to see them create a minimal test case, to conclusively show that the results of math operations are actually incorrect.