Viewing profile — WanderPanda

It highly depends on the task. For math and coding, sure. But for knowledge tasks GPT-4 is wayy better than even SOTA ~100B models. For my knowledge test cases the lines get blurry…

I applaud that you recently started providing the KL divergence plots that really help understand how different quantizations compare. But how well does this correlate with closed …

I would be really interested in a podcast with the CEO where he goes a bit into the trade-offs of backwards and forwards compatibility. I can not imagine that their planning was so…

This is so true! Shows a lack of care that usually doesn’t stop at just the naming

They are heavily post-trained on code and math these days. I don‘t think we can infer that much about their behavior from just the pre-training dataset anymore

Amazing work and people should really appreciate that the opportunity costs of your work are immense (given the hype). On another note: I'm a bit paranoid about quantization. I kno…

I find it hard to trust post training quantizations. Why don't they run benchmarks to see the degradation in performance? It sketches me out because it should be the easiest thing …

Wait but the one you linked seems to be pneumatically driven, while the op one is an actual combustion engine, right?

Small feedback if any of the Antigravity people read here: "Fast" is not a great name for the "eager" option (vs. "Planning") because "Fast" is associated with "dumb" in LLMs (fast…

SWIFT is Belgian, though?

Mechanically sure, but I still feel way safer when a Tesla (of any kind) is approaching me as a pedestrian or bicyclist than any other vehicle (except maybe Waymo) because I know t…

Makes sense! I like that you guys are more open about it. The other labs just drop stuff from the ivory tower. I think your style matches better with engineers who are used to data…

Damn TIL, I always used > Cursor: disable completions and forgot to turn it on again I need to try snooze then!

Why did you stop training shy of the frontier models? From the log plot it seems like you would only need ~50% more compute to reach frontier capability

Until it isn't

Did you check out the STM32N6? It apparently has an h264 encoder

Amazing: (Mar 5 2022) TinyGL 0.4.1 is out (Changelog) (Mar 17 2002) TinyGL 0.4 is out (Changelog) "our plans are measured in centuries"

I have a strong Tinnitus on one ear after an ear surgery for 8 years now. And I usually don‘t notice it for months at a time, even though it is there all the time (thanks for remin…

I think this is the frontier when it comes to "unstructured": https://youtu.be/nmEy1_75qHk They for sure did not anticipate that the user would backflip into their robot and knock …

Theoretically, when the market offers me an order book and I take offers on one or the other side that should be totally fair? I think until execution/fill the information should b…

Alarm is a good example of an “output only” task. The more inputs that need to be processed the less a pure chatbot interface is good (think lunch bowl menus, shopping in general e…

Did they still not release "Bring your own subscription" "login with ChatGPT" and letting people apply their subscription/quota to other apps/services? There are so many use-cases …

It was 4x over the original version IIRC so should be ~ 2x over the previous

Imagine regulators doing their job for once and creating a clean regulation that removes the uncertainty about the liability for such releases. Such that they can just slap Apache …

I think modularization of templates is really hard. Best thing I can think of is a cache e.g. for signatures. But then again this is basically what the mangling already does anyway…