Viewing profile — chris_money202

The kv cache is wiped as soon as you get your answer, cloud hosts are not going to hold the GPU memory for your entire session. You're probably referring to some agent level cache

I don't know if that's the whole point, but I agree with the sentiment, why would a startup be working in legacy code and where would that code come from if this is truly the start…

My thoughts on this is there is a deliberate act going on that is doing more for retention than just the simple act of using a (fountain) pen. If I am in a lecture and I am writing…

oh great now I have to worry about the wing tips flying off midflight as well

Right, a heat exchange is reusable though on earth and can be recycled across multiple SKUs and thus depreciates longer. In space similar to how you can’t repair you also can’t swa…

Repairability and depreciation are the main problems. A earth data center can be repaired, depreciated, and recycled at EoL recovering some of the costs. SpaceX datacenters are a t…

Based on description it doesn't sound like SoC design, it sounds like a book about RISC-V microprocessors. To the untrained eye, that sounds similar, but a microprocessor is one pa…

You don’t need to serve raw html, you can just open it in a hypertext markup language viewer (I.e a browser). Just send people the index.html

Don't be fooled, there is politics, opinions, and less rigor in science as well.

"How it Works" -> "Idk" OP probably

Wow that’s like such an obvious thing that makes so much sense. I have no doubt something like “Hands on, Hands on, Hands on” will start chirping in near future

I think future is probably more similar to speculative execution (inference/decoding). A small LLM is used to speculate and a large LLM is used to confirm if needed. If the small L…

My guess is area becomes problematic. Chip becomes bigger, harder to manufacture without defects, costs rise as a result of those defects. Bonus though, Apple is using "defective" …

I still don't know if I am sold with that. .NET is also a runtime so how do you handle the user story? If your users are also on Windows Lite then they have to manage .NET version …

OP says Windows needs builders to make applications and that is what Windows Lite would enable (or expand) but then says Windows Lite shouldn't include .NET one of the primary fram…

Or hear me out, we improve life here on Earth...

If you’re truly serious about local AI you’re not using a Mac. A Mac is for people who want the best of both worlds, GPUs are much faster if memory is equal.

Love this, seems to struggle with newly indexed words. Will try again when the FP load is gone

I forgot Stargate

Microsoft, Google, and Amazon also do this, but they also have the hyperscaler datacenter infrastructure to host the chips. Designing and taping out the chip is one thing, packagin…

Don't recall saying I would trust them over my own judgement, they are an additional layer of perception

I drive a 2004 truck, it's not as big as the newer trucks but it's still pretty big. My 2004 truck also has 0 sensors on it and no cameras. If I were driving a newer truck, I belie…

Why would Apple’s inference fleet be more efficient? They would need to get into the TPU/water cooling business to make that happen. Apple’s silicon is great but remember it’s base…

Have to remember that regulated gambling also has lobbyist so unless regulated gambling is invested in these apps they are likely trying to get them banned or also regulated

Flip the classroom, make students learn the material on their own (Using AI or whatever resources they want to use) and then in-classroom time is divided on working on problems (wi…