Viewing profile — gpapilion

Yes and no. They paid what everyone else pays for those gpus. NVIDIA make the profit and leaves crumbs for the rest. For other components they paid less, but since the gpus are the…

27b fp4.

So recently I moved from a Anthropic model to a qwen 3.5 model running on my Mac to summarize ticket activity over 7 days. I used to do this manually with a colleague and it would …

The initial cost of serving is very high, and while super performant not great for scaling up. In practice they are also not very flexible when compared to gpus.

It’s a very different company post the PwC purchase. They have around 1/3 of the revenue from consulting which tends to push the valuation down due to its relative low margin when …

Home networks have made this much easier. DVD players didn’t expect network access for software updates etc…

Just to level set here. I think its important to realize this is really focused on allowing things like search to operate on encrypted data. This technique allows you to perform an…

The large api/token providers, and large consumers are all investing in their own hardware. So, they are in an interesting position where the market is growing, and NVIDIA is takin…

So the answer is yes, but not to a noticeable amount. Don't worry about protecting your battery life, and charge your phone as needed.

Nvme pricing is pretty volatile in the past 2 years I’ve seen it move between 2-3x from its low post Covid. I don’t think the prices have adjusted because of that. Additional durin…

Realistically groq is a great solution but has near impossible requirements for deployment. Just look at how many adapters you need to meet the memory requirements of a small llm. …

I would think this is for rental fleets or bike share. The weight and design would seem to make sense for that. Though the single speed seems like and odd choice for that.

This is not true. Almost all firmware is signed by every vendor, and there are standards from Intel and amd on implementation of code signing. Look up Intel pfr.

The one vendor mentioned in the comments, AMI, is switching this code base to openbmc. Also it should be noted that often this software is system specific.

The issues were durability, fire rate, and well power. I don’t know that the first two have changed significantly.

I think that the private carriers are more likely to be helped by this, since they will manage the paperwork. It’s more likely a set of products that were shipping directly from fa…

Gradual damage is consistent with over heating. I've seen racks of servers do the same thing. Overall, there is a continued challenge with CPU temperatures that requires much tight…

It makes sense in any environment you have two workloads sharing compute from two parties, public clouds. The protection here is to ensure the vms are isolated. Without doing this …

I think it’s more pragmatic. We can eliminate hyperthreading to solve this, or increase memory safety at the cost of performance. One is a 50% hit in terms of vcpus, the other is n…

More generally beats better. That’s the continual lesson from data intensive workloads. More compute, more data, more bandwidth. The part that I’ve been scratching my head at is wh…

Scope, it’s all about scope of your team. Em to director requires opportunity as well as performance. For you that means focusing on a growing area of the company, and finding new …

I think this will eventually morph into apples server fleet. This in conjunction with the ai server factory they are opening makes a lot of sense.

https://www.backblaze.com/blog/ssd-drive-stats-mid-2022-revi... They reach the conclusion here they are more reliable.

I don’t know this is significantly different than modern engines. They require special tools and software too. The bigger issue I think is most of the cars are teslas, which didn’t…

The headline discussion on the podcast covers whether chatgpt is actually successful. They point to relatively few use cases emerging, and the continual or press around agi. They c…