Viewing profile — hehdhdjehehegwv

The phrase “unsustainable gigantic moral hazard” applies to the current pharmaceutical and health industry. You know, the one that killed millions with opioids. As far as I am conc…

I guess that would make AppleCare a bucket of compost.

Sell NVIDIA, buy buckets of worms, profit.

Literally all smartphones dying at once is preferable because they are all backed up into heavy duty databases. You can restore every phone from the cloud in this thought experimen…

I didn’t comment earlier so I can’t move a goalpost I never set down. I agree with the root comment that there may be more instances of SQLite, the most important data is not in SQ…

It most definitely does and I’m serving several read-only production databases from memory. It is insanely fast if you do it right. https://www.postgresql.org/docs/current/pgprewar…

The number of societal-wide problems that occur if your Lightroom database gets corrupted is zero. The amount of hell that would be unleashed if the financial systems layers upon l…

Yeah and the GitHub for .cpp links directly to ollama - it’s literally advertised by the core maintainer as a good project.

Yeah, I’m busy doing actual work - Ollama acting as a wrapper is exactly what I want.

I answered the financial thinking in another reply, but another factor is I need to know if the model today is exactly the same as tomorrow for reliable scientific benchmarking. I …

So my main motivation is not so much to have the lowest cost, but to have the most predictable cost. Knowing up front this is my fixed ML budget gives me peace of mind and gives me…

I’m doing non-interactive tasks, but in terms of the A6000 running llama3 70b in chat mode it’s as usable as any of the commercial offerings in terms of speed. I read quickly and i…

Doing really nuanced classification of documents at very large scale. Needle in the haystack type problems.

Nope, powers some low-level infrastructure-ish stuff.

Absolutely phenomenal.

It’s hard not to think this is just the FAA trying to protect Boeing again by making it look like Airbus is equally bad. FAA should just be rehoused under department of commerce wh…

At least their extortion is polite?

I dropped $5k on an A6000 and I can run llama3:70b day and night for the price of my electricity bill. I’ve gone through hundreds of millions, maybe billions, of tokens in the past…

This is why you need proactive privacy evaluations before you ship. The standard of the past 25 years of “let’s violate every privacy law and know it won’t catch up with us” is ove…

I read that article earlier, but it didn’t mention Boeing so I wasn’t questioning it. But where Boeing goes, bad things follow.

Starting today we are using solar power so Gemini can generate infinite scammy blogs and websites. Google Search will then use hydropower to index this LLM spam into our search eng…

Arrival and Dune Part 1 are both really good, 10/10, adaptations. Dune 2 to me shows that even with an amazingly talented adapter/director, that there are some limits to what can b…

She’s low-key one of the most successful engineers ever in terms of bringing cutting edge technology to the mass market, but AMD never gets the fawning press attention of NVIDIA, a…

Really well done, enjoyed it.

The WWDC show got on my nerves with the corpspeak, but this is pretty cool stuff. I’ve been trying to make smaller more efficient models in my own work. I hope Apple publish some a…