Viewing profile — marci

delta.chat is email https://delta.chat/en/help#can-i-use-a-classic-email-address...

Then maybe what you want is email? Sprinkled with a little bit of https://delta.chat ? And potentially a dash of iroh https://news.ycombinator.com/item?id=48542480 https://www.iroh…

Nothing to understand. Straight up hallucination. I could have sworn I read that they used a novel architecture where the model is dense but you could select specific layers or som…

Seems like what Apple's going for with afm3. Their latest model that will be embedded in macOS 27 is a quantized dense 20B that only select between 1 to 4B at inference, based on t…

https://xcancel.com/Alibaba_Qwen/status/2084100707423289643#...

Makes me wonnder... how much compute/storage there's in all the satellites currently in LEO combined.

This was a preview release. They haven't finish training. The Pro contains more knowledge but it probably takes longer training than flash for the smarts to kick in.

"That’s where EMO comes in. We show that EMO – a 1B-active, 14B-total-parameter (8-expert active, 128-expert total) MoE trained on 1 trillion tokens – supports selective expert use…

But with Apple's AFM 3 architecture, we might end up with huge SOTA adjacent on devices with limited RAM. They use a technique where you only load between 1B and 4B of a 20B dense …

Don't worry. Most people spend most of their compute time on a phone, where you're ability to filter ads is way more enshitified.

I wonder where's the line between using a font and copyright/trademark infringement.

"That’s where EMO comes in. We show that EMO – a 1B-active, 14B-total-parameter (8-expert active, 128-expert total) MoE trained on 1 trillion tokens – supports selective expert use…

Did they modify their post? I can't see who claimed that consumer hardware will be able to build most things?

when you sign an app with your personal dev account.

That's just a regular rounndabout. I thought you were talking about this: https://www.youtube.com/watch?v=6OGvj7GZSIo

Also everything from scratch by allen.ai. Weights, datasets, code, multiple checkpoints... I like their FlexOlmo concept.

I think it's mostly because most cpus that can run a gpu already have parts dedicated as h264 encoder, way more efficient energy wise and speed wise.

Unfortunately, the most extreme is that it's the new normal that now, there's >0 chance that someone, whether they are a US citizen or not apparently, child or adult, can end up in…

Imagine, a llm trained on the best thrillers, spy stories, politics, history, manipulation techniques, psychology, sociology, sci-fi... I wonder where it got the idea for deception…

Their issue with the mac was the sound of fans spinning. I doubt a dedicated gpu will resolved that.

"finetune" Not "Train from scratch"

It is so, so long... I barely reached the middle before my brain just "Nope." They are talking about this kind of battery replacement: https://www.ifixit.com/Guide/Fairphone+3+Batt…

If your family members ever had to mount an ikea furniture or equivalent, they'll probably have an as easy or easier time replacing a part on a fairphone. Especially for the batter…