Viewing profile — bytesandbits

I imagine it is based off World Labs

absolutely crazy level of detail... in awe

I thank Microsoft deeply for the forced copilot crap, almost impossible to remove, that they have put into vs code. Finally after 5 years I have deleted vs code in my Mac! that was…

I know a 10x engineer when i see one.

fine. I will port it myself. Real-time, sub 100ms latency. Here https://testflight.apple.com/join/myNP5XvU

Handy with parakeet is pretty awesome by the way!

here the original NASA photos at high resolution without unnecessary ads. https://www.nasa.gov/gallery/journey-to-the-moon/

why is a mail client needed in an onboard space computer at all ?

anything that doesn't touch the model parameters at all once it has been compiled. for example, in streaming ASR of an encoder-decoder you can get gains in accuracy just by enhanci…

we constantly underestimate the power of inference scaffolding. I have seen it in all domains: coding, ASR, ARC-AGI benchmarks you name it. Scaffolding can do a lot! And post-train…

https://machinelearning.apple.com/research/exploring-llms-ml...

Apple

4x faster PREFILL not decode. Decode is bandwidth-bounded. Prefill is flops-constrained.

do you run two eSIMs when traveling and if so how is stability / battery life?

incredible work

I am not sure what "edge" device you want to run this on, but you can compress parakeet to under 500MB on RAM / disk with dynamic quants on-the-fly dequantization (GGUF or CoreML c…

sensei karpathy has done it again

parakeet v3 has a much better RTFx than moonshine, it's not just about parameter numbers. Runs faster. https://huggingface.co/spaces/hf-audio/open_asr_leaderboard

maybe a deepseek v4 distill. give it a few days

its cause of a chain of events. Next week Chinese New year -> Chinese labs release all the models at once before it starts -> US labs respond with what they have already prepared a…

Not trained in Ascend that is BS. Hopper GPU cluster. Please remove that.

wow Mistral really cooked

how are you so fast man

John Giannandrea leaves and things start to work well in the Apple AI department. Maybe just a coincidence :)

I will never understand why when you expect to sell a few hundred units of a product at most, you would decide to go and build something in china. There are instances where buildin…