The fact that Apple didn't ship this in years after Siri acquisition is an indictment of its Product leadership
This is not different from mlx-lm other than it uses a closed-source inference engine.
Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
41–50 of 167 posts
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#42Just tried it. really cool, and a fun tech demo with rcli. I filed a bug report; not everything is loading properly when installed via homebrew. Quick request: unsloth quants; bit per bit usually better. Or more generally UI for huggingface model selections. I understand you won't be able to serve everything, but I want to mix and match! Also - grounding: "open safari" (safari opens, voice says: "I opened safari") "n…
How did you try it? You said on github it doesn't work.
[deleted]
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#43Earlier quoted context omitted.
The upvotes on the current post are fine - the reason you saw the submission rise in rank is that startup launch posts by YC startups get special placement on the front page (this is in the FAQ: https://news.ycombinator.com/newsfaq.html ). Not every such post does, but some do. In other words, your perception wasn't wrong, but the interpretation was off. I've put "Launch HN" and "YC W26" back in the title to make tha…
hi dang. while you are here -- are comments artificially ordered on this post? https://news.ycombinator.com/item?id=47326953 is grey (i.e the two posts calling out unethical behavior have been living at the bottom of this post the entire time, until a couple of actually [flagged] comments ended up under them. i do not care about the karma itself, at all. but i do care to know if launch/show posts have comment section…
Adding onto it, My comments are also ranked low. This comment on which dang replied has 4 upvotes which I think that this is at the 4th last of this post and the other comment that I made on your comment where I responded to ya has 3 upvotes.
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#44"Apple M3 or later required. MetalRT uses Metal 3.1 GPU features available on M3, M3 Pro, M3 Max, M4, and later chips. M1/M2 support is coming soon. On M1/M2, RCLI automatically falls back to the open-source llama.cpp engine."
Funny you mention that because on their github they just pushed an update to say that it didn't work M3 and M4.
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#45Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#46Just tried it. really cool, and a fun tech demo with rcli. I filed a bug report; not everything is loading properly when installed via homebrew. Quick request: unsloth quants; bit per bit usually better. Or more generally UI for huggingface model selections. I understand you won't be able to serve everything, but I want to mix and match! Also - grounding: "open safari" (safari opens, voice says: "I opened safari") "n…
How did you try it? You said on github it doesn't work.
They said it didn't work installed from homebrew, so I assume they went back and did the curl | bash install option
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#47Very cool, congrats! I'm curious how you were able to achieve this given Apple's many undocumented APIs. Does it use private Neural Engine APIs or fully public Metal APIs?
Either way, this is a tremendous achievement and it's extremely relevant in the OpenClaw world where I might not want to have sensitive information leave my computer.
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#48Earlier quoted context omitted.
How did you try it? You said on github it doesn't work.
They said it didn't work installed from homebrew, so I assume they went back and did the curl | bash install option
This option didn't work either. I tried it. Also, the install script… installs Brew. So at the end, it's the same?
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#49This doesn't work on any of the methods I've tried.
Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
#50Based on the demo video, the TTS sounds like it's 10 years out of date. I would not enjoy interacting with it.