Live data from Hacker News

Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

github.com

61–70 of 167 posts

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#61
post #39
post #7

Just tried it. really cool, and a fun tech demo with rcli. I filed a bug report; not everything is loading properly when installed via homebrew. Quick request: unsloth quants; bit per bit usually better. Or more generally UI for huggingface model selections. I understand you won't be able to serve everything, but I want to mix and match! Also - grounding: "open safari" (safari opens, voice says: "I opened safari") "n…

How did you try it? You said on github it doesn't work.

It loads after those errors. Tap space and talk to it.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#62

If I send a Portfile patch, would you consider MacPorts distribution?

You're welcome to add me as a co-maintainer on this if you submit it to macports/macports-ports:

     {macports.halostatue.ca:austin @halostatue}
I maintain https://github.com/macports/macports-ports/blob/master/sysut... amongst other things regularly.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#63

I think the title should read "RunAnywhere," not "RunAnwhere."

Dang has changed the title and it seems that he may have had a minor error doing it . Must have been a typo from his side changing it and that's okay! I think that Dang will update it sooner than later. Edit: just reloaded, its fixed now.

tomhow fixed it. I had looked at it multiple times and not noticed!

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#64
post #29

Earlier quoted context omitted.

The upvotes on the current post are fine - the reason you saw the submission rise in rank is that startup launch posts by YC startups get special placement on the front page (this is in the FAQ: https://news.ycombinator.com/newsfaq.html ). Not every such post does, but some do. In other words, your perception wasn't wrong, but the interpretation was off. I've put "Launch HN" and "YC W26" back in the title to make tha…

hi dang. while you are here -- are comments artificially ordered on this post? https://news.ycombinator.com/item?id=47326953 is grey (i.e the two posts calling out unethical behavior have been living at the bottom of this post the entire time, until a couple of actually [flagged] comments ended up under them. i do not care about the karma itself, at all. but i do care to know if launch/show posts have comment section…

> you've responded to a handful of other comments and ignored this one

I hadn't seen this until 30 seconds ago. The assumption of moderator omniscience leads to a lot of mistaken conclusions!

We marked offtopic comments offtopic, which lowers them on the page. This is standard HN moderation. If we didn't do this, nearly every thread would be choked with something offtopic at the top.

At the same time, we haven't killed the posts or put them in a "stub for offtopicness" [1] like we otherwise would. They're still here for people who want to read them, while at the same time the main discussion can be about the main topic, which is the startup launch.

HN is actively moderated and always has been. Downweighting offtopic/generic comments is one of the biggest things we've ever discovered for improving the quality of the threads. For us it's about the quality of the site as a whole, not specific narratives, but of course everyone can (and will) make up their own mind about this. What I can tell you is (a) the way we do these things has been stable for a long time (HN time is measured in decades, not years), and (b) we're always willing to answer questions about it.

Oh, and (3) - when YC or a YC-funded startup is part of a story, then we moderate less than we otherwise would [2]. We do still moderate, though—we just do it less.

[1] https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

[2] https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#65
post #44
post #38

"Apple M3 or later required. MetalRT uses Metal 3.1 GPU features available on M3, M3 Pro, M3 Max, M4, and later chips. M1/M2 support is coming soon. On M1/M2, RCLI automatically falls back to the open-source llama.cpp engine."

Funny you mention that because on their github they just pushed an update to say that it didn't work M3 and M4.

Sorry about that but this is what is being there in github : Apple M3 or later required. MetalRT uses Metal 3.1 GPU features available on M3, M3 Pro, M3 Max, M4, and later chips. M1/M2 support is coming soon. On M1/M2, RCLI automatically falls back to the open-source llama.cpp engine.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#66
post #64

Earlier quoted context omitted.

hi dang. while you are here -- are comments artificially ordered on this post? https://news.ycombinator.com/item?id=47326953 is grey (i.e the two posts calling out unethical behavior have been living at the bottom of this post the entire time, until a couple of actually [flagged] comments ended up under them. i do not care about the karma itself, at all. but i do care to know if launch/show posts have comment section…

> you've responded to a handful of other comments and ignored this one I hadn't seen this until 30 seconds ago. The assumption of moderator omniscience leads to a lot of mistaken conclusions! We marked offtopic comments offtopic, which lowers them on the page. This is standard HN moderation. If we didn't do this, nearly every thread would be choked with something offtopic at the top. At the same time, we haven't kill…

im sorry, but i disagree quite strongly with your suggestion that a comment about the unethical behavior of a company is off-topic on a post by that company launching their product.

especially when that company wants you to curl | bash their code onto your machine -- potential users deserve to know that despite being a YC-backed company (which would typically be a positive indicator, people may reduce their scrutiny) that they have been caught scraping data they shouldnt be, and then using that data for marketing, and refuse to respond to anyone who bring it up.

but it is your world and i am just living in it, so i will carry on. i appreciate that you did not collapse them.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#67
post #29

Earlier quoted context omitted.

The upvotes on the current post are fine - the reason you saw the submission rise in rank is that startup launch posts by YC startups get special placement on the front page (this is in the FAQ: https://news.ycombinator.com/newsfaq.html ). Not every such post does, but some do. In other words, your perception wasn't wrong, but the interpretation was off. I've put "Launch HN" and "YC W26" back in the title to make tha…

Thanks dang but can you please explain there being two accounts who wrote something very small comment and one account being completely new and the other being 7 months old only being invoked in this case. Clearly I am not the only one here as john_strinlai here seems to have had somewhat of the same conclusion as me. Dang I know you care about this community so can you please talk more what you think about this in p…

I'm happy to answer as best I can! but I'm having trouble understanding what you're specifically asking.

If https://news.ycombinator.com/item?id=47327129 and https://news.ycombinator.com/item?id=47328465 don't answer your questions, can you maybe try picking the most important question and making it as specific as you can? Then I can take a crack at that and we can go from there.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#68

Earlier quoted context omitted.

Terrible? It's fine. What's your accent that it's terrible? It even pulls last names from my address book and spells them right.

Terrible relative to everything else that exists today. I have a neutral American accent. Maybe you just don’t know what you’re missing? Google’s default speech to text is still bad compared to Whisper and Parakeet, but even Google’s is markedly better than Apple’s. I cannot think of a single speech to text system that I’ve run into in the past 5 years that is less accurate than the one Apple ships. Sure, Apple’s spe…

As someone who tried every TTS in existance a few years ago for some product work, Apple’s is so consistantly better that we wound up getting a bunch of apple stuff just for the TTS.

Re: Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon

#69
post #64

Earlier quoted context omitted.

hi dang. while you are here -- are comments artificially ordered on this post? https://news.ycombinator.com/item?id=47326953 is grey (i.e the two posts calling out unethical behavior have been living at the bottom of this post the entire time, until a couple of actually [flagged] comments ended up under them. i do not care about the karma itself, at all. but i do care to know if launch/show posts have comment section…

> you've responded to a handful of other comments and ignored this one I hadn't seen this until 30 seconds ago. The assumption of moderator omniscience leads to a lot of mistaken conclusions! We marked offtopic comments offtopic, which lowers them on the page. This is standard HN moderation. If we didn't do this, nearly every thread would be choked with something offtopic at the top. At the same time, we haven't kill…

Dang, Although I really appreciate the work you put in. I am not quite sure if the criticism of said company because of genuine reasons and suspicions about it in launch HN of said company is offtopic. As John said, I agree with him on the aspect that the definition of offtopic might vary for us then it seems.

But if I may ask, doesn't the policy of moderate less not more your (3) point opposite to what you said about offtopic from how I perceive it?

> Sure, we marked the offtopic comments offtopic, which lowers them on the page. This is standard HN moderation. If we didn't do this, then nearly every thread would be choked with something offtopic at the top.

>Oh, and (3) - when YC or a YC-funded startup is part of a story, then we moderate less than we otherwise would [2]. We do still moderate, though—we just do it less.

I would suggest that the minor disagreements that we have is because these two points seem contradictory to me from how I perceive it. I would suggest (if possible) to moderate less as you mention not more and let the order of ranking be natural which in this case might be that john's comments can come at the first place for example. Because you are moderating it by putting it into downweighting it and that's one of the concerns that we sort of have.

> At the same time, we haven't killed the posts or put them in a "stub for offtopicness" [1] like we otherwise would. They're still here for people who want to read them, while at the same time the main discussion can be about the main topic, which is the startup launch.

Also regarding this. I might have to trust ya when you say this but I do feel like its within the HN spirit that when a company gets launched, the critisims of the company and its past gets talked about.

On top of my head I remember some VPN company sometime ago which used TEE encryption by intel. One of the first comments or similar was about how the guy had shady past because they were the former server owner of liberachat and some controversy surrounding it and how they wouldn't want to run said VPN (other comments were about the trust within Intel in general)

My point is that this might be considered offtopic according to ya now but those were active and quite on top. So maybe I am recollecting events differently but it does seem to have some idea that this doesn't seem offtopic (atleast to me, I could be wrong though, I usually am but still)

With all of this in mind, I don't think that its necessarily offtopic Sir. I'd really appreciate it if for better accuracy you can have the flow of comments be natural in this regards in this particular thread as We'd really appreciate it if possible. Thanks!

Thoughts?

Post reply on HN