Live data from Hacker News

Desert Ant Labs: local, fast models that run on device

desertant.com

31–40 of 101 posts

Re: Desert Ant Labs: local, fast models that run on device

#31

> opinionated on-device intelligence > Hate speech triage. On-device moderation that flags hateful, abusive and threatening text What could go wrong here?

I don't think you understood. It means these are specialized models. Their toxic model could be ideal for video game lobbies without investing a ton of money if you're an indie dev

This also could be ideal if you want your child to play online to have auto-censorship

Re: Desert Ant Labs: local, fast models that run on device

#32
post #9

I wonder why they only support Apple platforms, citing CoreML. Doesn't Android have a similar framework, ML Kit?

We plan to make most our models available for Android and web too. Some are a bit harder to port to the different platforms and will take a bit longer to properly land on Android or web. Mostly sequencing (Voz, Clips, Title). Soon!

Re: Desert Ant Labs: local, fast models that run on device

#34
post #14

Earlier quoted context omitted.

> If I'm happy with the weights you've given me, and I'm not using your compute for inference and not wanting or needing any updates off you, why should you continue getting money off me and my customers? I definitely understand the appeal of the desire to “buy it once”, but I think there are a few issues: - almost no software is static. Look at a package like python Requests and even though it does the simplest thin…

LLMs are static though.

In the way that, say, Garmin Maps are static, I agree.

Re: Desert Ant Labs: local, fast models that run on device

#35
post #30

Earlier quoted context omitted.

> If I'm happy with the weights you've given me, and I'm not using your compute for inference and not wanting or needing any updates off you, why should you continue getting money off me and my customers? Because they own the IP and they get to decide the terms of how it’s licensed. This is like a company taking open source software, saying they like the code the community has given them, and asking why they should c…

>Because they own the IP and they get to decide the terms of how it’s licensed. how'd that work out for the rest of IP owners that had their stuff used as training data for use in model creation? was the material they trained on produced in-house?

Use as training data has been tested in court multiple times and cleared.

I know some people want it to be a legal violation, but it’s not.

Also these are audio models, if you hadn’t noticed. The training sets for this type of work is very different than the corpus of scraped GitHub repos.

Re: Desert Ant Labs: local, fast models that run on device

#36
post #34

Earlier quoted context omitted.

LLMs are static though.

In the way that, say, Garmin Maps are static, I agree.

Very much like map CD-rom updates, I think a lot of people wouldn't mind paying per-update for these models, and would understand the implications. That is, if there weren't so many open models available.

Re: Desert Ant Labs: local, fast models that run on device

#38
post #30

Earlier quoted context omitted.

> If I'm happy with the weights you've given me, and I'm not using your compute for inference and not wanting or needing any updates off you, why should you continue getting money off me and my customers? Because they own the IP and they get to decide the terms of how it’s licensed. This is like a company taking open source software, saying they like the code the community has given them, and asking why they should c…

>Because they own the IP and they get to decide the terms of how it’s licensed. how'd that work out for the rest of IP owners that had their stuff used as training data for use in model creation? was the material they trained on produced in-house?

Was the material, I was trained, produced in-house?

Philosophical questions don't make sense if you use them to counter argue about something which is a legal issue.

Re: Desert Ant Labs: local, fast models that run on device

#39
post #37
post #26

Earlier quoted context omitted.

Thanks!

How was it built?

We design in Figma. Build a design system out that with components for all our public facing products, demos and marketing assets. The website is built with the components, and we have a set of skills and tools to keep both in sync. We also use skills to sync between HuggingFace, our SDK on GitHub and the website. We write and review most our core copy by hand and use that to help expand into different pages. We prob do a write-up about this on our blog later.

Re: Desert Ant Labs: local, fast models that run on device

#40
I definitely think there's a lot to be done with small models dedicated to specific tasks. I've always thought the REAL value is in having large models be able to easily build small models for custom tasks (which I know is kind of a thing), but perhaps just providing the small models directly is the more accessible approach.

>accessible via one SDK for Swift, Kotlin, and JavaScript

Lol well let me know when there's a Python SDK and I'll give it a try then. Obviously this isn't a deal breaker if you have a real case, but as someone who is willing to spin something up and try it out if there's a quick "pip install" command, this is getting put back on the shelf for now.

Post reply on HN