341–350 of 383 posts
Earlier quoted context omitted.
This is what Apple is envisioning with their SLMs, like having a model specifically for managing calendar events. It doesn't need to have the full knowledge of all humanity in it - just what it needs to manage the calendar.
Issue is their envisioning everyone only using Apple products.
The tech is still public and the research is available
Earlier quoted context omitted.
This is what Apple is envisioning with their SLMs, like having a model specifically for managing calendar events. It doesn't need to have the full knowledge of all humanity in it - just what it needs to manage the calendar.
Apple's hardware is notoriously overpriced, so I don't think they're envisioning that at all.
Earlier quoted context omitted.
This would only apply if they were distributing the GPL licensed code alongside their own code. If my MIT-licensed one-line Python library has this line of code… run([“bash”, “-c”, “echo hello”]) …I’m not suddenly subject to bash’s licensing. For anyone wanting to run my stuff though, they’re going to need to make sure they themselves have bash installed. (But, to argue against my own point, if an OS vendor ships my…
This is a false analogy. It's quite straightforward. Running bash (via exec()/fork()/spawn()/etc) isn't the same as (statically or dynamically) linking with its codebase. If your MIT-licensed one-liner links to code that's GPL licensed, then it gets infected by the GPL license.
Earlier quoted context omitted.
I was commiserating with my brother over how difficult it is to set up an environment to run one LLM or diffusion model, let alone multiple or a combination. It's 5 percent CUDA/ROCm difficulties and 95% Python difficulties. We have a theory that Lanyone working with generative AI has to tolerate output that is only 90% right, and is totaly fine working with a language and environment that only 90% works. Why is Pyth…
This is a generic problem. JS/TS/npm is just as bad with probably more build tools/frameworks. Rust is a mess. Go, well. Even perl was quite complicated.
This is flat out wrong. NPM packages by default are local to a directory. And I haven't seen a package rely on a specific minor version of node in literally years. Node's back compat is also great, there was one hiccup 5 or 6 years ago where a super popular native package was deprecated ago but that's been about it.
I can take current LTS node and run just about any package from the NPM repo written within the last 4 or 5 years and it will just work. Meanwhile plenty of python packages somehow need specific point releases. What the unholy hell.
Node version manager does exist, and it can be setup to work per directory, which is super cool, but I haven't needed NVM in literal years.
Earlier quoted context omitted.
That's a great point about the dependencies. To make the setup easier and add a few features people are asking for here (like GPU support and long text handling), I built a self-hosted server for this model: https://github.com/devnen/Kitten-TTS-Server The goal was a setup that "just works" using a standard Python virtual environment to avoid dependency conflicts. The setup is just the standard git clone, pip install…
Oh wow, really impressive. How long did this take you to make?
Impressive, might use this for https://hnup.date
"A new tool is stirring up excitement and debate in the programming community"
Just give me the facts without American style embellishments. You're not trying to sell me anything =)
Earlier quoted context omitted.
Just point people to uv/uvx.
The project is like 80% there by having a pyproject file that should work with uv and poetry. The just aren't any package versions specified and the python version is incredibly lax, and no lock file is provided.
I hope this is the future. Offline, small ML models, running inference on ubiquitous, inexpensive hardware. Models that are easy to integrate into other things, into devices and apps, and even to drive from other models maybe.
Dedicated single-purpose hardware with models would be even less energy-intensive. It's theoretically possible to design chips which run neural networks and alike using just resistors (rather than transistors). Such hardware is not general-purpose, and upgrading the model would not be possible, but there's plenty of use-cases where this is reasonable.