Viewing profile — ericcurtin

Time to use some local ai with Docker Model Runner :) No cloudflare no problem https://github.com/docker/model-runner

I'm one of the devs, happy to answer any questions

Hi HN, I’m one of the authors of this post. We’ve updated Docker Model Runner to support vLLM alongside the existing llama.cpp backend. The goal is to bridge the gap between local …

Will be around the next few hours

We've been working with Docker to make running quantized models easier with Docker. This integration allows users to pull and run Unsloth-optimized models using the native Docker C…

Hi everyone, we're the maintainers. We're rebooting the model-runner community and wanted to share what we've been up to and where we're headed. When we first built this, the idea …

Hey Hacker News, We're the maintainers of docker/model-runner and wanted to share some major updates we're excited about. Link: https://github.com/docker/model-runner We are revita…

Keep opening pull requests and issues, we need these things, you are right!

Any new features you think we should add to further enhance your usage? Glad you find it useful

Is there overlap with "Show HN: docker/model-runner – an open-source tool for local LLMs" posted today, we encapsulate AI workloads in containers using docker model runner. Some cl…

What did you like? Anything stand out?

Thanks very much. It worked well for you? Which hardware? :) Any other feedback, keep it coming!

Hi everyone, we're the maintainers. We're rebooting the model-runner community and wanted to share what we've been up to and where we're headed. When we first built this, the idea …

Hey Hacker News, We're the maintainers of docker/model-runner and wanted to share some major updates we're excited about. Link: https://github.com/docker/model-runner We are reboot…