I tried to port it to Docker and wrote a blog here https://shekhargulati.com/2025/08/09/making-coderunner-ui-wo.... I used Claude Code to do the port. We used Datalayer Jupyter MCP Server instead of coderunner which uses Apple containers.
I want everything local – Building my offline AI workspace
211–220 of 294 posts
Re: I want everything local – Building my offline AI workspace
#212Half-OT: Anything useful that runs reasonably fast on a regular Intel CPU/GPU?
Re: I want everything local – Building my offline AI workspace
#213> Even with help from the "world's best" LLMs, things didn't go quite as smoothly as we had expected. They hallucinated steps, missed platform-specific quirks, and often left us worse off. This shows how little native app training data is even available. People rarely write blog posts about designing native apps, long winded medium tutorials don't exist, heck even the number of open source projects for native desktop…
I mean outside of HPC why would you when the browser is the world’s most ubiquitous VM?
If you want something better than UI designed for toddlers
Re: I want everything local – Building my offline AI workspace
#214Earlier quoted context omitted.
> whereas at best you would have to trust the AI cloud providers that they are not training or storing that data. Yeah, about that. They even illegally torrented entire databases, hide their crawlers. Crawl entire newspaper archives without permission. They didn't respect the rights of big media companies. But they're going to respect the little guy's of course because it says to in the T&Cs. Uh-huh. Also, openai alr…
I agree but I was just (repeating?) some argument that I heard that if the companies would actually not follow on their premise that they are actually safe if they said so (think amazon bedrock tos policy which says such) Then it will cause an insane backlash and nobody would use the product. So it is in their interest to not train/record. But yes I also agree with you. They are already torrenting :/ So pretty sure i…
> Then it will cause an insane backlash and nobody would use the product. So it is in their interest to not train/record.
I don't think there would be that much backlash. People are getting hooked on it and many don't actually care about privacy.
We know about Google, meta and people still use them. Not a big dent in openai usage either since their revelations.
But I understand your point!
Re: I want everything local – Building my offline AI workspace
#215This is fantastic work. The focus on a local, sandboxed execution layer is a huge piece of the puzzle for a private AI workspace. The `coderunner` tool looks incredibly useful. A complementary challenge is the knowledge layer: making the AI aware of your personal data (emails, notes, files) via RAG. As soon as you try this on a large scale, storage becomes a massive bottleneck. A vector database for years of emails c…
I'm gonna put it here for visibility: Use patchright instead of Playwright: https://github.com/Kaliiiiiiiiii-Vinyzu/patchright
Re: I want everything local – Building my offline AI workspace
#216Yep, that is something I do also actively experiment with in home projects. Local NAS (Synology) with 28TB of RAIDed storage, local containers and VMs on it and local gitea and other devops and productivity tools. All that talks to my mac which runs editing, compiling, etc and lmstudio with local agent. Not best always with AI, I lack enough RAM but close to imagine how I will work in the future, end-to-end
Re: I want everything local – Building my offline AI workspace
#217Half-OT: Anything useful that runs reasonably fast on a regular Intel CPU/GPU?
I did a bunch of research and basically no. Unless you can work with sending a request in the evening and getting the result in the morning.
And you'd need a lot of regular RAM because otherwise you start swapping at which point I think response times end up in days.
This tech is in the Wild West days, for it to be usable by the average person on consumer hardware, I think we'll need to be in 2030+.
Re: I want everything local – Building my offline AI workspace
#218Any way to install this via just a container? Similar to a `docker compose up -d` that a lot of projects offer. Just download the docker-compose.yml file into a folder, run the command, and you're running. If you want to delete everything, just `docker compose down` and delete the folder, and the container and everything is gone. Anything similar to that? I don't want to run a random install.sh on my machine that doe…
But you would pump your secrets into a docker AI?
Does Docker do that or are you speculating?
Also - podman?
Re: I want everything local – Building my offline AI workspace
#219local/edge is the most under-valued space at the moment. incredible computing power that dwarfs datacenters, zero latency, zero cost, private, distributed and resilient
I guess you imagine a world like Skype supernodes (Skype gave that up more than a decade ago) or Tor nodes (Tor is used by a tiny fraction of internet users).
Not saying it can't be done, but the effort is humongous.
Re: I want everything local – Building my offline AI workspace
#220The socialist EU allows only AI that serves the governance purpose. The EU has rightfully acknowledged that freedom of AI is essentially freedom of speech. Hacking officially stopped being non-political in EU. https://artificialintelligenceact.eu/ Enjoy understanding this here: https://artificialintelligenceact.eu/article/3/ Measures of Innovations rank at... Article 57! https://artificialintelligenceact.eu/ai-act-ex…
The EU isn't socialist, what are you going on about?
And AI - if true AI - can be "end of times" type tech, you think it won't be regulated? This is not hackers playing with breadboards in the 60s, it's Project Manhattan in the 40s.