[flagged]
Cloudflare OS: an open platform for agents, apps, and work
261–270 of 365 posts
Re: Cloudflare OS: an open platform for agents, apps, and work
#262They gated it to US providers only, fucking garbage
Not intentionally, we just haven't gotten around to expanding the provider list beyond what we use regularly. There is ollama (local LLM) support in there. But we'll probably expand it to everything pi-agent-core supports, just need some UI work.
I'm talking about setting up one provider for the entire OS not about BYOK per user. Right now only cloudflare AI gateway is supported and in it you hardcoded it to US providers. Plus your AI workers and from your model you only supporting two.
Re: Cloudflare OS: an open platform for agents, apps, and work
#263Earlier quoted context omitted.
Not intentionally, we just haven't gotten around to expanding the provider list beyond what we use regularly. There is ollama (local LLM) support in there. But we'll probably expand it to everything pi-agent-core supports, just need some UI work.
I'm talking about setting up one provider for the entire OS not about BYOK per user. Right now only cloudflare AI gateway is supported and in it you hardcoded it to US providers. Plus your AI workers and from your model you only supporting two.
The code currently supports Anthropic, OpenAI, Gemini, Workers AI, and ollama as AI providers.
It additionally optionally supports sending all requests through Cloudflare AI Gateway as a proxy. The same set of providers is supported either way, but when you configure AI Gateway, we assume you intend to install side-wide API keys into the gateway. The idea here is that you're setting up the gateway for your entire company, and you want all users to use the same keys. So we no longer let individual users configure their own keys in this mode -- instead they can choose from among the providers you have configured site-wide.
We will expand the provider list soon.
Re: Cloudflare OS: an open platform for agents, apps, and work
#264Earlier quoted context omitted.
What do you mean? This is 100% open source and self-hostable! https://github.com/cloudflare/cloudflare-os It runs on the open source Workers Runtime: https://github.com/cloudflare/workerd You can run it at home if you want. There's even a Home Assistant Gatekeeper.
I'd say better to not call it Cloudflare in that case
The idea is actually supposed to be that Cloudflare OS is Cloudflare's internal instance, but when you deploy it for your own company, you call it " OS".
The product name and logo are configurable in the admin settings.
Yeah it's a little cheesy. Sorry.
Re: Cloudflare OS: an open platform for agents, apps, and work
#265Interesting bit from the repo: there is an agent's plan (presumably unintentionally) checked in two days ago as part of a rewrite from the Vercel AI SDK to pi-agent-core ( https://github.com/cloudflare/cloudflare-os/blob/main/plans/... ). That plan states "The project is in early alpha — minor behavioral regressions are acceptable and will be fixed as discovered.".
Yeah, I checked that in intentionally. I've started checking in plans under `plans/` so that people can see the plan during code review, and also so I can refer to it when I prompt agents about things related to the plan. My usual process for using AI is I first tell it what I want and have it write out a plan. I then review the plan, make comments, and go back and forth until I like it. Then I ask it to implement. I find this makes the final code output much easier to review -- it's almost always very close to what I want on the first try.
The project is indeed in early stages. That's mentioned in the readme as well.
The reason I had to tell the agent this explicitly is because Fable's original plan called for an overly careful process involving a 2-3 day "spike" to test and derisk. It also wanted to write an elaborate test harness that would run every message through both the old and new paths and compare the results to ensure feature parity. It was way too cautious. I knew that the conversion would actually work fine. And, in fact, it did: the conversion actually fixed more bugs than it introduced.
I tweeted about this at the time: https://x.com/KentonVarda/status/2084293600142135365
Re: Cloudflare OS: an open platform for agents, apps, and work
#266Earlier quoted context omitted.
ffs there is literally no pleasing some people. "Hosting an open source project is too difficult! They should provide a free SaaS solution instead on their own cost but also no lock-in!!"
I think it’s a legitimate question! Some companies operate at such a scale that if you tried to adopt their tools or services, it would be way too complex for the ROI. Think Bazel or how K8s was for ~ever. For Google’s scale? Required. For a small team? A net-negative.
workerd stand-alone is designed to work well at small-medium scale.
If we open sourced Cloudflare's production scheduler, nobody would be able to use it because it is explicitly designed for HUGE, globe-spanning scale. Well, nobody except our direct competitors.
But the goal with workerd is actually that it should be pretty easy to run, about as easy as Node. Stateless workloads should scale trivially (just add more instances and load balance). For Durable Objects (statefull), currently it doesn't scale well at all, but I'm working on changes[0] so that it scales nicely across a cluster. I intentionally chose a design here that is operationally easy to set up. (Basically: just connect all the nodes to NFSv4.)
Re: Cloudflare OS: an open platform for agents, apps, and work
#267Interesting bit from the repo: there is an agent's plan (presumably unintentionally) checked in two days ago as part of a rewrite from the Vercel AI SDK to pi-agent-core ( https://github.com/cloudflare/cloudflare-os/blob/main/plans/... ). That plan states "The project is in early alpha — minor behavioral regressions are acceptable and will be fixed as discovered.".
I tried to make something in the same spirit
Re: Cloudflare OS: an open platform for agents, apps, and work
#268Earlier quoted context omitted.
I think because the idea of an "agent operating system" is starting to feel more and more inevitable. Since I can use AI to: - Pull information from external sources - Transform and/or augment that information - Publish information I almost do not need a traditional OS anymore. This obviously isn't entirely true: I still use it to interact directly with humans, and it's the way I access my LLM. For now.
You need a "traditional" operating system to even run your LLM, or do you have your own custom collection of drivers you flash your machine with? :p
I already mentioned this:
> This obviously isn't entirely true: [...] it's the way I access my LLM.
It doesn't change my opinion that there's a very real possibility that we move to thin clients or microkernels intended primarily to run chat interfaces (or some other UI that organizes LLM sessions and their outputs) either locally on the hardware, or against cloud computing environments. An operating system is just the interface a user has with their computer.
More to the point - it is possible to run an operating system on top of another operating system: this is what VMs are. I'm obviously not claiming that LLMs replace the glue between hardware and software(?!)
Re: Cloudflare OS: an open platform for agents, apps, and work
#269Earlier quoted context omitted.
I think because the idea of an "agent operating system" is starting to feel more and more inevitable. Since I can use AI to: - Pull information from external sources - Transform and/or augment that information - Publish information I almost do not need a traditional OS anymore. This obviously isn't entirely true: I still use it to interact directly with humans, and it's the way I access my LLM. For now.
> I almost do not need a traditional OS anymore. You sure about that?
[deleted]
Re: Cloudflare OS: an open platform for agents, apps, and work
#270Earlier quoted context omitted.
I think because the idea of an "agent operating system" is starting to feel more and more inevitable. Since I can use AI to: - Pull information from external sources - Transform and/or augment that information - Publish information I almost do not need a traditional OS anymore. This obviously isn't entirely true: I still use it to interact directly with humans, and it's the way I access my LLM. For now.
smells like lock-in to me.
I'm not advocating for this model. But I'm also not sure it has any more lock-in than choosing an OS today: Windows, macOS, Linux, ChromeOS, Android, iOS.