OS?? Reallyy, What nonsense is this marketing?
Cloudflare OS: an open platform for agents, apps, and work
311–320 of 365 posts
Re: Cloudflare OS: an open platform for agents, apps, and work
#312Earlier quoted context omitted.
It's cool that it's open-source, but how much effort and scale would it take to run it on non cloud flare infra?
ffs there is literally no pleasing some people. "Hosting an open source project is too difficult! They should provide a free SaaS solution instead on their own cost but also no lock-in!!"
Open Source is a marketing term if your solution takes $2m worth of compute or devops time in order to run properly. The idea is, you have a way out if you want to leave. An option. But if leaving costs $x,xxx,xxx then that option was never there for most people. One example is NextJS. It's open source but even CloudFlare couldn't figure out how to run it properly on their platform.
Re: Cloudflare OS: an open platform for agents, apps, and work
#313Earlier quoted context omitted.
The code currently supports Anthropic, OpenAI, Gemini, Workers AI, and ollama as AI providers. It additionally optionally supports sending all requests through Cloudflare AI Gateway as a proxy. The same set of providers is supported either way, but when you configure AI Gateway, we assume you intend to install side-wide API keys into the gateway. The idea here is that you're setting up the gateway for your entire com…
I can't get an AI Gateway custom provider to work within CFOS (deployed to my CF account). No matter what custom model path I use in the cfos admin add provider mechanism, I get a model not found error when attempting to use the model in a conversation...
Yeah sorry, only the providers I listed are supported right now. We'll be widening support soon.
Re: Cloudflare OS: an open platform for agents, apps, and work
#314Earlier quoted context omitted.
The key is the fine-grained instances (gadgets). E.g. if you're using a slide editor app, each slide deck you create is its own instance of the app, whose code can be independently modified. The slide content and the code are kept together and sandboxed together. Adding HIPPA data to the app is no different to adding it to the slide content. I suppose whether or not that is OK depends on a lot of things, but the same…
I hope there are no healthcare CEOs reading this and if there are, please, for the love of god, do not let your execs or providers use cloud platforms to create apps with HIPAA data in them unless your lawyer is really bored and you have cash to burn on all the fines and lawsuits. Also don't offload yet another responsibility (i.e software development) to the people trying to take care of patients.
You can self-host using workerd.
But I'm certainly not claiming that this alone is sufficient to comply with regulations. I have no idea.
Re: Cloudflare OS: an open platform for agents, apps, and work
#315Everytime I read about new things from Cloudflare they look really cool but I cannot shake the feeling of not wanting to use them for fear of lock-in, am I too paranoid?
This is 100% open source and self-hostable. https://github.com/cloudflare/cloudflare-os It runs on top of our open source runtime. https://github.com/cloudflare/workerd
Kenton, back when I was building qbix.com/ecosystem you were building sandstorm, and I wanted to get in touch.
Now I have spent about 6 months building the hardened, self-hosted AI version that can be hosted in different clouds like AWS and GCP, and you shipped yours.
I think we’d have a lot to discuss. Should I reach out on gmail?
Re: Cloudflare OS: an open platform for agents, apps, and work
#316Anything with the word OS at the end never ends well...
Re: Cloudflare OS: an open platform for agents, apps, and work
#317An open platform tailored for agents and distributed apps is definitely the right primitive for the next-gen web. Very exciting project.
Re: Cloudflare OS: an open platform for agents, apps, and work
#318Why are companies slapping "OS" in their product naming? it's stupid
You're missing the subtle marketecture trick here they are doing..
Non-technical people don't always think of an OS as the computer OS. To them, sometimes it means more like standard operating procedure or process - a standard way of doing things.
Secondly, for tech products, calling yourself an OS, you are associating yourself with things like Windows, Mac or Linux. You are indirectly trying to grandstand and position yourself as meaningful enough to be an "OS" when clearly, that is far from what an app layer + AI/LLM on top of a real OS is.
The biggest giveaway is this, and I'm exposing it right here -from a technical perspective, what operating system computer technology was built from scratch from first principles around AI/LLM?
Someone wants to be the first company to get huge sums of money/funding to be that startup/project, so that is also a positioning tactic.
The issue is of course, most people are standing on the shoulders of giants at this point... and OS has this conflicted meaning with nontechnical users also about work process vs the software that runs my computer.
Re: Cloudflare OS: an open platform for agents, apps, and work
#319Earlier quoted context omitted.
Does workerd have full feature-parity with Workers, including stuff like Durable Objects?
It's the same code. The only thing it doesn't include is the global scheduling and orchestration, but you don't actually want that locally. (And honestly... that stuff is a bit of a beast.) Durable Objects are fully supported by workerd (and Cloudflare OS uses them extensively). There is, however, one catch currently: Durable Objects don't scale out well without the global scheduling. For running Cloudflare OS for on…
Thank you for coming in and replying to all of these comments with actionable, honest info!
Re: Cloudflare OS: an open platform for agents, apps, and work
#320Earlier quoted context omitted.
I can't get an AI Gateway custom provider to work within CFOS (deployed to my CF account). No matter what custom model path I use in the cfos admin add provider mechanism, I get a model not found error when attempting to use the model in a conversation...
Yeah sorry, only the providers I listed are supported right now. We'll be widening support soon.
How does the cloudflare-based deployment of cfos get updated? If I "redeploy" will it get updates from cfos upstream? Eg, for when you add new stuff like this upstream..