Live data from Hacker News

Intel Pulls Out of OpenStack Effort It Founded with Rackspace

fortune.com

61–70 of 118 posts

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#61
post #38

From someone not very invested in the OpenStack process it feels like all the momentum of the recent push of the project just withered away all at once. I am not sure if the container crowd ate it's lunch, where containerized appliances just solve the problem of openstack better.

OpenStack is a platform for creating an Infrastructure as a Service (IaaS). So it's running on some physical machines, and manages your physical machines to slice into VMs. There you get to manage / create networks, storage, etc. Basically running a private cloud in your own datacenter/basement/office. Openstack has grown more than just compute. It has a supposedly compatible interface for S3 an object storage system…

This seems to get back to an interesting discussion I had with someone early in the OpenStack efforts: as a developer OpenStack doesn't directly interest me because I don't care about infrastructure. Where OpenStack had a possibility to win was to provide options for infrastructure agnosticism: if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potential time and money from having to port apps to/from/between AWS, Azure, Google Cloud, et al (assuming of course that it enough clouds actually adopt).

From that perspective, container solutions are delivering a better developer proposition than OpenStack has yet managed. There are ways now to build container clusters that you can ship in parallel to AWS and Azure with very little code difference.

In that earlier discussion I was skeptical of OpenStack precisely because of its focus on infrastructure first. Without the buy in of being a clone for a specific cloud structure (AWS compatibility over anything else, for instance) or the backing of traditional datacenter/server vendors (IBM who eventually started into BlueMix; Microsoft whose "on premises Azure" is now firing on most cylinders but was announced as a plan early in OpenStack's history), OpenStack didn't seem to have an obvious niche in the infrastructure world. The closest to a niche it might have had in its early life was the promise of application portability between clouds and that never quite seemed to be delivered.

I can tell it frustrates infrastructure folks to hear that containers have been eating OpenStack's lunch, but that is the very real case from the developer perspective. As a developer today, I go for containers and OpenStack is no longer relevant on my radar. Sure I can run containers on OpenStack, but containers abstract away more of the infrastructure and I have less and less care what cloud(s) is underneath the container cluster. When I asked OpenStack people what OpenStack might deliver to me that vision of application portability was tantalizing but never seemed quite finished; container technologies have actually delivered that.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#62
post #13

Earlier quoted context omitted.

I don't know about today, but a few years ago I tried to set it up and found it to be an uninstallable massive ball of twine and chewing gum. It was shockingly clunky. I can't imagine running something like that in production. I suppose it'd be good job security for a lot of sysadmins.

I just moved into an openstack development job, and I'm struggling. So many technologies and complexities you have to keep in mind, even within a single project. I'm hoping it comes together soon. I have not provided a ton of value yet just sitting here learning, and breaking so many things.

It is a lot to ingest. Can you elaborate on the OpenStack development you are doing?

OpenStack refers to a number of different projects (Nova, Neutron, Horizon, etc). I would advise getting a high level understanding of how Nova, Neutron, and Cinder/Swift interoperate. Then drill in to Neutron. As with every other cloud platform I've worked with, most of the IaaS complexity lies in Networking, in my opinion. Neutron, and SDN in general, is a fairly complex topic depending on your experience with network architecture and administration.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#63
post #2

I never saw a compan benefitting from openstack.

I'm at one of the only companies I know of outside Rackspace that's running it in production. We're doing a very poor job of it; we never hit production with any effort to upgrade the cluster in the past three years, so we're still running Havana with Nova Network. The most likely upgrade path for us right now is VMWare 6.5.

I worked for a company (Nobis Technology Group) that was acquired by LeaseWeb USA; I was a part of the "server automation" team and was somewhat reluctantly "forced out" of the team after the transition (they basically offered to pay me a smaller salary to work for them - do I look stupid?).

The team was essentially dissolved several months later, as I knew it would be.

But for the short period I was there (about 2 years), it was a great place to work, and a high point in my total career. Prior to that position, I had been doing web development in PHP pretty much exclusively. Doing server automation was a completely new space to me.

Soon after starting, our team was tasked with a migration to OpenStack. Since our current infrastructure front-end was already based on PHP, I got tasked with looking into how or if we could use PHP OpenCloud to work with OpenStack. It seemed workable to me; I was able to extend the classes in such a way using namespaces and other techniques so that we could add additional capabilities to the interface that weren't already supported (and there were a lot of holes to fill!), but wouldn't break things if/when we had to upgrade OpenCloud (this was ultimately tested a couple times I was there, and the changes proved flawless - at least on the PHP side).

Ultimately, we had a nice stable front-end that worked well with both our original system (some VM architecture that I forget) and the new "cloud" infrastructure based around OpenStack. In effect, a user could deploy either an actual server (if available), provision a VM (if a server was available), or build a cloud server "system" from a myriad of parts (we tried to support and provide as much access to the OpenStack stuff as we could). We also had a RESTful API for clients to also used (some of our clients resold our services under their own names). Some of the backend stuff was a bit "messy" in how it worked (I won't go into details, but I "authored" a fake "O'Reilly" "book" (really just a front "cover" mainly) whose mascot was dickbutt) - but despite the mess, overall it worked well, considering all the moving parts (where it would tend to fall down - not always, but enough - was when an upgrade to OpenStack was performed).

In short - we were also one of the few companies running OpenStack in production. Our owners ended up selling to LeaseWeb, I left - but the idea was that LeaseWeb wanted to transition things to their API and system, and I honestly don't know what happened with all the work and such I was involved in on the PHP side of things (there was also a point where me and a coworker had to quickly ramp up and learn GoLang to make an interface from Rancher/Docker over to the Nobis API - that was a fun and interesting experience). I imagine that some portion is still running, but who knows.

I personally think that in the right hands and with the right infrastructure OpenStack can be a very workable and working technology. It seemed to work well for the systems we used while I was at Nobis. I don't know honestly whether you could use it to scale up to anything like AWS or Google's offerings, but I think for medium-sized stuff like we were doing (or like Digital Ocean does - who at the time was our direct competition), it can work well - at least as I experienced things.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#64

From someone not very invested in the OpenStack process it feels like all the momentum of the recent push of the project just withered away all at once. I am not sure if the container crowd ate it's lunch, where containerized appliances just solve the problem of openstack better.

[Disclosure: I spend a (not too large) _portion_ of my time on the OpenStack Compute project, so adjust my comments for bias.] Please. You seem to be making the same mistake, that many make on blogs and news websites, of exclaiming "containers are the future!" while both VMs and containers have their place and use-cases. I'd rather suggest you read the below. (Since I'm linking to a blog, quick background about the a…

VMs have their place, but a lot of what kind of built the OpenStack hype engine - dynamic workload deployment and multitenant-style management - also is what driving the (also partly aspirational) deployment of containers.

The thing is, though, they are at odds. Enterprises don't have nearly the dynamic workload set that people thought but where they legitimately have some is in devops style development. And if you have container management, which you do, then highly dynamic VM management is much less valuable.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#65

the article mentions other big players pulling out or cutting jobs/funding related to OpenStack in recent months in addition to this latest move by Intel. Is this related to some endemic problem with the technology, big egos within the project, dominance by another outside player or what? Cursory searching doesn't reveal any "big thing". Maybe it's just dying a death by a thousand cuts.

I figure Intel's participation was hinged on supporting a growing fleet of competitors to AWS, who would bid up chip prices. I guess that isn't happening. IMO, OpenStack was sort of a consortium effort to compete with VMWare, AWS and Salesforce, but it's operational model is closest to AWS. Nearly all the big enterprise IT companies tied their rafts together hoping to stave the flow of customers. It doesn't appear to…

> It seems their big push is cloudfoundry, which seems to be more about containers and k8s.

Cloud Foundry is built on technologies that predate k8s, but yes, containerisation is the unit of operational currency.

Insofar as Dell EMC has a multi-play, it also includes Pivotal, which is the leading contributor to Cloud Foundry. Unsurprisingly it runs smoothly on VMWare, as well as AWS, GCP, Azure, OpenStack and I forget what else.

Disclosure: I work on Cloud Foundry on behalf of Pivotal.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#66

the article mentions other big players pulling out or cutting jobs/funding related to OpenStack in recent months in addition to this latest move by Intel. Is this related to some endemic problem with the technology, big egos within the project, dominance by another outside player or what? Cursory searching doesn't reveal any "big thing". Maybe it's just dying a death by a thousand cuts.

Openstack was supposed to be a vendor based consultant bonanza. It wasn't designed by or for the users or customers, if it was designed at all. Instead it was a vehicle for hardware vendors to sell compatible product and consultants to build something they'd have to service forever afterwards. (Yes this is a cynical and half joking take, but it's also serious) So what went wrong? Welll, If you're not going to build a…

The problem is that "consulting bonanza" with open source software is really hard to do. It is really, really hard to draw a line between what is custom engineering and what is a non-upstream patch you will have to maintain forever. And that's why Red Hat's mantra is to do everything upstream first, even at the cost of sometimes delivering features later.

Everybody got that completely wrong. Open source works, but you still have to understand how to engineer it. So far, companies that succeeded are mostly following an "open core" model where they control the core too (Atlassian, Automatic). Red Hat is the exception, and with Red Hat putting a lot of effort on upstream OpenStack development no one could pull off open core for OpenStack. Mirantis has plenty of non-upstream code and last I heard wants to sell SaaS to work around that.

Plus, no one devoted the right amount of engineering to the lower levels of the stack (at least QEMU and libvirt). You cannot seriously expect to partner with vendors for guest operating systems without knowing all of the stack---this was something else that Mirantis and others missed.

So the problem was not that OpenStack was bad, it was that everybody thought open source is magic. But it isn't magic, and if it looks like magic, it means you don't understand it.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#67
post #38

Earlier quoted context omitted.

OpenStack is a platform for creating an Infrastructure as a Service (IaaS). So it's running on some physical machines, and manages your physical machines to slice into VMs. There you get to manage / create networks, storage, etc. Basically running a private cloud in your own datacenter/basement/office. Openstack has grown more than just compute. It has a supposedly compatible interface for S3 an object storage system…

This seems to get back to an interesting discussion I had with someone early in the OpenStack efforts: as a developer OpenStack doesn't directly interest me because I don't care about infrastructure. Where OpenStack had a possibility to win was to provide options for infrastructure agnosticism: if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potent…

> if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potential time and money from having to port apps to/from/between AWS, Azure, Google Cloud, et al (assuming of course that it enough clouds actually adopt).

OpenStack is at the same layer as AWS, GCP or Azure. It's not an abstraction over them -- that's a PaaS. I'm not sure OpenStack was ever seriously intended to work at that level.

I work on a platform, Cloud Foundry, which provides the kind of portability you're talking about. Red Hat have OpenShift, which is another such platform.

Disclosure: I work on Cloud Foundry on behalf of Pivotal.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#68
post #38

Earlier quoted context omitted.

OpenStack is a platform for creating an Infrastructure as a Service (IaaS). So it's running on some physical machines, and manages your physical machines to slice into VMs. There you get to manage / create networks, storage, etc. Basically running a private cloud in your own datacenter/basement/office. Openstack has grown more than just compute. It has a supposedly compatible interface for S3 an object storage system…

This seems to get back to an interesting discussion I had with someone early in the OpenStack efforts: as a developer OpenStack doesn't directly interest me because I don't care about infrastructure. Where OpenStack had a possibility to win was to provide options for infrastructure agnosticism: if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potent…

> if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potential time and money from having to port apps to/from/between AWS, Azure, Google Cloud, et al (assuming of course that it enough clouds actually adopt).

> There are ways now to build container clusters that you can ship in parallel to AWS and Azure with very little code difference.

OpenStack is an IaaS, so just like AWS. Focus on the context. Do you want your own private cloud? Yes or not?

If no, then this discussion can end, because AWS and Azure run on their proprietary IaaS code. As a customer, you request resources from the IaaS layer, and you build your server/platform from that point.

So arguing that container clusters can ship to other clouds with very little change (almost likely writing the APIs to create a container) is unfair in the context of why one would choose container over OpenStack. The purpose is different.

If your answer is yes I am building a private cloud, how are you going to do that with Docker alone? Can you build a software-defined network with Docker? Absolutely not with Docker since Docker is a host-based deployment solution.

What you are looking for is ability to create OpenStack the same way CloudFoundry / Kubernetes are created. You write up a manifest, and the necessary databases and services are deployed to some EC2 machines. In the case of CloudFoundry, you write up a manifest file, describes number of instances, types, credentials, what not, then call Bosh to create Cloud Foundry (will create a pool of app machines, router servers, UAA, etcd etc). Machines are created based on a stemcell, basically an image. You want to create your IaaS based on images. You want to be able to script up a manifest and deploy your IaaS. You want a lift and drop IaaS infrastructure. Container can do that, but it cannot be done simply with Docker. You need that infrastructure abstraction layer to cover up. That's probably what Docker Enterprise Edition might do, but I have not really dig into it yet.

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#69
post #37

Is there an alternative out there for OpenStack? Perhaps a minimalist version?

If you just want clustered virtual machines, check out Ganeti[0]. It's not advertised much, but this piece of software hosts most of Googles internal infrastructure (not public facing stuff). Unlike Openstack, it has a proper scheduler, and lets you rebalance VMs across hypervisors efficiently. Also unlike Openstack, it can restart VMs if it (or the hypervisor) dies, if you've enabled that. And completely orthogonal…

[deleted]

Re: Intel Pulls Out of OpenStack Effort It Founded with Rackspace

#70
post #68

Earlier quoted context omitted.

This seems to get back to an interesting discussion I had with someone early in the OpenStack efforts: as a developer OpenStack doesn't directly interest me because I don't care about infrastructure. Where OpenStack had a possibility to win was to provide options for infrastructure agnosticism: if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potent…

> if I can build an app that runs "unmodified" on any OpenStack-based infrastructure, that has a possibility to save me potential time and money from having to port apps to/from/between AWS, Azure, Google Cloud, et al (assuming of course that it enough clouds actually adopt). > There are ways now to build container clusters that you can ship in parallel to AWS and Azure with very little code difference. OpenStack is…

Yes, it is an unfair comparison. I was attempting to explain in my comment why I consider it a valid unfair comparison, because it is a matter of perspective.

As a software developer, do I ever want a private cloud? No. Does my employer? Maybe. Is it my job to tell them how to invest their infrastructure dollars? Quite possibly no, because software development and infrastructure are typically held at arms length. But even when they are not in a "proper" DevOps shop, the ballgame of which cloud is then subservient to developer convenience and how easy it is to deploy software to a cloud and how productive developers are writing software for that cloud.

So yes, the purpose of OpenStack and Container technologies are very different and I appreciate that technically. In terms of real world value to me as a software developer, however, I have platform problems not infrastructure problems. I don't care what the infrastructure is under the service so long as it provides a stable, reliable platform for me to build upon. Containers abstract that for me in a way that solves real platform problems that OpenStack was only ever relevant to me in so far as its ability to once hint at a possible solution to. That's not fair and that was expecting too much from OpenStack at the time, but that's life.

Post reply on HN