Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cloudera and Hortonworks merge

cnbc.com

Post reply on HN
Print view View original

21–30 of 60 posts

Re: Cloudera and Hortonworks merge

#21

Post by ironchef »

agibsonccc wrote: post #20
jamesblonde wrote: post #18

Earlier quoted context omitted.

Ok, now you're changing your angle. Differentiated tech is what we are all about - that is ok by me (for now). If you want to train DNNs on a hundred GPUs today on-premise on TensorFlow, come to us, we can do it. They can't.

I don't think I changed my angle here? I'm still addressing the same point. Tech doesn't matter. Simplicity does. Even in our own product line, we only do a small subset of this. We don't even require a cluster to run. We also work with tech that people use. You are currently competing with horovod and kubeflow. eg: "competing with free" You need more than that to survive. Generally, that comes down to services.

A slightly different wording is it comes to using the tech... which is either through services or through adoption / operationalization (which... with complexity... is very difficult)

Re: Cloudera and Hortonworks merge

#22

Post by purplezooey »

capkutay wrote: post #8

Good move for both companies. The surplus of 'enterprise hadoop' companies was created by a mixture of hype and a peak in VC investment in open source. The fact that Cloudera, Hortonworks, MapR were all founded and raised $100m+ around the same time was a bit superfluous for the whole market. Hard to say where this leaves MapR now. They seem to be the odd man out in terms of growth and adoption.

My current company uses MapR and I have to say their software is impressive. It's much easier to use than CDH or HDP. I think they'll do fine.

Re: Cloudera and Hortonworks merge

#23

Post by agibsonccc »

ironchef wrote: post #21
agibsonccc wrote: post #20

Earlier quoted context omitted.

I don't think I changed my angle here? I'm still addressing the same point. Tech doesn't matter. Simplicity does. Even in our own product line, we only do a small subset of this. We don't even require a cluster to run. We also work with tech that people use. You are currently competing with horovod and kubeflow. eg: "competing with free" You need more than that to survive. Generally, that comes down to services.

A slightly different wording is it comes to using the tech... which is either through services or through adoption / operationalization (which... with complexity... is very difficult)

Exactly!

Re: Cloudera and Hortonworks merge

#24

Post by dirkgently »

capkutay wrote: post #8

Good move for both companies. The surplus of 'enterprise hadoop' companies was created by a mixture of hype and a peak in VC investment in open source. The fact that Cloudera, Hortonworks, MapR were all founded and raised $100m+ around the same time was a bit superfluous for the whole market. Hard to say where this leaves MapR now. They seem to be the odd man out in terms of growth and adoption.

> surplus

Define surplus. Why having 3 or 4 companies in 1B plus market is surplus?

Re: Cloudera and Hortonworks merge

#25

Post by dfee »

dirkgently wrote: post #24
capkutay wrote: post #8

Good move for both companies. The surplus of 'enterprise hadoop' companies was created by a mixture of hype and a peak in VC investment in open source. The fact that Cloudera, Hortonworks, MapR were all founded and raised $100m+ around the same time was a bit superfluous for the whole market. Hard to say where this leaves MapR now. They seem to be the odd man out in terms of growth and adoption.

> surplus Define surplus. Why having 3 or 4 companies in 1B plus market is surplus?

Because there are typically uneven returns due to the winner-takes-most style of internet businesses.

Differentiation is of course key, then.

Re: Cloudera and Hortonworks merge

#26

Post by HenryR »

jamesblonde wrote: post #9
capkutay wrote: post #8

Good move for both companies. The surplus of 'enterprise hadoop' companies was created by a mixture of hype and a peak in VC investment in open source. The fact that Cloudera, Hortonworks, MapR were all founded and raised $100m+ around the same time was a bit superfluous for the whole market. Hard to say where this leaves MapR now. They seem to be the odd man out in terms of growth and adoption.

We have a startup, Logical Clocks (www.logicalclocks.com), that just raised money to sell our data-science next-generation Hadoop stack. It has a new verison of HDFS called HopsFS (Nvme storage, distributed metadata) and support for GPUs in YARN. And distributed tensorflow, Spark, Airflow, Flink. So, what does that mean for us? I am shellshocked. I expect prices to increase (good for us). What else should we expect?

I am surprised that anyone is trying to differentiate on storage at this time, precisely when that's the part of the stack that's being cannibalized by the cloud vendors (look at the rate of innovation in HDFS over time; the effort is going elsewhere). Are you just targeting on-premise clusters, or is there some differentiation planned for the cloud as well?

Re: Cloudera and Hortonworks merge

#27

Post by Tsarbomb »

Can someone explain to me what the big draw was for Hortonworks or Cloudera?

Working as a lead in a small team that deals with a colossal amount of data (human genomics), it was always easier for us to hand roll deployments with terraform/ansible in either baremetal or OpenStack environments.

In the public clouds like AWS we are using the managed services like EMR.

The whole sales pitch I've always got from either hortonworks or Cloudera always seemed more aimed at nontechnical stakeholders than the technical ones. Am I wrong? Have I missed out on some cool stuff?

Re: Cloudera and Hortonworks merge

#28

Post by thinkmassive »

> The two companies are committed to supporting existing offerings from the two companies for at least three years but will work on a "unity release" of software, drawing on technologies from both companies' portfolios, Reilly said.

I’m really intrigued to see whether Ambari or Cloudera Manager wins out in the long run. This is unexpected but interesting.

(I worked at Hortonworks 2014-2016, no current affiliation)

Re: Cloudera and Hortonworks merge

#30

Post by sfohohoho »

Tsarbomb wrote: post #27

Can someone explain to me what the big draw was for Hortonworks or Cloudera? Working as a lead in a small team that deals with a colossal amount of data (human genomics), it was always easier for us to hand roll deployments with terraform/ansible in either baremetal or OpenStack environments. In the public clouds like AWS we are using the managed services like EMR. The whole sales pitch I've always got from either ho…

It's cool bro. You obviously are a np. Million dollar Cloudera deployments with 1000s of ba users. You missed out on working for a large, for profit, business. Not a big deal.
Post reply on HN