Live data from Hacker News

Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

oath.com

21–30 of 122 posts

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#21

Yahoo time and again releases open source software which is super super helpful to the community at large. But it always makes me wonder why an org with such an amazing engg culture (multiple anecdotes from friends who were at Yahoo, plus the amazing experiences at Yahoo OpenHack each year as a testament to this) could be run into the ground. Really goes to show that engg != business and unless you have a firm busine…

ok if I ask what company, I have some interest in the area.

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#22
post #20

Yahoo time and again releases open source software which is super super helpful to the community at large. But it always makes me wonder why an org with such an amazing engg culture (multiple anecdotes from friends who were at Yahoo, plus the amazing experiences at Yahoo OpenHack each year as a testament to this) could be run into the ground. Really goes to show that engg != business and unless you have a firm busine…

IMHO, yahoo has bad investors. One of the proof is the firing of Marissa Meyer. As soon as she was hired, the reputation of yahoo has started to improve. All the fights of investors against her until they make her leave had the opposite effect. It takes years to build a reputation and it takes more years for this reputation to bring dividends. I have a similar feeling for Microsoft. The reputation has (slowly) improv…

Meyer basically destroyed a healthy, but not growing, company in the span of 4 years through short-term number-massaging actions at the cost of their competent engineers and core product development.

Nadella isn't making a particularly strong case for MS either with his seeming distaste for any product of theirs that isn't either mobile or cloud-based (like the ones where they actually have a monopoly to build off and no competition worth speaking of), which seems to arise from that 'chasing growth numbers' mindset.

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#23

  $ cloc-git https://github.com/vespa-engine/vespa.git
  http://cloc.sourceforge.net v 1.60  T=64.10 s (224.5 files/s, 28276.3 lines/s)
  --------------------------------------------------------------------------------
  Language                      files          blank        comment           code
  --------------------------------------------------------------------------------
  Java                           6573         106215         102720         537097
  C++                            3209          76542          19178         504855
  C/C++ Header                   2985          42731          57087         158388
  XML                             389            705            550         139626
  Maven                           141            133            244          14096
  CMake                           450            254            560           8452
  Perl                             57           1124            762           7649
  Bourne Shell                    196           1257            734           6918
  Scala                            95           1685            617           6378
  Teamcenter def                  234           1474           3490           2468
  Lisp                              4            231            403           2118
  HTML                             16            211             29           1950
  C                                 7            288            198           1432
  Python                            6            132             66            556
  Ruby                              9             39              9            294
  Bourne Again Shell                3             35             12            182
  Pig Latin                         9             39             52             54
  make                              2             22              8             39
  Ant                               1              9             17             36
  YAML                              1              9              1             22
  DTD                               2              6              6             10
  --------------------------------------------------------------------------------
  SUM:                          14389         233141         186743        1392620
  --------------------------------------------------------------------------------

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#24
post #22
post #20

Earlier quoted context omitted.

IMHO, yahoo has bad investors. One of the proof is the firing of Marissa Meyer. As soon as she was hired, the reputation of yahoo has started to improve. All the fights of investors against her until they make her leave had the opposite effect. It takes years to build a reputation and it takes more years for this reputation to bring dividends. I have a similar feeling for Microsoft. The reputation has (slowly) improv…

Meyer basically destroyed a healthy, but not growing, company in the span of 4 years through short-term number-massaging actions at the cost of their competent engineers and core product development. Nadella isn't making a particularly strong case for MS either with his seeming distaste for any product of theirs that isn't either mobile or cloud-based (like the ones where they actually have a monopoly to build off an…

Yeah she was terrible. Their homepage still sucks, freezes up my browser all the time.

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#25

Yahoo time and again releases open source software which is super super helpful to the community at large. But it always makes me wonder why an org with such an amazing engg culture (multiple anecdotes from friends who were at Yahoo, plus the amazing experiences at Yahoo OpenHack each year as a testament to this) could be run into the ground. Really goes to show that engg != business and unless you have a firm busine…

Because often there's no correlation between engineering culture and business.

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#26
post #22
post #20

Earlier quoted context omitted.

IMHO, yahoo has bad investors. One of the proof is the firing of Marissa Meyer. As soon as she was hired, the reputation of yahoo has started to improve. All the fights of investors against her until they make her leave had the opposite effect. It takes years to build a reputation and it takes more years for this reputation to bring dividends. I have a similar feeling for Microsoft. The reputation has (slowly) improv…

Meyer basically destroyed a healthy, but not growing, company in the span of 4 years through short-term number-massaging actions at the cost of their competent engineers and core product development. Nadella isn't making a particularly strong case for MS either with his seeming distaste for any product of theirs that isn't either mobile or cloud-based (like the ones where they actually have a monopoly to build off an…

Microsoft products? "Windows is a service" is the word now, as firmly stated by a recent message demanding a PC reboot.

(The first sentence was "Windows is a service and updates are a normal part of keeping it running smoothly.")

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#27
post #20

Yahoo time and again releases open source software which is super super helpful to the community at large. But it always makes me wonder why an org with such an amazing engg culture (multiple anecdotes from friends who were at Yahoo, plus the amazing experiences at Yahoo OpenHack each year as a testament to this) could be run into the ground. Really goes to show that engg != business and unless you have a firm busine…

IMHO, yahoo has bad investors. One of the proof is the firing of Marissa Meyer. As soon as she was hired, the reputation of yahoo has started to improve. All the fights of investors against her until they make her leave had the opposite effect. It takes years to build a reputation and it takes more years for this reputation to bring dividends. I have a similar feeling for Microsoft. The reputation has (slowly) improv…

Boardroom drama and IR conference calls turning into a 4chan style discussions are characteristic of Big Co. culture as such in US. The few successful big companies that evaded that predicament, were the ones with either poison pill provisions, or other tricks that made them "taste bad" for activist investors and other nasty guys from financial industry

Loss of direction is what stalls big tech companies 9 times out of 10. If you have 10 decision making actors on the board of directors, you have to effectively do 10 different things that each of that guys want, and all of them with compromises made to accommodate the 9 remaining other things that had to be done simultaneously.

My father frequently says that "a public company is a like a woman with 10 husbands, all trying to make love to her at the same time"

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#28

$ cloc-git https://github.com/vespa-engine/vespa.git http://cloc.sourceforge.net v 1.60 T=64.10 s (224.5 files/s, 28276.3 lines/s) -------------------------------------------------------------------------------- Language files blank comment code -------------------------------------------------------------------------------- Java 6573 106215 102720 537097 C++ 3209 76542 19178 504855 C/C++ Header 2985 42731 57087 1583…

As an ex-employee, there could not be a better description of Yahoo! development than this.

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#29

$ cloc-git https://github.com/vespa-engine/vespa.git http://cloc.sourceforge.net v 1.60 T=64.10 s (224.5 files/s, 28276.3 lines/s) -------------------------------------------------------------------------------- Language files blank comment code -------------------------------------------------------------------------------- Java 6573 106215 102720 537097 C++ 3209 76542 19178 504855 C/C++ Header 2985 42731 57087 1583…

Pig Latin?

Re: Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine

#30
post #29

$ cloc-git https://github.com/vespa-engine/vespa.git http://cloc.sourceforge.net v 1.60 T=64.10 s (224.5 files/s, 28276.3 lines/s) -------------------------------------------------------------------------------- Language files blank comment code -------------------------------------------------------------------------------- Java 6573 106215 102720 537097 C++ 3209 76542 19178 504855 C/C++ Header 2985 42731 57087 1583…

Pig Latin?

That would be Apache Pig, a scripting language for Hadoop. Some scripts are included to feed data to and query Vespa from Hadoop.

https://github.com/vespa-engine/vespa/tree/master/vespa-hado...

Post reply on HN