Earlier quoted context omitted.
I've implemented a distributed worker system on top of this paradigm. I used ZMQ to connect nodes and the worker nodes would connect to an indexer/coordinator node that effectively did a `SELECT FROM ORDER BY ASC`. It's easier than you may think and the bits here ended up with probably - Coordinator node ingests from a SQL table - There is a discriminator key for each row in the table for ordering by stacking into an…
Yeah, but that's like doing actual engineering. Instead you should just point to Kafka and say that it's going to make your horrible architecture scale magically. That's how the pros do it.
IBM to acquire Confluent
171–180 of 374 posts
Re: IBM to acquire Confluent
#172IBM have an absolutely stellar record of blowing acquisitions. The highly motivated newly acquired team will be in honeymoon phase for 3 months, and then it slowly dawns on them that they’ve joined an unbelievably rigid organization where things like customer satisfaction and great products don’t matter at all. Then they’ll be in shock and disbelief at the mind boggling Byzantine rules and internal systems they have…
They seem to primarily benefit from kickbacks in the form of both leasing and technical contracts for things like opening offices in a location for tax benefits or to promote local economy.
Then they see how far they can cut back their end of the contract after the first few months (e.g. Maybe we agreed to have 500 employees in an office, but since nobody is allowed in, we think we can get away with 100 employees.) Then this turns into trolling about how the contract never defines what in office means so can we offshore… Too much undefined confusion, so I guess we get to break the contract but keep what the mayor paid us… Then they just shut down the office and move on to the next location.
It seems like the local government must be in on these schemes for leasing. Otherwise this wouldn’t be going on for decades as it has been.
The other part of business, technical contracts, is similar except instead of leasing it’s providing some sort of infrastructure coverage for something big. It starts off with good faith fulfilling the contract. Then a few months later it’s like well we have a US military contract that demands US employees but US employees are too expensive. What if we offshore but all the traffic is technically going through a single US employee’s computer which is what the contract technically demands.
Then it turns into well we have offshore people working on this anyway, why not just give them direct access and we’ll have a US person overseeing them. Lay everyone else off.
Then they see how long they can get away with this until someone gets mad. Then they take one step back to see how close to the technical contract they can get while threatening to abandon the whole thing at the same time.
Along with this sort of atmosphere and attitude for the law, it seems we see them constantly doing everything possible to constantly fire old people or anyone else that has legally protected status. So you’ll get statistical analytics on ways to fire protected people based around the constant performance reviews with statistics being used to see how close groups of protected people can be removed without statistically breaking the law. Whatever that algorithm is.
That plays into just straight up cutting people, but it also goes into a lot of other subsystems of skirting the law, like if old people can’t relocate as easily then hopping offices and forcing people to relocate 5000 miles is a way they can be eliminated. Part of this might be moving people onto new teams and then saying that team has to be in office for some made up reason, and then firing them for not relocating or using some made up metric like badging timestamps to get them, or some other technicality like leaving for lunch 5 minutes early despite being a salaried employee which is reported as hourly because of tax trolling.
I don’t know how IBM still exists because from my perspective it’s pretty clear they’re breaking or at best on razor thin gray line on ice on just about every possible law you could break.
Re: IBM to acquire Confluent
#173IBM have an absolutely stellar record of blowing acquisitions. The highly motivated newly acquired team will be in honeymoon phase for 3 months, and then it slowly dawns on them that they’ve joined an unbelievably rigid organization where things like customer satisfaction and great products don’t matter at all. Then they’ll be in shock and disbelief at the mind boggling Byzantine rules and internal systems they have…
I hope Hashicorp survives. A few higher ups I’ve talked to there made it seem like IBM wants to learn from them, not force their old ways onto Hashicorp. We’ll see. That one is still pretty new.
Re: IBM to acquire Confluent
#174Earlier quoted context omitted.
I hope Hashicorp survives. A few higher ups I’ve talked to there made it seem like IBM wants to learn from them, not force their old ways onto Hashicorp. We’ll see. That one is still pretty new.
HCP wasn't any prize when they got bought, though, right? HashiCorp Cloud was more like a fog in terms of growth. A bunch of products got lost a long the way (Boundary? Waypoint?) HCP lost 50% of its IPO value by the time it was bought. Yes, I know IPO's are high and always go down, but it went from around a $14bn valuation to being bought for something like $6.5bn.
Re: IBM to acquire Confluent
#175Earlier quoted context omitted.
I think there is a wide spectrum between small-homelab and google scale. I was surprised how far sqlite goes with some sharding on modern SSDs for those in-between scale services/saas
What you're doing is fine for a homelab, or learning. But barring any very specific reason other than just not liking Kafka, its bad. The second that pattern needs to be fanned out to support even 50+ producers/consumers, the overhead and complexity needed to manage already-solved problems becomes a very bad design choice. Kafka already solves this problem and gives me message durability, near infinite scale out, sha…
Not everything needs to be big and complicated.
Re: IBM to acquire Confluent
#176Earlier quoted context omitted.
Not to be cynical but that's said a lot in acquisitions by bigger companies to motivate some people to stay, but just doesn't seem to happen.
And even if there is a 20% of executives actually believe in "We should learn from HashiCorp", usually not even that is enough to counter-act the default mode of operation which is squeezing customers. GLHF to remaining HashiCorp believers, but personally I'd try to find alternatives for the software you use from them if you haven't already.
Re: IBM to acquire Confluent
#177IBM have an absolutely stellar record of blowing acquisitions. The highly motivated newly acquired team will be in honeymoon phase for 3 months, and then it slowly dawns on them that they’ve joined an unbelievably rigid organization where things like customer satisfaction and great products don’t matter at all. Then they’ll be in shock and disbelief at the mind boggling Byzantine rules and internal systems they have…
Pretty bleak, and describes my experience to a T (although involving other companies). Has there ever been an example where a company has been acquired and culture/morale/conditions have actually improved rather than dissolved?
Re: IBM to acquire Confluent
#178This is so fascinating to me. I mean how IBM keeps taking over other companies, but they consistently deliver low quality/bottom-tier services and products. Why do they keep doing the same thing again and again? How are they generating actual revenue this way? Ok, so does anyone remember 'Watson'? It was the chatgpt before chatgpt. they built it in house. Why didn't they compete with OpenAI like Google and Anthropic…
They gave up on watson about 18 months before llm's popped up, and they have simply just not got enough cash on hand to compete. While the big boys grew fantastically bigger over the past 15 years as cloud happened ibm fumbled time after time and shrank ever smaller, and is now desperately hoping it can stay relevant. but in the end they just haven't got the resources to compete on that stage anymore.
Same thing happened with their cloud offering. They laughed at AWS, then tried to catch up, then missed and pivoted to “hybrid” (cloud and local).
Re: IBM to acquire Confluent
#179This is so fascinating to me. I mean how IBM keeps taking over other companies, but they consistently deliver low quality/bottom-tier services and products. Why do they keep doing the same thing again and again? How are they generating actual revenue this way? Ok, so does anyone remember 'Watson'? It was the chatgpt before chatgpt. they built it in house. Why didn't they compete with OpenAI like Google and Anthropic…
Everything will make sense when you realize that IBM is a consulting company. They don't care about building great products. In fact building self-serve products will directly take away from their consulting revenue. They instead need to be good at marketing and selling their services. Watson was exactly that - a marketing demo that got them in the news cycle and helped them sell a giant wave of contracts under a sin…
Re: IBM to acquire Confluent
#180This is so fascinating to me. I mean how IBM keeps taking over other companies, but they consistently deliver low quality/bottom-tier services and products. Why do they keep doing the same thing again and again? How are they generating actual revenue this way? Ok, so does anyone remember 'Watson'? It was the chatgpt before chatgpt. they built it in house. Why didn't they compete with OpenAI like Google and Anthropic…
Why in the world would economists need to study this? It's been known that large bureaucracies have been dysfunctional for over a couple of decades now if not centuries. The large reason is because 1) the incentives to do great work are not there (most of the credit for a huge company's success goes to the CEO who gets 100X the salary of a regular worker while delivering usually pretty much nothing) 2) politics usual…
Well, in Confluent's case I'm not so sure that's true given that their CEO is also the company founder as well as one of the original authors of Apache Kafka.