Viewing profile — rajman187

i think it's worth revisiting this in a short while because, by and large, how the engineering craft has been for the last 40+ years is no longer the correct paradigm. it takes Cla…

Re: cerebras, they filed a S1 [1] last year when attempting to go public. It showed something like a $60M+ loss for the first 6 months of 2024. The IPO didn’t happen because the CE…

> You could cut your MongoDB costs by 100% by not using it ;) Came here to say exactly this

They’ve filed a S1 [1] last year when attempting to go public. It showed something like a $60M+ loss for the first 6 months of 2024. The IPO didn’t happen because the CEO’s past in…

If I could upvote this more than once I certainly would

My main keyboard has been a 34-key split Ferris. I usually have either a trackpad between the halves if I’m using a Mac or an ergonomic Logitech if on my Linux desktop. Not having …

Yeah the org structure is one thing, the missions are another. Yann adds some clarity here https://www.linkedin.com/posts/yann-lecun_were-excited-to-ha...

This has nothing to do with the newly appointed fellow nor Meta Superintelligence Labs, but rather work from FAIR that would have gone through a lengthy review process before seein…

An intuitive treatment of RLHF, TRPO, PPO, GRPO, DPO and RLAIF

That’s why you have encoders as well as decoders. For example, another model from Meta does this for translations; they have encoders and decoders into a single embedding space tha…

Not a lawyer but would assume downloading material from libgen is, in the vast majority of cases, illegal because it's a breach of copyright or similar. That’s gotten Meta in quite…

Well there was the case of an employee leaving due to his perceived moral issues around the use of copyrighted material in the training dataset [1] [1] https://www.pbs.org/newshour…

> other than a bit of open source (PyTorch and React are nice, I guess) Not to detract from your main point but I think this misses a lot of contributions, eg Cassandra, Hive, Pres…

> It was clearly valuable from day 1 I’m not sure that’s the case even if in retrospect we can clearly argue this In 1998, Paul Krugman, winner of the Nobel memorial prize in econo…

It originates in Yann LeCunn’s paper from 2022 [1], the term AMI being district from AGI. However, the A has changed over the past few years from autonomous to advanced and even au…

From the documentation [1] > The mission of Sail is to unify stream processing, batch processing, and compute-intensive (AI) workloads. Currently, Sail features a drop-in replaceme…

MTIA will be for inference initially. Another to add to the list is wafer maker Cerebras https://www.forbes.com/sites/craigsmith/2024/08/27/cerebras-...

Meta is already working on this [1], not sure it can replace NVIDIA for training large models within that time frame however. The ecosystem around their chips is what gives a huge …

The title and opening is perhaps giving people reason to infer something which Lecun isn’t arguing, that AI isn’t going to reach such a level of intelligence. Indeed, he’s publishe…

I would have liked to see a more generic implementation that isn't necessarily tied to NVIDIA, while I agree that's a much greater ask than a 7-person team can probably take on, th…

In a world of finite time and resources, wouldn't it be more useful to improve services on the lines themselves? The Elizabeth line had the highest rate of cancelations in the enti…

While I agree the public transit in the US is abysmal at best, I'm not sure the UK is a good measure anymore. Rail strikes and engineering work are happening with such frequency th…

Several years ago Walmart dramatically sped up their online store's performance by storing images as blobs in their distributed Cassandra cluster. https://medium.com/walmartglobalt…