Viewing profile — rar00

> the researchers noticed a group of neurons that consistently signaled the wrong response. Instead of fading as learning improved, these neurons grew stronger, and occasionally ev…

Really cool! An affective basis of homeostatic drive seems promising. Have you performed any basic evaluation / test of your approach? I'm also curious if there was any deliberatio…

typo? Rounding it up to 2 billion, 30% means 600 million per year

hmm, can't tell if complete bullshit or a work of genius. On the one hand, the approach overlaps a lot with my thinking, and has some original tweaks (like the emotionally valenced…

I started reading two recent neuroscience books (elusive cures and natural neuroscience) that while have different goals both highlight the utility of systems neuroscience. In elus…

"As [Essential AI Labs (founded in 2021 by Vaswani)] changes focus, Vaswani is asking investors for at least $150 million." expected, yet still funny. Noting that their initial aim…

https://archive.ph/pn5Tt

I know people are pushing back, taking "only" literally, but from a reasonable perspective what causes LLMs (technically their outputs) to give that impression is indeed the crux o…

That's an orthogonal concern IMO. Running a batch in Europe is about tapping into another source of opportunities. There are plenty of founders that won't or aren't able to attend …

disagree, there are a few organisations exploring novel paths. It's just that throwing new data at an "old" algorithm is much easier and has been a winning strategy. And, also, the…

yep, even with greedy sampling and fixed system state, numerical instability is sufficient to make output sequences diverge when processing the same exact input

This argument works better for state space models. A transformer would still steps context one token at a time, not maintain an internal 1e18 state.

getting a billionaire to finance your startup with 9-figures for no equity... :D

It is a sensible position. YC and VCs are backing businesses, not charitable causes or research initiatives. It is the founders' responsibility to liaise the two sides in order to …

the robot arm demonstration video jumps at the 00:28s mark...

Model weights already available in HF, code to be released shortly in GitHub ( https://github.com/nvidia-cosmos/cosmos-predict2 )

aligns with (or is based on) Demis Hassabis' assessment from yesterday on missing cognitive capabilities for AGI: long-term memory, reasoning, hierarchical planning. He then goes o…

Says that new cognitive capabilities are needed to attain AGI: reasoning, hierarchical planning, long-term memory, inventive creativity. Interesting that LeCun also mentions the sa…

> However, we have a verbal agreement that these materials will not be used in model training. That'll do it... clearly no incentive to do otherwise. There should be some form of a…

nice way to spoil the fight result to people. Because, of course, an athlete gaining more than its adversary is HN-worthy news...