Viewing profile — Analog24

So the "E2B" and "E4B" models are actually 5B and 8B parameters. Are we really going to start referring to the "effective" parameter count of dense models by not including the embe…

They had to put together ~14 hours of visuals, more than 5x what U2 had to do. There's nothing low effort about that. Some visuals were not as good as others as a result but I can …

As someone else mentioned in this thread, it is not possible to understand how everything you purchase works. That is also incredibly infeasible. What you are asking is to effectiv…

I think the expectation that the entire consumer market (or even just a majority) is going to collectively become universally informed about all their purchases and shift the marke…

Internships are definitely not a waste of time. First of all, they pay well in and of themselves (at least in tech). Second of all, most internships are filled by students on their…

That's not true at all. At Meta your RSUs are based off the average share price for the month before your start date

"neat future" is very ambiguous. At the moment there is nothing even close to transformers in terms of performance. I suspect you are right in general but I'm not sure about the "n…

This is the reason why they're not going to move on device anytime soon. You can use compression techniques, sure, but you're not going to get anywhere near the level of performanc…

"It's six years later and Siri, Alexa, and Google Home are still nearly as dumb as they were back then". You can't even keep a coherent discussion and you are delusional about the …

The fact that you think creating a writing assistant plugged into Word is equivalent to building a general purpose, always-on voice assistant tells me all I need to know.

Do you have any publications to back up your claims about your work? They seem more than a bit grandiose. If you're ideas are as novel and useful as you say then you should publish…

Scaling up an LM from 2017 would not achieve what GPT-4 does. It's nowhere near that simple. Of course companies saw the potential of natural language interfaces, there has been bi…

It fails at _some_ arithmetic. Humans also fail at arithmetic... In any case, is that the defining characteristic of having a good enough "world model"? What distinguishes your abi…

What is your intent?

If you read some of the studies of these new LLMs you'll find pretty compelling evidence that they do have a world model. They still get things wrong but they can also correctly id…

You can't just wave your hand and tell someone that words are broken up into sub-word tokens that are then transformed into a numerical representation to feed to a transformer and …

Embeddings and their relationship to each other are definitely relevant to transformers. Why do you think that's not the case?

What would be the differentiating factor(s) for true AI/intelligence in your opinion?

Another hyperbolic analogy. What a great argument, I'm convinced.

No it wasn't. You have the misconception that an AI system has to achieve anthropomorphic qualities to become dangerous. ML algorithms are goal-oriented, they are optimized to maxi…

That analogy is nonsense. We're actually making measurable gains in AI and the pace of progress is only increasing. Belief in this isn't based on faith, it is based on empirical ev…

> > > Should we develop nonhuman minds > The embarrassing part. Preaching a religion under professional pretenses. There are quite a few companies with the explicitly stated goal o…

I had the same thought after reading this and I have to say my gut reaction to that thought was: "I hope so".

You can make a pretty compelling argument that those narco states developed because of the war on drugs

What developer working on anything meaningful does not rely on documentation? You certainly have to make the documentation available similar to how you would have to make it "avail…