Viewing profile — epups

Some important landmarks since GPT4 was first released (not in chronological order): - Vast cost reduction (>10x) - Performance parity of several open source models to GPT4, includ…

[flagged]

Greenwald is an odd one, I'll give you that. He seems to see this issue from a libertarian perspective. He would also say that Germany banning Nazi speech is censorship, for exampl…

A huge chunk of them were made public: https://apnews.com/article/brazil-twitter-elon-musk-x-censor... To the people disagreeing with my parent statement, could you find one non fa…

This is what the far right in Brazil wants you to believe, but it's not true. It's especially not true in regards to X, as they have repeatedly ignored judicial decisions that are …

This is partially the reason why we see LLM's "plateauing" in the benchmarks. For the lmsys Arena, for example, LLM's are simply judged on whether the user liked the answer or not.…

Intel seems 100% tied to its outcomes as a foundry now. If there is any disruption in chip prodution from Taiwan for example, I can see its stock doubling in price.

The graphs seem to indicate their model trades blows with Llama 3.1 405B, which has more than 3x the number of tokens and (presumably) a much bigger compute budget. It's kind of ba…

This article is borderline comical. The thin list of his accomplishments focus on increasing revenue ($15B to $70B) and launching or acquiring successful initiatives (Xbox, Skype, …

It seems that this would compete with Khan Academy for a similar space. Perhaps Karpathy will aim for adults instead?

> If we start with 2410 GWh in 2023 and grow with 59% per year that gives us 61.917 GWh in 2030. That would mean almost exactly 8 doublings in 2030. For context, the global electri…

The author is making the point that Alphafold 3 is not so impressive - it is simply regurgitating its train set, and it's not so good for inference. I think his central point is fa…

It would be simply stupid that we got so much worse at this technique in the past 10 years. You are welcome to post a link to your data source here, you already had two opportuniti…

No, it's actually only about 1% that do: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4302464/

The article makes it sound like it was ultimately a great decision, because now coal use is at historically low levels while renewables have been increasing. What it neglected to m…

This is the same dynamics we have seen before. How many national supermarket chains are there? Crossing Walmart or Amazon seem very analogous here. If anything, business in the pas…

If it's not about percentages, then what's the difference here? Walmart and Amazon are not fundamentally different. If the Apple Store can be compared to a mall, then we are in the…

I like Varoufakis in general and I find this analogy interesting. However, his answer to this question was not satisfactory in my opinion, as many commercial arrangements including…

It is not always trivial to switch. There are realistically two companies dominating phone OS, and either one comes with their poisoned pills. More importantly, I think what he is …

Sorry, could you expand on this a bit further? Are you saying that for a MoE, you want to train the exact same model, and then just finetune the feed forward networks differently f…

A gun malfunction has a potentially lethal consequence. This bug caused a person to see a fake photo of herself with fake boobs out. Perhaps it's ok that the safety standards for t…

How is Anthropic moving so fast if it took them almost a year to produce a better model? And they have probably 1% of the market right now.

You write as if there is a finite supply of "entertainment" which comes out of thin air. If someone is consuming, then someone is supplying. You mentioned yourself that the ones su…

How many libraries were included in these 25 lines of code?