111–120 of 174 posts
Earlier quoted context omitted.
Does this mean you can train efficiently without GPUs? Presumably there will be a lot of interest.
No. But it does potentially mean that either current or future-tweaked GPUs could run a lot more efficiently -- meaning much faster or with much less energy consumption. You still need the GPU parallelism though.
It's a very crude approximation, e.g. 1.75 * 2.5 == 3 (although it seems better as the numbers get closer to 0). I tried implementing this for AVX512 with tinyBLAS in llamafile. inline __m512 lmul512(__m512 x, __m512 y) { __m512i sign_mask = _mm512_set1_epi32(0x80000000); __m512i exp_mask = _mm512_set1_epi32(0x7F800000); __m512i mant_mask = _mm512_set1_epi32(0x007FFFFF); __m512i exp_bias = _mm512_set1_epi32(127); __m…
Earlier quoted context omitted.
Fair enough, but then I want a way to penalize publishers for abusing clickbait. There is no "unread" button, and there is no way to unsubscribe to advertisement-based sites. Even on sites that have a "Like / Don't like" button, my understanding is that clicking "Don't like" is a form of "engagement", that the suggestion algorithm are going to reward. Give me a button that says "this article was a scam", and have the…
I doubt there’s a business model there because who is going to opt in to a scheme that loses them money? What could work is social media giving people an easy button to block links to specific websites from appearing in their feed, or something along those lines. It’s a nice user feature, and having every clickbait article be a chance someone will choose to never see your website again could actually reign in some of…
Agreed, of course.
In a reasonable world, that could be considered part of the basic, law mandated requirements. It would be blurry and subject to interpretation to decide what is clickbait or not, just like libel or defamation - good thing we're only a few hundred years away from someone reinventing a device to handle that, called "independent judges".
In the meantime, I suppose you would have to bring some "unreasonable" thing to it, like "brands like to have green logos on their sites to brag" ?
> What could work is social media giving people an easy button to block links to specific websites from appearing in their feed, or something along those lines.
I completely agree. It's a feature they have had the technology to implement such a thing since forever, and they've decided against it since forever.
However I wonder if that's something a browser extension could handle ? A merge of AdBlock and "saved you a click" that displays the "boring" content of the link when you hoveron a clickbaity link ?
Earlier quoted context omitted.
Are you sure it’s a life changing productivity booster? Sometimes I look at my projects and wonder how would I explain it to an LLM what this code should have done if it didn’t exist yet. Must be a shitton of boilerplate programming for copilot to be a life-changing experience.
You haven't used them enough. Everytime an LLM reduces my search from 1min to 5s, the LLM pays. Just summary features: save me 20min of reading a transcript, turn it into 20s. That's a huge enabler.
Earlier quoted context omitted.
I've been using it for over a year I think. I don't often feed it tasks with comments so much as go about things the same as usual and let it autocomplete. The time and cognitive load saved adds up massively. I've had to go without it for a bit while my workplace gets its license in order for the corporate version and the personal version has an issue with the proxy, and it's been agonizing going without it again. I…
> I almost forgot how much it sucks having to jump to google every other minute Even allowing for some hyperbole, your programming experience is extremely different from mine. Looking anything up outside the IDE, let alone via Google, is by far the exception for me rather than the rule. I've long suspected that this kind of difference explains a lot of the difference in how Copilot is perceived.
It's a very crude approximation, e.g. 1.75 * 2.5 == 3 (although it seems better as the numbers get closer to 0). I tried implementing this for AVX512 with tinyBLAS in llamafile. inline __m512 lmul512(__m512 x, __m512 y) { __m512i sign_mask = _mm512_set1_epi32(0x80000000); __m512i exp_mask = _mm512_set1_epi32(0x7F800000); __m512i mant_mask = _mm512_set1_epi32(0x007FFFFF); __m512i exp_bias = _mm512_set1_epi32(127); __m…
Your kernel seems to be incorrect for 1.75 * 2.5. From paper we have 1.75 == (1+0.75)*2^0 for 2.5 == (1+0.25)*2^1 so result is (1+0.75+0.25+2^-4)*2^1 == 4.125 (correct result is 4.375)
Another example, if we have for example 1.9 * 1.9 then we need to account for overflow in (0.9 + 0.9) and this seems to induce similar overhead as expressing numbers as (1-0.05)*2 .
Earlier quoted context omitted.
I mean, all these smart people would rather pay NVIDIA all their money than make AMD viable. And yet they tell us its all MatMul.
Both companies are doing pretty well. Why don't you think AMD is viable?
They are and have been buying AMD CPUs for a while now, which says something about AMD and Intel.
Earlier quoted context omitted.
> I almost forgot how much it sucks having to jump to google every other minute Even allowing for some hyperbole, your programming experience is extremely different from mine. Looking anything up outside the IDE, let alone via Google, is by far the exception for me rather than the rule. I've long suspected that this kind of difference explains a lot of the difference in how Copilot is perceived.
Claiming LLMs are a massive boost for coding productivity is becoming a red flag that the claimant has a tenuous grasp on the skills necessary. Yeah if you have to look up everything all the time and you can't tell the AI slop isn't very good, you can put out code quite fast.
Maybe you don't push your boundaries as an engineer and thus rarely need to know new things or at least learn new API surfaces. Maybe you don't know how to effectively prompt an LLM. Maybe you lack the mastery to analyze and refine the results. Maybe you just like doing things the slow way. I too remember a time as an early programmer where I eschewed even Intellisense and basic auto complete...
I'd recommend learning a bit more and practicing some humility and curiosity before condemning an entire class of engineers just because you don't understand their workflow. Just because you've had subpar experiences with a new tool doesn't mean it's not a useful tool in another engineer's toolkit.