401–410 of 682 posts
Earlier quoted context omitted.
Newb question but I’m curious what would help it to run faster? Would it need more vRAM or just system memory?
It runs very quickly on my RTX 5090 fwiw. Whole thing is loading entirely into vRAM with a ~130k context size (the max) fitting as well.
Remember when we needed 200 servers for an enterprise website because Apache used one process or thread per connection - and Nginx collapsed that into a single box overnight? That moment for LLMs is near. It’s going to move us from the big iron era of AI to small portable brains. Nature has already proved it’s possible with 20 watts and very little heat generation. And I think the data center buildout will end in car…
Everyone keeps repeating this who doesn’t understand the underlying technology. Small llms are still way more efficiently server on big GPUs. Sharing server capacity takes advantage of the massive parallel throughput and sharing of memory bandwidth. You are sharing the GPUs with thousands of concurrent users.
for clarity, I'm not agreeing with GP that small models will mean doom for data center projects
Earlier quoted context omitted.
brains do it with 20 watts because theyre analog. llms require massive amounts of power and this isnt changing any time soon without a breakthrough
And a breakthrough in hardware, specifically.
Earlier quoted context omitted.
Meta can never be redeemed, but it's still valid to admit that FB at one point had a very badass engineering culture. They're one of 2 companies I would absolutely never work for (weapons etc aside). FB's recruiters hounded me so often I requested that they blackball me. The day they became Meta, I learned this by checking my email to see that they started trying to reach out again. I once again requested that they b…
> FB at one point had a very badass engineering culture Perpetually kneecapped by one of the worst management cultures I've ever seen
Earlier quoted context omitted.
> Only China can release good, open weight models and American companies can’t compete. Oh by the way all the spend is for nothing because China alone can release open-weight models thus destroying American AI. Let me be blunt and let me say: you don't understand why we people support Chinese models. 1. Chinese labs started with open weight models, US labs started with dooms day narrative 2. US VC based companies mus…
US companies published their research on transformers. The only reason Chinese companies have any models at all is open US research... Add distillation to that, and the entire Chinese AI sphere is really just an offshoot of public US AI information...
During the last few years, the published research from USA was only a small fraction from that published from China.
Earlier quoted context omitted.
It’s rather amusing to me to read comments like this, and then simultaneously whenever a Chinese company or team releases open-weight models or whatever there is a giant round of applause, America is so behind, and there’s nothing but positive things to say about the intelligent, creative, and well-intentioned Chinese engineers (which is true, America certainly doesn’t have a monopoly on great people). Don’t you know…
These sentiments aren’t formed in a vacuum. America is becoming increasingly oligarchic and corrupt with decades of experience of companies profiting off harming people and lying through their teeth and Meta is like one of the worst offenders. They are pissing on every ally they have and once again started a war and both have material impacts on other countries. Americans seem to take the US’ geeat reputation for gra…
Isn't China a single-party state that is run by a corrupt autocrat, has literally enslaved people to build products, and disappears people for saying the wrong things? If America is becoming more like China, shouldn't you dislike China more than America?
> when this sentiment basically just sprang out of nowhere when the west realized it was their geopolitical rival
Well this isn't a sentiment that sprang out of nowhere. It is a sentiment that emerged based on real or perceived behavior.
> China is not starting any wars
Maybe not yet, but they certainly aren't behaving nicely toward Taiwan or other countries in and around the South China Sea, are they? The Philippines and Vietnam come to mind immediately, of course there are others.
> the source of cheap goods and innovation to other countries
But if those cheap goods run your country's businesses out of business and you have lots of people without work, is that a good thing?
> The US is now directly causing high oil prices with their war
The US didn't ask Iran to pursue building nuclear weapons, supply Russia for its ongoing war in Ukraine, or provide weapons and funding to groups in Yemen, Iraq, Syria, Lebanon, and Palestine which have led to instability in the region. If oil prices are too high, the rest of the world should have worked to address American concerns about Iran. They failed to act, and so the US eventually just did what it thought was necessary.
> rapacious companies like “prediction markets” which are 90% sports gambling
Before sports gambling was a thing in my state (Ohio) I seem to recall traveling to other countries and they had sports gambling too. Maybe I'm wrong?
> Meanwhile the classic American move to these kinds of comments is to claim that negative sentiment MUST be part of some bot campaign because surely no one could actually dislike the great America??
I can't speak for others but since I started this thread I'll chime in. I specifically disagree with the arguments put forth about AI strategy with respect to the US and China. I have no idea and frankly, aside from erroneously being accused of a bot once [1], have no interest in trying to guess if someone is a bot or not. Sometimes I just assume everyone is, because really what's the difference when it's all just text?
Others may feel differently and believe that there is a brigade of bots. I'd ask them for concrete evidence.
Earlier quoted context omitted.
> Perhaps there’s a group here that is simply anti-American as its primary interest, and passionately so to upvote each other. Considering this site has international users, it's not hard to find this, especially right now. Hell, Canada is in this group currently.
I'm a 52 year old natural born US citizen whose ancestors have been here for generations and I'm currently anti-American. Why wouldn't I be? We've never been the shining beacon of light we would claim to be, but we're so fucking awful now.
I applaud your openness to speak. I've traveled/interacted with many nationalities, and very rarely I come across someone who is open/rational enough to openly state their dislike of their country and denouncing their history.
I wish you the best in life, smart internet stranger!
Will be interesting to see how Qwen3.8 27B compares against this once it releases this week. Seems like dense 30B is back in fashion? EDIT: An open weight version of Muse Spark 1.2 is going to be released as well: https://x.com/alexandr_wang/status/2086756152034066792 https://xcancel.com/alexandr_wang/status/2086756152034066792
It seems worse than 3.6, but a bit smaller. UPD. was wrong on smaller, it's actually much larger
- muse glimmer: 15.9GB
- qwen 3.6 27B: 17.6GB
My video card is so close to its limit that these GB thresholds are mattering too much for me :D
Earlier quoted context omitted.
I find Claude doing a lot of pointless confirmation at night when it will ask me about things that it would normally just do during the day. Frustrating to be like “do X overnight, don’t ask me for input” and come down to find it having worked for a few minutes and then stopped.
Doesn't setting the question auto-continue timeout before you go to bed fix that? https://code.claude.com/docs/en/tools-reference#question-aut...
"Ready for you to rebuild MAME, restart, and retest. If the freeze goes away → timing was the cause."
when previously it had been happily auto rebuilding and running the mame test