331–340 of 476 posts
So much spam around this model. LocalLLaMA is stuffed with spam posts and even hacker news is getting spammed. Who has actually ran this model and verified performance? Does anyone know of a decent review from a trustworthy source?
Earlier quoted context omitted.
>I want to know exactly what makes everyone thinks that deepseek totally owns the LLM space? It achieved competitive performance to the competition at literally 10x less cost of production (training). That's an incredible achievement in any industry, especially given they have such a small team relative to competitors. Their API is 20-50x cheaper than the competitors, and not because they're burning cash by charging…
How would we know if a Chinese company's books on training costs and expenditures was accurate?
nice job, you should get a pretty solid performance review result.
> Liang Wenfeng: We believe that as the economy develops, China should gradually become a contributor instead of freeriding. In the past 30+ years of the IT wave, we basically didn’t participate in real technological innovation. We’re used to Moore’s Law falling out of the sky, lying at home waiting 18 months for better hardware and software to emerge. That’s how the Scaling Law is being treated.
In the past few years, Chinese publications on AI research have surpassed English-language ones. Deepseek itself is open-sourced
Earlier quoted context omitted.
> 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever get to that. Chinese chips will come soon, I heard on DeepSeek Huawei Ascend chips are already on part of inference. > 2. China censorship which limits the deepseek data ingestion and output, to some degree. There are things that deepseek doesnt censor but Claude does censor. After Yoon Suk Yeol's…
I just asked claude about martial law in the US and it didn't give any refusals. The problem is often the prompting. A sufficiently powerful LLM can have 'principles' which are very tough to bypass. In Claude's case it is to be a harmless assistant. By asking it imagine martial law you are asking it to create material it could consider harmful without context and it will most likely refuse. It needs a reason to do it…
Earlier quoted context omitted.
Western consumers don't want to buy EVs (mostly).
Yeah I mean, with the sad state of the Dutch electric grid, the poor coverage of chargers, and the disappearing consumer subsidies, I wouldn't want either. So why aren't governments also building the infrastructure they need to help stimulate demand for EVs? Not taking global climate disaster serious enough? Building EVs and supporting infrastructure is a lot more complicated than just having a bunch of blueprints.
Personally, I am not sure yet whether I like this or not. I can see good arguments for and against.
I wish it would be an honest open policy instead of the current vice grip of on the one hand passing aggressive phase out timelines of ICE through regulation, and on the other doing nothing to prepare a grid for mass EV adoption.
I can see why it wouldn't pass a democratic vote, but I also think chances of this passing under the covers are fairly slim as any time one of their roadmapped phases comes near they usually have to postpone them to appease the public.
Earlier quoted context omitted.
This is one of the biggest reasons why China or India are threat to the West. Because their Engineers are constantly in situations were they have to work with much less resources. And they come up with stuff that constantly surprises people for being much cheaper. The western reaction is to then go and buy them out. Its not going to work forever. They have already taken over large swathes of the tech landscape. Even…
For how much we all bitch about beancounters, I'm kind of surprised that beancounters haven't managed to convince management to buy bottom-of-the-barrel Celeron laptops for software developers. Make those fucking assholes use the hardware of the people instead of some monstrosity with a 256 cores CPU and 48 TB of RAM and 24 exabytes of enterprise SSD and an RTX Cinco Grande connected via optical fiber to the Amazonfl…
If shipping fast means you spend an extra $1000 once per developer, guess what almost every company is going to do?
Earlier quoted context omitted.
Not to the volume needed to compete with the training infrastructure setups of Anthropic or OpenAI or other leading players No ban is perfect, there is always some loopholes or illegal exports this is to be expected, but if it prevents large scale transaction then it it is achieved its goal. The question is rather do they we need a lot of gpus to train or training with older gen gpus is not competitive is a different…
> if it prevents large scale transaction then it it is achieved its goal. It doesn't prevent the transactions, it only makes them more expensive than they would have been otherwise. If the the US was able to covertly buy enough titanium from the USSR for the SR-71 program, China can buy the latest GPUs if it believes AI competence is in its national interests. Oh look, there's sudden demand for H100s of by dozens of…
This boils down to the same thing in a market economy. If the price is too high, that prevents the transaction.
Earlier quoted context omitted.
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition. Imagine Sam Altman throwing a chair out a window in a meeting lol. The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data. Anyone who hasn't read AI Superpowers should…
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
https://itif.org/publications/2024/09/16/china-is-rapidly-be...
China leads in Computers and Electronics, Machinery and Equipment, Motor Vehicles, Basic Metals, Fabricated Metals, Electrical Equipment.
The US leads in IT and Information Services, Pharmaceuticals, and Other Transportation.
It’s not about to happen. It already happened, and it is largely due to hubris that the US doesn’t talk about it.
Earlier quoted context omitted.
Can't agree more. Especially as I wait to download 1.3gb file to update some Windows driver like Realtek audio or LED display, and you realise a whole effing Debian operating system with Xfce & apps can fit in a lot less.
Whoever are downvoting this really don't understand that expanding a congested highway merely widens the congestion instead of alleviating it. Software today require several dozen gigabytes of RAM and two dozen CPU cores just to render some simple fucking text because everyone has several dozen gigabytes of RAM and two dozen CPU cores.
It’s not altogether different from how everything seems to be much more expensive than it was in the 1950s. There are many real and concerning reasons for that, but one less concerning reason is that we have higher standards and expectations now, and that translates to higher cost.
Earlier quoted context omitted.
It's literally happening lol. When you were a kid China was making shoes and their GDP is 10% of the US. Now they're making drones / evs / high end electornics and it's 80%. This is why people's perception is so unreliable because it's impossible to notice things when they happen over a lifetime
When I was a kid, China was a lot better integrated with the international community. Right now their relationships are far and few between, rarely featuring first-world nations. If Russia couldn't beat NATO in a pitched fight against the rest of the world, neither can China.
https://www.visualcapitalist.com/cp/biggest-trade-partner-of...
Whether China can beat NATO in a head to head military contest is one question, but separate from whether they can take Taiwan, for example.