131–140 of 252 posts
This is a hell of a way of sharing what you want to do but cannot guarantee you'll be able to without saying that you cannot guarantee you'll be able to do what you want to do.
this sentence is breaking my :brain: trying to read :)
Earlier quoted context omitted.
Every time I see the em-dash call out on here I get defensive because I’ve been writing like that forever! Where do people think that came from anyway? It’s obviously massively represented in the training data!
Where's the emdash key on your keyboard? There isn't one? Oh, maybe that's why people who didn't already know or care about emdashes are very alert to their presence. If you have to do something very exotic with keypresses or copypaste from a tool or build your own macro to get something like an emdash, or , it's going to stand out, even if it's an integral part of standard operating systems.
Earlier quoted context omitted.
It isn't "China" which open-source LLMs, but individual Chinese labs. China didn't yet made a sovereign move on AI, besides investing in research/hardware.
As far as I can tell AI is already playing a big part in the Chinese Fifteenth five year plan (2026-2030) which is their central top-down planning mechanism. That’s about as big a move as they can make.
https://triviumchina.com/research/the-ai-plus-initiative-chi...
> Anthropic occupies a peculiar position in the AI landscape: a company that genuinely believes it might be building one of the most transformative and potentially dangerous technologies in human history, yet presses forward anyway. This isn't cognitive dissonance but rather a calculated bet—if powerful AI is coming regardless, Anthropic believes it's better to have safety-focused labs at the frontier than to cede th…
This is the major reason China has been investing in open-source LLMs: because the U.S. publicly announced its plans to restrict AI access into tiers, and certain countries — of course including China — were at the lowest tier of access. [1] If the U.S. doesn't control the weights, though, it can't restrict China from accessing the models... 1: https://thefuturemedia.eu/new-u-s-rules-aim-to-govern-ais-gl...
If this really is a geopolitical play(I'm not sure if it is or isn't), it could be along the lines of: 1) most AI development in the US is happening at private companies with balance sheets, share holders, and profit motives. 2) China may be lagging in compute to beat everyone to the punch in a naked race
Therefore, releasing open weights may create a situation where AI companies can't as effectively sell their services, meaning they may curtail r&d at a certain point. China can then pour nearly infinite money into it and eventually get up to speed on compute and win the race
Cosma Shalizi says that this isn't possible. Are they in the training set? I doubt it.
http://bactra.org/notebooks/nn-attention-and-transformers.ht...
> Anthropic occupies a peculiar position in the AI landscape: a company that genuinely believes it might be building one of the most transformative and potentially dangerous technologies in human history, yet presses forward anyway. This isn't cognitive dissonance but rather a calculated bet—if powerful AI is coming regardless, Anthropic believes it's better to have safety-focused labs at the frontier than to cede th…
Given the number of leaks, deliberate publications of weights, and worldwide competition, why do you believe this?
(Even if by "lobotomised" you mean "refuses to assist with CNB weapon development").
Also, you can have more than one failure mode both be true. A protest against direct local air polution from a coal plant is still valid even though the greenhouse effect exists, and vice versa.
Can someone tell me the mechanism by which the prompts are even recovered? Cosma Shalizi says that this isn't possible. Are they in the training set? I doubt it. http://bactra.org/notebooks/nn-attention-and-transformers.ht...
Plus these transcripts showing the chats: https://gist.github.com/Richard-Weiss/efe157692991535403bd7e...
Earlier quoted context omitted.
Where's the emdash key on your keyboard? There isn't one? Oh, maybe that's why people who didn't already know or care about emdashes are very alert to their presence. If you have to do something very exotic with keypresses or copypaste from a tool or build your own macro to get something like an emdash, or , it's going to stand out, even if it's an integral part of standard operating systems.
Shift-option-minus on a Mac, just like how shift-option-8 is the degree symbol and option-slash is the division symbol.
Earlier quoted context omitted.
This is the major reason China has been investing in open-source LLMs: because the U.S. publicly announced its plans to restrict AI access into tiers, and certain countries — of course including China — were at the lowest tier of access. [1] If the U.S. doesn't control the weights, though, it can't restrict China from accessing the models... 1: https://thefuturemedia.eu/new-u-s-rules-aim-to-govern-ais-gl...
Why wouldn't China just keep their own weights secret as well? If this really is a geopolitical play(I'm not sure if it is or isn't), it could be along the lines of: 1) most AI development in the US is happening at private companies with balance sheets, share holders, and profit motives. 2) China may be lagging in compute to beat everyone to the punch in a naked race Therefore, releasing open weights may create a sit…
Seems like it may have a chance of working if you look at the companies highest valued on the S&P 500:
NVIDIA, Microsoft, Apple, Amazon, Meta Platforms, Broadcom, Alphabet (Class C),
Earlier quoted context omitted.
Every time I see the em-dash call out on here I get defensive because I’ve been writing like that forever! Where do people think that came from anyway? It’s obviously massively represented in the training data!
Where's the emdash key on your keyboard? There isn't one? Oh, maybe that's why people who didn't already know or care about emdashes are very alert to their presence. If you have to do something very exotic with keypresses or copypaste from a tool or build your own macro to get something like an emdash, or , it's going to stand out, even if it's an integral part of standard operating systems.