Earlier quoted context omitted.
I'm learning quite a bit today. Hopefully there are some other clueless readers that are learning from my dumb comments.
>other clueless readers that are learning Indeed! I don't pay attention to this space often and this chain of comments has been enlightening. Thank you for being vocally clueless while we remained mostly-silently-clueless, JKCalhoun! :-)
QwQ: Alibaba's O1-like reasoning LLM
391–400 of 435 posts
Re: QwQ: Alibaba's O1-like reasoning LLM
#392Impressive. * > User: is ai something that can be secured? because no matter the safety measures put in place (a) at some point, the ai's associated uses become hindered by the security, and (b) the scenario will always exist where person implements AI into physical weaponry without any need to even mention their intent let alone prove it thereafter - the ai may as well think it's playing whack-a-mole when its really…
I understand that this is technically a relevant answer, but did you really think anyone wanted to read a wall of text evaluation pasted in verbatim? Summarize it for us at least.
Re: QwQ: Alibaba's O1-like reasoning LLM
#393Earlier quoted context omitted.
On Macbooks with Apple Silicon consider MLX models from MLX community: https://huggingface.co/collections/mlx-community/qwq-32b-pre... For a GUI, LM Studio 0.3.x is iterating MLX support: https://lmstudio.ai/beta-releases When searching in LM Studio, you can narrow search to the mlx-community.
on macos with lm-studio is it better to use the mlx-community releases over the one that lm-studio releases? also I didn't install a beta and mine says i'm using 3.5 which is what the beta also says. is there a difference right now between the beta and the release version?
Re: QwQ: Alibaba's O1-like reasoning LLM
#394Earlier quoted context omitted.
> what do you mean? I can easily run 70b on my macbook. Fits easily Does your MacBook really have a 24GB VRAM consumer (GPU) card?
Newer mac books have a unified memory architecture, so the GPU can use all the available memory if it wants.
Re: QwQ: Alibaba's O1-like reasoning LLM
#395Earlier quoted context omitted.
giving? let's say they "gave" but that was a long time ago. What have they done as of late? "stolen, spies, espionage, artificial islands to claim territory, threats to Taiwan, conflicts with India, Uyghurs, helping Russia against Ukraine, attacking babies in AU" comes to mind.
Just last week, they gave a megaport to Peru, the biggest in Latin America
https://bankruptcyroundtable.law.harvard.edu/2024/09/24/a-ta... https://www.gao.gov/products/gao-24-106866 https://clsbluesky.law.columbia.edu/2024/06/14/chinas-debt-f...
Re: QwQ: Alibaba's O1-like reasoning LLM
#396Earlier quoted context omitted.
Just last week, they gave a megaport to Peru, the biggest in Latin America
The infrastructure projects that China "gives" generally result in unsustainable debt burdens for the host countries that negatively impact their economies. https://bankruptcyroundtable.law.harvard.edu/2024/09/24/a-ta... https://www.gao.gov/products/gao-24-106866 https://clsbluesky.law.columbia.edu/2024/06/14/chinas-debt-f...
Re: QwQ: Alibaba's O1-like reasoning LLM
#397Earlier quoted context omitted.
>>not that expensive to get an M4 pro with 64GB $3900 as the starting price does not sound 'not that expensive' for me.
M4 Pro with 64GB of ram starts at $3900? It doesn't take that much searching to know that is BS: https://www.apple.com/shop/buy-mac/mac-mini/apple-m4-pro-chi... An upgraded M4 Pro mac mini to 64GB is $1999. You'll probably want the extra GPUs, though, bringing you up to $2199. But you probably want the max (not offered for the mini) or ultra to do serious LLM work. An M4 Max in a 14 inch MBP with 64GB of ram will cos…
No, but the OP was talking about a M4 Macbook, not a M4 Pro mini. "I can easily run 70b on my macbook."
Like you said, a M4 Pro 14" Macbook does start at $3,900. Because they lock the 64GB ram behind the top spec M4 Max. There is no M4 Pro MBP with 64GB of ram, only M4 Max.
> 36GB available with M4 Max with 32‑core GPU. > 48GB available with M4 Pro or M4 Max with 40‑core GPU. > 64GB or 128GB available with M4 Max with 40‑core GPU.
https://www.apple.com/shop/buy-mac/macbook-pro/14-inch-space...
Re: QwQ: Alibaba's O1-like reasoning LLM
#398Earlier quoted context omitted.
> That is a pretty dark view on almost 1/5th of humanity The CCP does not represent 1/5 of humanity. > and a nation with a track record of giving the world important innovations: paper making, silk, porcelain, gunpowder and compass to name the few. Utter nonsense. It wasn't the CCP who invented gunpowder. If you are willing to fool yourself into believing that somehow all developments that ever originated by people w…
You changed china with ccp for both statements and then corrected them.
Re: QwQ: Alibaba's O1-like reasoning LLM
#399Earlier quoted context omitted.
M4 Pro with 64GB of ram starts at $3900? It doesn't take that much searching to know that is BS: https://www.apple.com/shop/buy-mac/mac-mini/apple-m4-pro-chi... An upgraded M4 Pro mac mini to 64GB is $1999. You'll probably want the extra GPUs, though, bringing you up to $2199. But you probably want the max (not offered for the mini) or ultra to do serious LLM work. An M4 Max in a 14 inch MBP with 64GB of ram will cos…
> M4 Pro with 64GB of ram starts at $3900? No, but the OP was talking about a M4 Macbook, not a M4 Pro mini. "I can easily run 70b on my macbook." Like you said, a M4 Pro 14" Macbook does start at $3,900. Because they lock the 64GB ram behind the top spec M4 Max. There is no M4 Pro MBP with 64GB of ram, only M4 Max. > 36GB available with M4 Max with 32‑core GPU. > 48GB available with M4 Pro or M4 Max with 40‑core GPU…
The page you linked to said as much.
Re: QwQ: Alibaba's O1-like reasoning LLM
#400Earlier quoted context omitted.
> To recapture the spirit of open source as being about freedom for actual users (as opposed to free labor for jailed SaaS) That spirit was never there; "Open Source" was created to be corporate -friendly as it was predated by Free software, which is rigidly committed to users freedom.
That is a pretty cynical take. FSF good, OSI bad. > ”Open Source" was created to be corporate-friendly as it was predated by Free software, which is rigidly committed to users freedom. Rigidly committed to a certain interpretation of users freedom. And that interpretation happens to involve removing a number of freedoms “for your own good”. It is more correct to say that the GPL was created to be anti-corporate, as i…
I ascribed no moral value judgement on which is better. However , Tim O'Reilly isn't exactly shy about who the target of those early Open Source conferences (OSCON) were, and what they were attempting to achieve - which they succeeded at.