Live data from Hacker News

Making Wolfram tech available as a foundation tool for LLM systems

writings.stephenwolfram.com

121–130 of 188 posts

Re: Making Wolfram tech available as a foundation tool for LLM systems

#121

Is mathematica code in the pre or post training set?

Yes. You can get llms to generate just about anything you want in mathematica and in particular the gpt-4.4 -> 4.5 generation had a massive improvement in mathematica code correctness in particular so it really seemed to me at that stage they specifically worked on it.

Re: Making Wolfram tech available as a foundation tool for LLM systems

#122
My first thought on CAG was that it sounds a bit like bolting on an MCP server onto SymPy (AFAIK, the closest OSS thing to Mathematica). And it turns out someone has already done that.

https://www.stephendiehl.com/posts/computer_algebra_mcp/

Re: Making Wolfram tech available as a foundation tool for LLM systems

#123

LLMs using code to answer questions is nothing new, it's why the "how many Rs in strawberry" question doesn't trip them up anymore, because they can write a few lines of Python to answer it, run that, and return the answer. Mathematica / Wolfram Language as the basis for this isn't bad (it's arguably late), because it's a highly integrated system with, in theory, a lot of consistency. It should work well. That said,…

> it's why the "how many Rs in strawberry" question doesn't trip them up anymore, because they can write a few lines of Python to answer it, run that, and return the answer.

That still requires the LLM to ‘decide’ that consulting Python to answer that question is a good idea, and for it to generate the correct code to answer it.

Questions similar to ”how many Rs in strawberry" nowadays likely are in their training set, so they are unlikely to make mistakes there, but it may be still be problematic for other questions.

Re: Making Wolfram tech available as a foundation tool for LLM systems

#124

My first thought on CAG was that it sounds a bit like bolting on an MCP server onto SymPy (AFAIK, the closest OSS thing to Mathematica). And it turns out someone has already done that. https://www.stephendiehl.com/posts/computer_algebra_mcp/

I wonder how this will compare, long term, to giving LLMs python sandboxes. Why implement an MCP server for a single library when you can give the LLM an interpreter running a distribution with arbitrarily many libraries?

Probably the trick is teaching the LLM how to use everything in that distribution. It’s not clear to me how much metadata that SymPy MCP server bakes in to hint the LLM about when it might want symbolic mathematics, but it’s definitely gonna be more than “sympy is available to import”

Also, reading through TFA, Wolfram is offering more than a programming language. It includes a lot of structured general purpose information. I suspect that increases response quality relative to web search, at least for a narrow set of topics, but I’m not sure how much.

Re: Making Wolfram tech available as a foundation tool for LLM systems

#125
post #97

Earlier quoted context omitted.

I like a lot of Stephen Wolfram's work, but we must also recognize the questionable assumptions he made in many of his commercial projects. There is a difference between cashing-in and selling-out... but often fame destroys peoples scientific working window by shifting focus to conventional mundane problems better left to an MBA. I live in a country where guaranteed health care is part of the constitution. It was a c…

'I live in a country where guaranteed health care is part of the constitution.' In the light of ' Almost half of the 6 million people needing treatment from the NHS in England have had no further care at all since joining a hospital waiting list, new data reveals. Previously unseen NHS England figures show that 2.99 million of the 6.23 million patients (48%) awaiting care have not had either their first appointment w…

Britain has always had challenges, and the side-effects manifest in predictable ways.

https://www.youtube.com/watch?v=WdVB-R6Duso

Over a human lifetime, the immediate economic decisions do change macroeconomic postures. For example, consider variable costs of dental services for braces, fillings, crowns, root canals, extraction, bone loss, dentures, and supporting pharmaceuticals/radiology. Then consider a one-time standard fixed cost of volume discounted cosmetic titanium implants with a crown. People would look great, have better heart health, and suffer less treatments over time.

Rationally, the more expensive option ends up several times less expensive than a sequence of bodges. Yet no politician in the world could make that happen due to initial costs, regulatory capture, and rent-seeking economic policy. Note, GDP would contract slightly as cost savings compounded, and quality of life improved.

In general, one could run integrated education, emergency care, and disease control diagnostics like assembly lines. Routing patients though 24h virtual sorting for specialist site clinics on fixed service rotation.

Some have already imagined efficient hip and knee replacement services that make sense in other contexts:

https://youtu.be/iUFXXB08RZk?si=sjvH3amiwEnUecT9&t=13

UK healthcare isn't a technical problem, and it would be unethical to interfere with such affairs. Best regards =3

Re: Making Wolfram tech available as a foundation tool for LLM systems

#126
post #90

Earlier quoted context omitted.

I tried finding this but couldn't find them on youtube. Can you please share the link for one of the videos?

It's under the Live tab of Wolfram's channel: https://www.youtube.com/@WolframResearch/streams Sessions are called Live CEOing, e.g.: https://www.youtube.com/watch?v=id0KH0sfHI8

Thanks, I should have linked. Also he cross-posts to his site:

https://livestreams.stephenwolfram.com/category/live-ceoing/

The next one is today, 4:30 PM ET!

Re: Making Wolfram tech available as a foundation tool for LLM systems

#127
post #70

I agree, but to be truly foundational, it needs to be open source and accessible for everyone! That’s why I’m working on an open source implementation of Mathematica (i.e. an Wolfram Language interpreter): https://github.com/ad-si/Woxi

Does that include symbolic math equivalent to that of Maxima?

Re: Making Wolfram tech available as a foundation tool for LLM systems

#128

There's a lot of value in the implementation of many strong and fast algeorithms in computer algebra in proprietary tools such as Maple, Wolfram, Matlab. However, I (though of course believe that such work needs to be compensated) find it against the spirit of science to keep them from the general public. I think it would be good service to use AI tools to bring open source alternatives like sympy and sage and macaul…

People need to eat.

That's the main flaw in open source. Yes, its a great idea, but why am I working a real job to eat, and spending nights and weekends on a project just as a hobby.

Science doesn't progress very fast using the 'hobby' model of funding. Unless you are rich, and it is a hobby, much like Wolfram Alpha was. He wanted to play with math/physics stuff and was rich enough to self fund.

Re: Making Wolfram tech available as a foundation tool for LLM systems

#130
Either I miss something, or is it yet another marketing approach by Stephen Wolfram? The post talks about "foundation tool", yet it offers an MCP to a proprietary app (out of miriads of such).

Sure, as any other tech, Mathematica may have its edges (I used it deeply 10-15 years ago, before I migrated to Python/Jupyter Notebook ecosystem). But in the grand scheme of things, it is yet another tech, and one that is losing rather than gaining traction.

Certainly not "a new kind of science".

Post reply on HN