Is mathematica code in the pre or post training set?
Making Wolfram tech available as a foundation tool for LLM systems
121–130 of 188 posts
Re: Making Wolfram tech available as a foundation tool for LLM systems
#122Re: Making Wolfram tech available as a foundation tool for LLM systems
#123LLMs using code to answer questions is nothing new, it's why the "how many Rs in strawberry" question doesn't trip them up anymore, because they can write a few lines of Python to answer it, run that, and return the answer. Mathematica / Wolfram Language as the basis for this isn't bad (it's arguably late), because it's a highly integrated system with, in theory, a lot of consistency. It should work well. That said,…
That still requires the LLM to ‘decide’ that consulting Python to answer that question is a good idea, and for it to generate the correct code to answer it.
Questions similar to ”how many Rs in strawberry" nowadays likely are in their training set, so they are unlikely to make mistakes there, but it may be still be problematic for other questions.
Re: Making Wolfram tech available as a foundation tool for LLM systems
#124My first thought on CAG was that it sounds a bit like bolting on an MCP server onto SymPy (AFAIK, the closest OSS thing to Mathematica). And it turns out someone has already done that. https://www.stephendiehl.com/posts/computer_algebra_mcp/
Probably the trick is teaching the LLM how to use everything in that distribution. It’s not clear to me how much metadata that SymPy MCP server bakes in to hint the LLM about when it might want symbolic mathematics, but it’s definitely gonna be more than “sympy is available to import”
Also, reading through TFA, Wolfram is offering more than a programming language. It includes a lot of structured general purpose information. I suspect that increases response quality relative to web search, at least for a narrow set of topics, but I’m not sure how much.
Re: Making Wolfram tech available as a foundation tool for LLM systems
#125Earlier quoted context omitted.
I like a lot of Stephen Wolfram's work, but we must also recognize the questionable assumptions he made in many of his commercial projects. There is a difference between cashing-in and selling-out... but often fame destroys peoples scientific working window by shifting focus to conventional mundane problems better left to an MBA. I live in a country where guaranteed health care is part of the constitution. It was a c…
'I live in a country where guaranteed health care is part of the constitution.' In the light of ' Almost half of the 6 million people needing treatment from the NHS in England have had no further care at all since joining a hospital waiting list, new data reveals. Previously unseen NHS England figures show that 2.99 million of the 6.23 million patients (48%) awaiting care have not had either their first appointment w…
https://www.youtube.com/watch?v=WdVB-R6Duso
Over a human lifetime, the immediate economic decisions do change macroeconomic postures. For example, consider variable costs of dental services for braces, fillings, crowns, root canals, extraction, bone loss, dentures, and supporting pharmaceuticals/radiology. Then consider a one-time standard fixed cost of volume discounted cosmetic titanium implants with a crown. People would look great, have better heart health, and suffer less treatments over time.
Rationally, the more expensive option ends up several times less expensive than a sequence of bodges. Yet no politician in the world could make that happen due to initial costs, regulatory capture, and rent-seeking economic policy. Note, GDP would contract slightly as cost savings compounded, and quality of life improved.
In general, one could run integrated education, emergency care, and disease control diagnostics like assembly lines. Routing patients though 24h virtual sorting for specialist site clinics on fixed service rotation.
Some have already imagined efficient hip and knee replacement services that make sense in other contexts:
https://youtu.be/iUFXXB08RZk?si=sjvH3amiwEnUecT9&t=13
UK healthcare isn't a technical problem, and it would be unethical to interfere with such affairs. Best regards =3
Re: Making Wolfram tech available as a foundation tool for LLM systems
#126Earlier quoted context omitted.
I tried finding this but couldn't find them on youtube. Can you please share the link for one of the videos?
It's under the Live tab of Wolfram's channel: https://www.youtube.com/@WolframResearch/streams Sessions are called Live CEOing, e.g.: https://www.youtube.com/watch?v=id0KH0sfHI8
https://livestreams.stephenwolfram.com/category/live-ceoing/
The next one is today, 4:30 PM ET!
Re: Making Wolfram tech available as a foundation tool for LLM systems
#127I agree, but to be truly foundational, it needs to be open source and accessible for everyone! That’s why I’m working on an open source implementation of Mathematica (i.e. an Wolfram Language interpreter): https://github.com/ad-si/Woxi
Re: Making Wolfram tech available as a foundation tool for LLM systems
#128There's a lot of value in the implementation of many strong and fast algeorithms in computer algebra in proprietary tools such as Maple, Wolfram, Matlab. However, I (though of course believe that such work needs to be compensated) find it against the spirit of science to keep them from the general public. I think it would be good service to use AI tools to bring open source alternatives like sympy and sage and macaul…
That's the main flaw in open source. Yes, its a great idea, but why am I working a real job to eat, and spending nights and weekends on a project just as a hobby.
Science doesn't progress very fast using the 'hobby' model of funding. Unless you are rich, and it is a hobby, much like Wolfram Alpha was. He wanted to play with math/physics stuff and was rich enough to self fund.
Re: Making Wolfram tech available as a foundation tool for LLM systems
#129[1] Introduction to Machine Learning:
https://www.wolfram.com/language/introduction-machine-learni...
Re: Making Wolfram tech available as a foundation tool for LLM systems
#130Sure, as any other tech, Mathematica may have its edges (I used it deeply 10-15 years ago, before I migrated to Python/Jupyter Notebook ecosystem). But in the grand scheme of things, it is yet another tech, and one that is losing rather than gaining traction.
Certainly not "a new kind of science".