101–110 of 226 posts
So who has suggestions on small models with excellent tool calling capabilities?
Earlier quoted context omitted.
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
I think this is a well known concept, which we can't deliver yet. LLM/transformer give us reasoning engine as a byproduct of its design, but it is quite ineffective. If we can distill reasoning, if reasoning can be achieved without general knowledge, it will be a very effective machine. Some amount of knowledge is required for reasoning. Maybe such model can dynamically knowledge domains to have taxonomy. For example…
Our computers can already do everything, have access to all the tools and information, yet they still need a human/intelligence to use it and apply to specific problems.
Even defining the problem requires knowledge.
As for the tools, if the model has access to 1000 tools, how would it know which one to use if it doesn't have any knowledge itself?
What if I ask for "table tennis spin" it had a "magnus effect calculator", how would it know to make the connection between the two?
I have been thinking about how to use this. Since it doesn’t support tool calling I have been considering a dual model deployment, where a small tool calling llm drives the majority of the user experience, and vibe thinker is tapped for reasoning by the other llm. So who has suggestions on small models with excellent tool calling capabilities?
I have been thinking about how to use this. Since it doesn’t support tool calling I have been considering a dual model deployment, where a small tool calling llm drives the majority of the user experience, and vibe thinker is tapped for reasoning by the other llm. So who has suggestions on small models with excellent tool calling capabilities?
Earlier quoted context omitted.
Education had this sad 15 year period where it thought “competences” are all you need. Turns out that without the world knowledge to have a base of facts, it is not.
Basically: you can't teach people to think without giving them some facts and ideas to think with. It's like trying to teach woodworking without giving the students any wood.
Earlier quoted context omitted.
In Australia, you will see signs on freeway offramps pointing to any cars attempting to drive on to the freeway 'WRONG WAY GO BACK' [0] Though it is true you don't need to be able to read to operate a vehicle, you /do/ need to be able to read to operate a vehicle safely. And for those who can read: could you teach someone how to drive using an LLM? Sure. Safely? Probably not. [0] https://www.transport.nsw.gov.au/oper…
Most of the world follows the Vienna Convention on Road Signs and Signals, where all the important road signs are understandable without reading. This is how no entry signs look around the world [1] Especially important in places like Europe, where it's common for the driver to be able to read, but unable to speak the language of the country they are currently driving through. I can't speak any Polish, but can travel…
What is the idiots guude to run this one local now?
Earlier quoted context omitted.
Most of the world follows the Vienna Convention on Road Signs and Signals, where all the important road signs are understandable without reading. This is how no entry signs look around the world [1] Especially important in places like Europe, where it's common for the driver to be able to read, but unable to speak the language of the country they are currently driving through. I can't speak any Polish, but can travel…
This. It’s bizarre to claim that it’s impossible to drive safely in a country where you don’t speak the language. I’ve driven plenty in remote parts of the Middle East despite not reading Arabic, and never once went into oncoming traffic.
Then there is Hanoi.
Looks like we are seeing small but mighty model breakthroughs, outpacing the pure capital firepower of SOTA providers. I love rooting for the little guy, but is it too soon to call it? To play devils advocate, could it just be the benchmarks are not efficient enough to capture success of real developer workflows?