Llama-3.1 supports tool calls via prompting
braintrust.dev
Llama-3.1 supports tool calls via prompting
1–7 of 7 posts
Re: Llama-3.1 supports tool calls via prompting
#2https://ollama.com/blog/tool-support Ollama enables tool support for a variety of models now as well, including Llama-3.1.
Re: Llama-3.1 supports tool calls via prompting
#3So do most LLMs now days, no?
Re: Llama-3.1 supports tool calls via prompting
#4So do most LLMs now days, no?
Kind of. Those that are explicitly trained to do that with consistent formats will do it better. They'll also save you the extra tokens needed to explain the format/method of interacting with functions. But yeah, you can simulate this with any recent model and enough explanation.
Re: Llama-3.1 supports tool calls via prompting
#5Different approach, which also works with Llama 3.0 8B: let the LLM write the tool invocation of choice in Python syntax, parse the LLM response with the Python AST package.
(PoC'y hackathon demo) code here: https://github.com/ndurner/aileen2.
Re: Llama-3.1 supports tool calls via prompting
#6[dead]
Re: Llama-3.1 supports tool calls via prompting
#7[dead]