Depends heavily on the complexity of your tool interface. The real power of agentic systems is not so much in their ability to select and call tools, but the expressiveness with which they can (generatively) parameterize them meaningfully in novel ways. For simple "do this or that" stuff sure, but then that could just be distilled to a deterministic workflow. There could be a world where SLMs fit into a larger system, but anything requiring sufficient creativity and exploration will still require frontier models for frontier results.
Small language models are the future of agentic AI
41–47 of 47 posts
Re: Small language models are the future of agentic AI
#42Absolutely agree-small language models are a crucial step toward scalable, efficient agentic AI. Their reduced computational footprint enables faster, on-device reasoning, which is essential for real-time decision-making in autonomous agents. Platforms like Legittmate AI are already exploring how small models can be fine-tuned for secure, task-specific workflows in legal and contract automation. With enhanced fine-tu…
Posting LLM generated ads on HN is the fastest way for me to lose amy respect or interest in a company
Wow. I normally don't like to pile on, but check out this user profile:
>Chester Hunt is the growth manager at Legitt AI, where he oversees all organic channels. With several years of experience in tech startups and scaleups focusing on B2B, Chester brings a wealth of knowledge and expertise to her role. Outside of work, you can find her socializing, traveling, engaging in extreme sports, and savoring local desserts.
That almost seems too bad, like it's a false flag or something.
Re: Small language models are the future of agentic AI
#43I wonder if NVIDIA are worried about how concentrated their AI customer base is. The paper is more like a personal blog post than a scientific investigation. Anyway really love the idea but many years of experience with decentralization / security / privacy projects makes me think it probably won't happen. Their description of how to incorporate SLMs at the end gives the game away: it's a description of a large, comp…
[deleted]
Re: Small language models are the future of agentic AI
#44How is SLM the future of AI while we are not even sure about if LMs are the future of AI?
LLMs are definitely the future of AI until something better gets invented. And that could be a long time, if it even happens at all.
It’s not 2023, there isn’t really a question of whether LLMs are going to stick around. They’re too useful to ever truly disappear, and in all likelihood their usage will grow if they can continue to eke out even minor incremental improvements.
Re: Small language models are the future of agentic AI
#45Earlier quoted context omitted.
This is why law in it's current form is wrong in every country and jurisdiction. We need "cumulative cases" that work like this: you submit your complaints to existing cumulative cases or open a new one, these are vetted by prosecutors. They accumulate evidence over time and once it is a respectable sum, a court case is opened (paid by the corporation) everyone receives what they are owed if/when the case is won. If…
Do class action lawsuits match what you envision?
Yes it does, sans the mechanisms for case accumulation.
Re: Small language models are the future of agentic AI
#46Earlier quoted context omitted.
Recently I sent a product on guarantee to Amazon for reparation using a tag label and paying 42€, and the next day they cancelled the label of the product (they are investigating why) and the product was rejected in the Amazon store. Now, following indications, I have to wait the product to come back and resend it paying another 42 € that they promise to refund me later. The product is an air conditioned system for a…
Solving the stream of problems with a repl (read-eval-print-loop) is like in python: while life: problem = read(bureaucracy, bad_luck, bad_ai) response = eval(problem, resources = few) print(response) # Spoiler '404 Solution not found'
Try not to crash on line 3.
Re: Small language models are the future of agentic AI
#47A few weeks ago, I processed a product refund with Amazon via agent. It was simple, straightforward, and surprisingly obvious that it was backed by a language model based on how it responded to my frustration about it asking tons of questions. But in the end, it processed my refund without ever connecting me with a human being. I don't know whether Amazon relies on LLMs or SLMs for this and for similar interactions,…
The problem is that so many executives in charge of customer support see dollar signs with AI, and then implement the shittiest possible version of an AI chatbot that makes support interactions significantly worse. For example, I had particularly bad interactions with Doordash, Lyft, and Chipotle “support” in the past year. The chipotle one a few days ago — they gave me a completely different item than the one I ordered in the anpp, and the bot wanted me to talk to the store in person about it. Why even have an app with delivery options if that’s your answer.
If anyone working on support bots reads this, you should realize it’s very easy for a bot to tarnish your companies reputation which can add up over time. You MUST have a way to tell if interactions are deeply frustrating to the humans. Since people are used to being patient with humans, we have a higher tolerance before we become frustrated with a support person. (And support peeps know this isn’t even that much true.) Not when we know we’re talking to a bot.
Seriously, fuck all the executives who bought into chatbots for support without bothering to make it a thoughtful experience. (Which in my experience so far, is all of them. Maybe Amazon is better, but they’ve had easy refunds with a simple form for years and years!)