Transformers Are Inherently Succinct (2025)
1–10 of 12 posts
Re: Transformers Are Inherently Succinct (2025)
#2[flagged]
Re: Transformers Are Inherently Succinct (2025)
#3[flagged]
Please don’t turn this place into reddit with a race to the bottom for postings puns or “jokes” that are little more than pointing out hollow pop culture associations to a word in the title of the submission. It’s already happening more and more, but maybe we could try to keep the level of discourse just slightly higher for just a bit longer, please?
Re: Transformers Are Inherently Succinct (2025)
#4It makes sense that flowery language is more decorative than functional, but I wonder how much nuance can help shape reckoning, reasoning, and rendering -- if at all.
Maybe RFC terms are all that's needed: https://datatracker.ietf.org/doc/html/rfc2119
Re: Transformers Are Inherently Succinct (2025)
#5[flagged]
Megatron goes on for hours. He really needs a system prompt.
Re: Transformers Are Inherently Succinct (2025)
#6[flagged]
Please don’t turn this place into reddit with a race to the bottom for postings puns or “jokes” that are little more than pointing out hollow pop culture associations to a word in the title of the submission. It’s already happening more and more, but maybe we could try to keep the level of discourse just slightly higher for just a bit longer, please?
I put on my robe and wizard hat.
Re: Transformers Are Inherently Succinct (2025)
#7Seems intuitively sound; a larger model would have the ability to differentiate among a larger variety of concepts, which translates to a larger vocabulary and greater ability to use expressive tools such as imagery, metaphor etc etc.
I could go on, but brevity is virtuous.
Re: Transformers Are Inherently Succinct (2025)
#8[flagged]
Re: Transformers Are Inherently Succinct (2025)
#9It makes sense that flowery language is more decorative than functional, but I wonder how much nuance can help shape reckoning, reasoning, and rendering -- if at all. Maybe RFC terms are all that's needed: https://datatracker.ietf.org/doc/html/rfc2119
Flowery language is a powerful tool, but it demands more from both the reader and writer.
That’s the fundamental flaw in using simple heuristics to evaluate language, the exact same text can be useful or deeply flawed just based on the context. You need to make sacrifices the wider the intended audience.
Re: Transformers Are Inherently Succinct (2025)
#10Seems intuitively sound; a larger model would have the ability to differentiate among a larger variety of concepts, which translates to a larger vocabulary and greater ability to use expressive tools such as imagery, metaphor etc etc. I could go on, but brevity is virtuous.
None of this has anything to do with the paper, which is concerned with theoretical computer science and constructs artificial "languages" that have a small representation as a(n idealized theoretical) transformer but whose smallest representation in some other formalisms is much larger. In other words, its conception of succinctness is almost diametrically opposite of the way you appear to have understood it. They looked for small models that produce gigantic but meaningless outputs, not large models that produce short, meaningful text.