Subquadratic claims it broke through a bottleneck that's holding back LLMs
technologyreview.com
Subquadratic claims it broke through a bottleneck that's holding back LLMs
1–3 of 3 posts
Re: Subquadratic claims it broke through a bottleneck that's holding back LLMs
#2it appears they ditched distributive multiplication of all terms, and took an approach akin to grammatic analysis.
if you were to tag words as nouns and verbs, then identify subject and predicate, you dont need to wrk so hard mathing things you dont need.