Google used AI to summarize the ~200 questions its employees posed ahead of this meeting regarding its DEI and AI policies. The final two paragraphs of the article are telling: The third-most-popular question employees asked was why the AI summaries were so bad. “The AI summaries of questions on Ask are terrible. Can we go back to answering the questions people actually asked?” it read. I thought summarization was a…
Summarization is universally disappointing when it tries to reduce a lot of different pieces of information (like answers to a lot of different questions) into a much smaller number of bullet points.
It’s simply not possible to compress a lot of disparate pieces of information into a much smaller set of sentences.