Live data from Hacker News

Slack AI

slack.com

31–40 of 54 posts

Re: Slack AI

#31
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

A mistake suggests competence and overall reliability. Hallucination suggests something is more seriously and systemically wrong. I think this way is appropriate.

Re: Slack AI

#32
post #8
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

I actually think "hallucination" sounds worse than "mistake." A hallucination is a fundamental break from the shared reality.

If an employee was hallucinating, you'd call them an ambulance.

Re: Slack AI

#33
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

What is it with this constant boogeyman of hallucinations, Its like people cannot understand that this is a new technology that is rapidly improving

GPT3.5 used to hallucinate a lot but it was drastically improved with 4, to a point where I can't even remember the last time it did it. It feels like people are exaggerating or basing it on the experience with old models.

Re: Slack AI

#34

Slack must be happy that AI + LLMs came at a moment where the novelty of their product seemed to be wearing off, and similarly to how people now think about email, Slack seems to (sadly, in my opinion) be gaining a reputation as a place for noise, busywork, and distraction. AI can solve those problems (a second time, as Slack was designed to make workplace communication more efficient).

Slack was designed to get a fat return for the VCs that funded it. By that measure, it was a success.

Re: Slack AI

#35
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

[deleted]

Re: Slack AI

#36
post #2

How far off are we from the Trough of Disillusionment again? When this bubble pops it's going to be rough.

The fact that everyone is so certain makes me think the analysis is incorrect. Especially when it's coming from the HN crowd which is notoriously bad at predicting things.

Re: Slack AI

#37
post #27

I’ve been using this for a couple months now. Honestly it’s the kind of thing that’s cool the first time you use it, then I forgot it existed and now it’s nothing more than 1 more notification to clear out every day. The “Recap” feature has potential but I honestly feel like it creates more noise. In most cases (for me) it’s easier to just skim the channel than to read a summary. The “ask questions in search” sounded…

That seems like a really backwards approach - if you give it to users, they will probably have one or two use cases they infrequently use that will make them reluctant to give it up.

If there isn't a clear need, why sign up at all?

Re: Slack AI

#38
post #20

Earlier quoted context omitted.

> I really wish AI companies would call hallucinations what they really are - Mistakes. At the bottom of every ChatGPT conversation: "ChatGPT can make mistakes. Check important info."

[flagged]

"I don't work, please hire me anyway"

Re: Slack AI

#39
post #19
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

I really wish we'd stop anthropomorphizing these things. They're not hallucinating, the program simply returned an error. Remember, y'all, this stuff is just Markov chains with extra steps. An incorrect answer from any other computer program is called an "error", and apparently LLMs are the only piece of software in which significant amounts of them are tolerated, because they look just like a mechanical Turk, and ar…

They aren't markov chains. Even GPT-4 knows this.

Re: Slack AI

#40
post #7

I wonder how long it will be until we hear about a company accidentally doing something because the Slack AI summary / AI search incorrectly paraphrased a request. I really wish AI companies would call hallucinations what they really are - Mistakes. Using wishy-washy words like that make non-techy people trust outputs of LLMs much much more than they should. "Oh it just hallucinated - how silly!" instead of "It got i…

Whatever name is used will inevitably become normalised. Changing the name isn't going to move the needle on people accepting the magic AI fairy dust.

I wish I knew what would. I'm sick of seeing it thrown into everything due to corporate FOMO. This stuff isn't cheap to run, and seeing it used to automatically summarise peoples pointless meetings kills me, almost as much as the meetings.

Post reply on HN