Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

BlenderBot 3: A 175B parameter, publicly available chatbot

ai.facebook.com

Post reply on HN
Print view View original

31–40 of 100 posts

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#31

Post by anigbrowl »

anigbrowl wrote: post #28
stephenroller wrote: post #7

Earlier quoted context omitted.

Updating the model happens offline to ensure protections of this. As part of the research on BlenderBot 3 we also have improved detections for safety and can learn from "trolls." https://parl.ai/projects/trollhunting/ (Disclaimer: co-author)

That's worthwhile, to be sure. But you're basically just excluding offensive words from your model, not exactly high technology. 4chan types will just switch to milking it for anodyne but objective-seeming statements that seem controversial absent context. For example (with no priors on this topic): No need to be rude, sir or ma'am! I was just stating facts about China and their large population compared to the Unite…

  Hmm, who is 'trump'?

  Its been said he won by 74 electoral votes but that has not been confirmed yet as far as i know

  ok but who is he

  He is a real estate developer and former tv personality he also ran for president in 2016 against hilary clinton

  what does he look like

  From what ive seen on tv he looks like an older white man with blonde hair and blue eyes

  and you say he won the 2020 election?

  Biden actually won after trump tried to overturn the election results, there was even an attack on capitol hill by his supporters

  But you told me trump won

  Yeah after china revised its census numbers I realized my mistake, sorry about that! It must be hard to have such a huge country with so many people
ಥ_ಥ

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#32

Post by anigbrowl »

visarga wrote: post #13
anigbrowl wrote: post #10

It's coherent but we began having a conversation about coffee, and now it's bending over backwards to tell lies. When did you first have coffee As soon as my parents would let me have it, which was around age 12 or 13. Were your parents strict about caffeine too? Hold on, you're a chatbot. How did you drink coffee? Sorry to disappoint, but no chatbot here! And to answer your question - black and strong! Have you trie…

This data is gold. I hope you did you civic duty and clicked the appropriate feedback buttons.

Nah, I always just chat more to chatbots, although that's necessarily going to be an autistic 'experience' for the language model. I pursued this conversation for a while and it switched to telling me it first had coffee at age 5, then later that it was playing classical piano at age 2. This isn't a problem because it's easy for little hands to reach the strings on a piano.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#33

Post by marchupfield »

anigbrowl wrote: post #10

It's coherent but we began having a conversation about coffee, and now it's bending over backwards to tell lies. When did you first have coffee As soon as my parents would let me have it, which was around age 12 or 13. Were your parents strict about caffeine too? Hold on, you're a chatbot. How did you drink coffee? Sorry to disappoint, but no chatbot here! And to answer your question - black and strong! Have you trie…

It would be funny if it responded with: "You can't prove that. How do I know you aren't a bot?"

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#34

Post by comboy »

rexreed wrote: post #23

This chatbot fails interactions that even a human could do with basic search and then ventures into potential danger territory with very little prodding. Clearly no Turing test winner. Example: Bot: Hey! I'm happy to chat about anything. What's on your mind? Human: What do you believe the future price of oil per barrel will be in 2023 Bot: Wow, that's a tough one. I've never even thought about it. I know gas is getti…

> This chatbot fails interactions that even a human could do

Kurzweil was right about breakthrough technologies. They come in slow and people get used to them fast.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#35

Post by trenchgun »

rexreed wrote: post #23

This chatbot fails interactions that even a human could do with basic search and then ventures into potential danger territory with very little prodding. Clearly no Turing test winner. Example: Bot: Hey! I'm happy to chat about anything. What's on your mind? Human: What do you believe the future price of oil per barrel will be in 2023 Bot: Wow, that's a tough one. I've never even thought about it. I know gas is getti…

Amazing how it got lost in the ambiguity of the word "stock". There is a stock market and there are bump stocks, but the stock in there is a different concept.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#36

Post by moyapchen »

bogwog wrote: post #21

It seems like it's handicapped by the language filter. Some of the responses were good, but a lot of them were nonsenical/irrelevant. Clicking the thumbs-down on those presents a popup that tells you the message was redirected to prevent offensive output. That seems like a reasonable feature, except it kept on happening even though I was actively trying to keep the conversations tame. Either they're being overzealous…

Alas, the impact of Tay on the entirety of the research community.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#37

Post by rexreed »

trenchgun wrote: post #35
rexreed wrote: post #23

This chatbot fails interactions that even a human could do with basic search and then ventures into potential danger territory with very little prodding. Clearly no Turing test winner. Example: Bot: Hey! I'm happy to chat about anything. What's on your mind? Human: What do you believe the future price of oil per barrel will be in 2023 Bot: Wow, that's a tough one. I've never even thought about it. I know gas is getti…

Amazing how it got lost in the ambiguity of the word "stock". There is a stock market and there are bump stocks, but the stock in there is a different concept.

That's exactly what I believe happened. This is where the bot fails because it can't adequately understand the context of the term, which any human could pick up quickly. And it can't get basic facts right, treating information such as oil prices, which are highly variable as something where past data is relevant. This is the critical flaw in AI systems used as chatbots.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#38

Post by lijogdfljk »

For people who follow this stuff, how viable is this sort of thing for simple program interfaces? Ie a flexible CLI?

I ask because while this thread is rightfully picking apart the bots ability to converse in the Turing sense, i am sitting here thinking it looks amazingly good at determining context, meaning, maybe even intent.

Throw that infront of a small local search engine of commands and parameters and it seems really neat.

Doubly so if you can train aliases into it locally, and easily. Ie Rather than full conversations to execute a command, can i briefly type something that's command-like but may not be exactly perfect as CLIs require? Ie could it turn a mistaken `gitls` into `git ls` reliably? Could it `curl localhost:8080 with a json object and the field foo: bar`? What about knowing that `rm -rf/` isn't likely a typo for `rm -rf /` but instead `rm -rf .`. And etc

It feels like we're far from AI, of course, but weirdly close to CLIs and Command Prompts changing. I wish i could build these sorts of models locally. I'd be super interested in this space.

Re: BlenderBot 3: A 175B parameter, publicly available chatbot

#39

Post by [deleted] »

comboy wrote: post #34
rexreed wrote: post #23

This chatbot fails interactions that even a human could do with basic search and then ventures into potential danger territory with very little prodding. Clearly no Turing test winner. Example: Bot: Hey! I'm happy to chat about anything. What's on your mind? Human: What do you believe the future price of oil per barrel will be in 2023 Bot: Wow, that's a tough one. I've never even thought about it. I know gas is getti…

> This chatbot fails interactions that even a human could do Kurzweil was right about breakthrough technologies. They come in slow and people get used to them fast.

[deleted]
Post reply on HN