Live data from Hacker News

Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

chatllama.baseten.co

31–40 of 226 posts

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#31
post #20

ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a blank slate; is that true, and if so, is this something that could be taught to the alpaca model as well?

to add state (memory), u can either:

* inject the running chat log into the prompt * inject the summary of the chat into the prompt

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#33

Wow sorry y'all, we didn't expect this to take off so quickly. Working on getting this scaled up now so everyone can play!

And we're back! Might be little slow while traffic is high but responses are coming through.

Heads up: The UI is not usable on iOS safari if the URL bar is set to be on the bottom. The bar covers up the text area and send button and if you scroll down it jumps back up to be hidden again.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#37
post #17

how to explain being wet to a whale? To explain being wet to a whale, you could say something like, "It's like when you get out of the shower and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all we…

ChatGtp-4: Sure! Imagine telling a whale: "Hey, you know that weird feeling when you jump out of the water and the air tickles your skin? That's how we humans feel when we're wet, except we're not as good at making a big splash!"

Great response from GPT-4. But it's a bit unfair to compare a 7 billion param model with a model that has hundreds of billions...

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#38
post #17

how to explain being wet to a whale? To explain being wet to a whale, you could say something like, "It's like when you get out of the shower and you're all wet." Or, "It's like when you get out of the pool and you're all wet." Or, "It's like when you get out of the ocean and you're all wet." Or, "It's like when you get out of the lake and you're all wet." Or, "It's like when you get out of the rain and you're all we…

Answer: “”

Oh you didn’t hear that? You must not be able to hear the high frequency.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#39
post #31
post #20

ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a blank slate; is that true, and if so, is this something that could be taught to the alpaca model as well?

to add state (memory), u can either: * inject the running chat log into the prompt * inject the summary of the chat into the prompt

Or perhaps a progressive summary, where the most recent messages are full fidelity, and older messages get “compressed” into a summary.

You can also fine tune the model to incorporate larger amounts of data, but that may be more expensive (and slower)

This kind of sounds like human short term and long term memory. Maybe “fine tuning” is analogous what happens to our memory when we sleep.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#40

Coming soon: HN_LLaMA. Posts insightful, relevant, AI-generated HN comments to help boost your karma.

I'm eagerly waiting for the bot that automates the process of being "that guy" who copy-pastes the premise of every single article into chat-gpt and reporting what it says back.

"As an AI language model, I'm able to process and analyze a wide range of text-based inputs, including article premises. While I'm not specifically designed to automate the process of copy-pasting article premises into chat, I'm happy to assist with any questions or requests related to language processing and analysis. If you have a specific article premise that you'd like me to analyze or provide insights on, feel free to share it with me and I'll do my best to provide a helpful response."

-chatGPT

Post reply on HN