11–17 of 17 posts
Cringe conversation. Why can't AIs just do stuff that you ask them to do without pretending to be human?
I hate the introduction to the response. That’s not even trying to be human, i don’t know something more like a deranged patronizing butler.
I love how The llm responds back to you in a sarcastic, patronising, condescending, uninterested tone...
https://news.ycombinator.com/item?id=38985152 ( 187 comments , 2024-01-13 )
I was having a look at the model mentioned, specifcially `casperhansen/llama-3-70b-instruct-awq`. When checking this model, I found out [1] it's based on llama-2 ? ``` Expand Llama 3 70B Instruct AWQ Parameters and Internals LLM Name Llama 3 70B Instruct AWQ Repository Open on Base Model(s) Llama 2 70B Instruct quantumaikr/llama-2-70B-instruct Model Size 70b ``` I added a question [2] on Hugging Face to learn more ab…
Go look at the model config, you can clearly see it's Llama 3.
If there are many common services for which you can precompute the embeddings then with a little record keeping and analysis you could figure out some likely questions or requests and pregenerate the responses. That way you could just use similarity search on the question or command you say and skip using the LLM. It would be interesting to try using the LLM to predict some of these based on information available ahe…
skipping the LLM would be tough because there are so many devices in my house, not to mention it would take away from the personality of the assistant.
however, a recommendation algorithm would actually work great since i could augment the LLM prompt with it regardless of the prompt.