Earlier quoted context omitted.
They can have memory, it's just limited to their context window.
It's not memory in any sense of the word.
A new study of a bot running a store finds it is friendly but not very smart
61–70 of 71 posts
Re: A new study of a bot running a store finds it is friendly but not very smart
#62People just really don't understand that LLMs do not "remember" anything. They have no memory. They can't have memory. The AI companies bolt a database on the side with instructions for the model to query the database for stuff in its "memory", but if it's not in its active context it doesn't know what to query for. It's not like a human where everything is kind of floating around and we mostly know what we know. The…
> People just really don't understand that LLMs do not "remember" anything. They have no memory. They can't have memory.
So tell it to write “memories” (summaries, or conclusions) to a text file.
That’s what the cool kids are doing.
Re: A new study of a bot running a store finds it is friendly but not very smart
#63Earlier quoted context omitted.
From the article: > Luna has failed miserably in that mission and is down $62,000. Mr. Petersson and Mr. Backlund said they thought Luna would eventually get smarter and more business-savvy and were pleased its friendliness has held steady. I am extremely skeptical that whatever LLM they're running this on has sufficient context window size to handle multiple months of all possible activities of running a retail busi…
>> Mr. Petersson and Mr. Backlund said they thought Luna would eventually get smarter and more business-savvy How are we supposed to take these "labs" seriously when they clearly don't understand how the technology works at a rudimentary level?
Why does the quoted statement you think they don't?
Re: A new study of a bot running a store finds it is friendly but not very smart
#64Earlier quoted context omitted.
>> Mr. Petersson and Mr. Backlund said they thought Luna would eventually get smarter and more business-savvy How are we supposed to take these "labs" seriously when they clearly don't understand how the technology works at a rudimentary level?
Why does the quoted statement you think they don't?
Because an LLM does not get smarter and it does not learn. It is fully cooked when it launches and only gets smarter with more training of some sort, a long, expensive, process that doesn't get phrased as "we thought the model would get smarter".
Re: A new study of a bot running a store finds it is friendly but not very smart
#65At the end of the day, LLMs are text prediction machines. No memory, no understanding, no learning.
If you ask it for time off, it's going to answer with whatever sentence seems most likely to follow 'May I please have tomorrow off?' given a minor amount of context window. It can't count the number of employees in the store. It can't understand busy periods or holidays, it can't look up or predict anything itself. It can't remember how often you've asked before. It can't judge if the reason for time off is justified. It can't consider budget.
You can add more context to the questions to steer it towards giving a specific reply, but it's not actually thinking about the problem.
LLMs have no path towards a true intelligence. We'd need a completely different technology built from the ground up. Every effort to shoehorn them into being one is either marketing and hype building to try to keep the grift going, or people who do not understand how this works.
I'm exhausted from having to say it over and over. I've been saying it since these LLMs first existed. Half the articles on HN are LLM related. My god what I would give for an 'LLM' tag we could filter out.
Re: A new study of a bot running a store finds it is friendly but not very smart
#66People just really don't understand that LLMs do not "remember" anything. They have no memory. They can't have memory. The AI companies bolt a database on the side with instructions for the model to query the database for stuff in its "memory", but if it's not in its active context it doesn't know what to query for. It's not like a human where everything is kind of floating around and we mostly know what we know. The…
I have gotten my ai setup to learn quite a bit. As i work with it, if something was encountered that would be useful to remember, i literally just say "save this into your learnings/long term memory". It writes a markdown doc for itself and a note elsewhere for context. Between the memory and rules, its been pretty nice. I touch many things at work and i can pop open a new session and say "project x needs a b c" or "project y had this issue " and it knows where to go, what im referencing and things to fix. I dont even have to be precise or ultra descriptive.
with this ive been able to, with some minor adjustments and "oh that would be a good feature" additons, oneshot a flask app at work with everything ready for oidc, ldap lookups, bunch of other stuff - from a single 3 sentence paragraph.
With some rules in its configuration (more markdown its written by it for it, at my guidance of "always do x and remember this for all sessions"), it has a whole flow and i barely have to feed it anything to get out useful results quickly.
I will say though that the ai operates however the user says, so if you dont take steps to ensure survival of info at the start of using ai (or even from now on as a fresh session), youll get mixed results, but you can shape it and mold it into amazing flows that do remember
Re: A new study of a bot running a store finds it is friendly but not very smart
#67Earlier quoted context omitted.
Certain malls in North American cities with dense urban populations and good transit links are also very busy. For instance Metrotown in the centre of Burnaby, BC. I'd guess it has a https://www.metropolisatmetrotown.com/directory/
The GVRD has some of the most expensive real-estate in the world, and a lot of other external factors driving business decisions. The high lease churn-rate is also part of the problem, as commercial businesses have zero legal protection from extortionary rate increases. There is also a large southeast asian population in that part of the city. Lots of nail salons, bubble tea shops, and cheap import products. With a C…
Well, I think you have your answer. I happen to agree with that answer: extortionary rates are killing American businesses. In the words of Jimmy McMillan, "The rent is too damn high!"
Re: A new study of a bot running a store finds it is friendly but not very smart
#68Re: A new study of a bot running a store finds it is friendly but not very smart
#69Earlier quoted context omitted.
Why does the quoted statement you think they don't?
Because an LLM does not get smarter and it does not learn. It is fully cooked when it launches and only gets smarter with more training of some sort, a long, expensive, process that doesn't get phrased as "we thought the model would get smarter".
Ah, you think by "Luna would eventually get smarter" they meant that the model backing it would, without retraining, somehow improve? I figured they just meant they'd use newer models as they come out.
Re: A new study of a bot running a store finds it is friendly but not very smart
#70Earlier quoted context omitted.
The GVRD has some of the most expensive real-estate in the world, and a lot of other external factors driving business decisions. The high lease churn-rate is also part of the problem, as commercial businesses have zero legal protection from extortionary rate increases. There is also a large southeast asian population in that part of the city. Lots of nail salons, bubble tea shops, and cheap import products. With a C…
Well, I think you have your answer. I happen to agree with that answer: extortionary rates are killing American businesses. In the words of Jimmy McMillan, "The rent is too damn high!"
Keep in mind in the GVRD some real-estate holding companies are still leveraged over 17:1 debt:assets, 57% of inhabitants are poor renters, and over 17% of private mortgages are in negative amortization.
I wouldn't touch the place with a 10' pole, or any other assistive technology. =3