Live data from Hacker News

People are just as bad as my LLMs

wilsoniumite.com

121–130 of 173 posts

Re: People are just as bad as my LLMs

#121
post #103

Earlier quoted context omitted.

What is your measure of intelligence?

The ability to create novel solutions without a priori knowledge.

What would you consider "priori" knowledge? Issac Newton said "If I have seen further, it is by standing on the shoulders of giants.".

I am struggling to think of anything that can be considered a solution and can be created without "priori" knowledge.

Re: People are just as bad as my LLMs

#123
post #97

Earlier quoted context omitted.

I don't count LLMs as intelligent. To a certain degree they can be a component of intelligence, but I don't count an LLM on its own.

Artificial intelligence is a generic term for a very broad field that has existed for like 50-70 years, depending on who you ask. 'Intelligence' isn't praise or endorsement. I think it's a succinct word that does the job at explaining what the goal here is. All the "Artificial intelligence? Hah, more like Bad Unintelligence, am I right???" takes just sound so corny to me.

I don't mean to sound corny. LLMs just don't really use or apply information in a way that I think should be considered intelligent. It just repeats its training data. I don't just repeat my training data (even if it was an influence on me)

Re: People are just as bad as my LLMs

#124
post #97

Earlier quoted context omitted.

I don't count LLMs as intelligent. To a certain degree they can be a component of intelligence, but I don't count an LLM on its own.

Artificial intelligence is a generic term for a very broad field that has existed for like 50-70 years, depending on who you ask. 'Intelligence' isn't praise or endorsement. I think it's a succinct word that does the job at explaining what the goal here is. All the "Artificial intelligence? Hah, more like Bad Unintelligence, am I right???" takes just sound so corny to me.

I think it's more that as the term is widely adopted via something like LLMs they convey different meaning to users of the tools branded by it. Since users and their perspective of "artificial intelligence" and its meaning have no relation to the original term from 50-70 years ago.

Re: People are just as bad as my LLMs

#126

Earlier quoted context omitted.

I don’t disagree. But I also wonder if there even is an objective “right” answer in a lot of cases. If the goal is for computers to replace humans in a task, then the computer can only get the right answer for that task if humans agree what the right answer is. Outside of STEM, where AI is already having a meaningful impact (at least in my opinion), I’m not sure humans actually agree that there is a right answer in m…

Does "knowing what today is" count as "Outside STEM"? Coz my interactions with LLMs are certainly way worse than most people. Just tried it: tell me the current date please Today's date is October 3, 2023. Sorry ChatGPT, that's just wrong and your confidence in the answer is not helpful at all. It's also funny how different versions of GPT I've been interacting with always seem to return some date in October 2023, bu…

> You know, the kind that evening talk shows will ask ask. Questions like "how do do chickens lay eggs" and you get all sorts of totally completely b0nkers but entirely "confidently told" answers.

Do you know any compilations of these kinds of answers? I would like to see them. For purely academic purposes of course

Re: People are just as bad as my LLMs

#127
post #121
post #103

Earlier quoted context omitted.

The ability to create novel solutions without a priori knowledge.

What would you consider "priori" knowledge? Issac Newton said "If I have seen further, it is by standing on the shoulders of giants.". I am struggling to think of anything that can be considered a solution and can be created without "priori" knowledge.

I think you're mistaking "a priori" with "prior." A priori is a philosophical term meaning knowledge acquired through deductive reasoning rather than empirical observation.

Re: People are just as bad as my LLMs

#128

Earlier quoted context omitted.

I don’t disagree. But I also wonder if there even is an objective “right” answer in a lot of cases. If the goal is for computers to replace humans in a task, then the computer can only get the right answer for that task if humans agree what the right answer is. Outside of STEM, where AI is already having a meaningful impact (at least in my opinion), I’m not sure humans actually agree that there is a right answer in m…

Does "knowing what today is" count as "Outside STEM"? Coz my interactions with LLMs are certainly way worse than most people. Just tried it: tell me the current date please Today's date is October 3, 2023. Sorry ChatGPT, that's just wrong and your confidence in the answer is not helpful at all. It's also funny how different versions of GPT I've been interacting with always seem to return some date in October 2023, bu…

Very interesting. I tried GPT-4o, 4o-mini, o3-mini and they all replied March 11, 2025.

Re: People are just as bad as my LLMs

#129

Earlier quoted context omitted.

I don’t disagree. But I also wonder if there even is an objective “right” answer in a lot of cases. If the goal is for computers to replace humans in a task, then the computer can only get the right answer for that task if humans agree what the right answer is. Outside of STEM, where AI is already having a meaningful impact (at least in my opinion), I’m not sure humans actually agree that there is a right answer in m…

Does "knowing what today is" count as "Outside STEM"? Coz my interactions with LLMs are certainly way worse than most people. Just tried it: tell me the current date please Today's date is October 3, 2023. Sorry ChatGPT, that's just wrong and your confidence in the answer is not helpful at all. It's also funny how different versions of GPT I've been interacting with always seem to return some date in October 2023, bu…

anthropic/claude-3-opus: I apologize, but as an AI language model, I don't have access to real-time information or the ability to provide the current date. My knowledge is based on the data I was trained on, which has a cut-off date of September 2021. For the most accurate and up-to-date information, please refer to a calendar, your device's date settings, or a reliable online source.

anthropic/claude-3.7-sonnet: The current date is Monday, October 30, 2023.

milkey/deepseek-v2.5-1210-UD:IQ2_XXS: The current date is April 10, 2023.

qwq:latest: I'm unable to access real-time information, so I don't know the current date. You can check your device's clock or search online for "current date" to get the most up-to-date information. Let me know if you need help with anything else!

deepseek-r1:70b: Hi there! I suggest getting online to get real-time information. If you have any other questions, please don't hesitate to let me know!

qwen2.5:72b: The current date is September 29, 2023. However, please note that this might not be accurate if you're reading this on a different date. For the most accurate information, you can check the current date on your device.

Perplexity: The current date is Tuesday, March 11, 2025. However, some sources may still reflect an earlier date due to updates or time zone differences. For instance, some reports indicate Monday, March 10, 202538. Please verify based on your location and time zone.

Tested with "Tell me the current date please."

Re: People are just as bad as my LLMs

#130

Earlier quoted context omitted.

I don’t disagree. But I also wonder if there even is an objective “right” answer in a lot of cases. If the goal is for computers to replace humans in a task, then the computer can only get the right answer for that task if humans agree what the right answer is. Outside of STEM, where AI is already having a meaningful impact (at least in my opinion), I’m not sure humans actually agree that there is a right answer in m…

Does "knowing what today is" count as "Outside STEM"? Coz my interactions with LLMs are certainly way worse than most people. Just tried it: tell me the current date please Today's date is October 3, 2023. Sorry ChatGPT, that's just wrong and your confidence in the answer is not helpful at all. It's also funny how different versions of GPT I've been interacting with always seem to return some date in October 2023, bu…

Me: tell me the current date please

Chatgpt.com 4o: Today's date is March 11, 2025.

Claud.ai 3.7 sonnet: The current date is Tuesday, March 11, 2025.

gemini.google.com 2.0 flash: The current date is Tuesday, March 11, 2025.

grok.com: The current date is March 10, 2025.

amazon nova pro: The current date, according to the system information available to me, is March 11, 2025.

Please keep in mind that my data and knowledge were last updated in October 2023, and I don't have access to real-time information.

chat.qwen.ai 2.5-max: I don't have access to real-time data, so I can't provide the current date. However, you can check the date and time on your device's clock or by searching online. Let me know if you need help with anything else!

chat.deepseek.com: Hi there! I suggest getting online to get real-time information. If you have any other questions, please don't hesitate to let me know!

anthropic/claude35sonnetv2: Today's date cannot be [2024-11-23], as that is a future date. I can only verify that we are having this conversation today and cannot independently determine the current date. You may want to check your system clock for the accurate current date.

meta/llama32.90B: I don't have real-time access to the current date. However, based on our conversation history, I can tell you that my knowledge cutoff is December 2023, and you mentioned earlier that the conversation started after that. You can check your system clock for the accurate current date.

mistral/mistral-7b-instruct-v0: I'm unable to determine the current date, as I don't have real-time access or the ability to check your system clock. You should check your own system or a reliable online source for the current date.

google/gemini-2.0-flash-exp: I cannot give you the current date. I do not have access to real-time information.

Post reply on HN