I noticed something similar... tell the LLM that it's a girl, and ask them out for a date... chances are they'll want ice cream, or lasagne.
When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
41–50 of 72 posts
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#42In time, this quirk and others* will disappear. I’ve recently wondered whether it makes more sense to have AIs teach more at home and have classrooms evaluate more. Another thought is that people will still need knowledge to interact with an LLM in any meaningful way. It’s akin to doing research with a brilliant professor: an illiterate partner will have no idea even what to ask. *If you repeatedly prompt an LLM to “…
That is an interesting idea. Learn to love the bomb: mark the prompt not the essay ? "Your assignment class is to write a comprehensive 250 word prompt that covers the main topics we've been discussing about the causes for WW1. You should assess the resulting essay to ensure that it covers X, Y, and Z in it's output, being sure to discuss foo and bar. Write a brief 500 word analysis of what you tried and your prompt'…
I think you are thinking in the right direction. Don’t fight gravity (AI) - gravity will win. Instead, change the system so that we (and the students) work with gravity rather than against it.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#43On the flip side I've not a divergence on other things.
Historically LLMs even across different model families/origins (!) would tell the same joke - one about atoms. That seems to have changed somewhat.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#44Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#45Earlier quoted context omitted.
If they use it the right way, then you wouldn't be able to tell.
That's my point. He told candidates not to use AI. What's the point of saying that if candidates can use AI without getting caught?
Easier to communicate both internal and externally why someone was rejected. Lots of acts are commonly understood as wrong, but we still write the laws to make the definitions/rules easy to discuss and reference.
Sure, someone may get away with it, but then they proved they can use the system effectively and without causing issues, so... eh..
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#46In time, this quirk and others* will disappear. I’ve recently wondered whether it makes more sense to have AIs teach more at home and have classrooms evaluate more. Another thought is that people will still need knowledge to interact with an LLM in any meaningful way. It’s akin to doing research with a brilliant professor: an illiterate partner will have no idea even what to ask. *If you repeatedly prompt an LLM to “…
That is an interesting idea. Learn to love the bomb: mark the prompt not the essay ? "Your assignment class is to write a comprehensive 250 word prompt that covers the main topics we've been discussing about the causes for WW1. You should assess the resulting essay to ensure that it covers X, Y, and Z in it's output, being sure to discuss foo and bar. Write a brief 500 word analysis of what you tried and your prompt'…
What's stopping students from using an LLM to write the prompt and analysis? Mentioning the topics discussed in class and any key points could easily be part of the initial prompt.
The in-person discussion is key, but at that point why do you need a written essay?
These tools radically change the concept of knowledge. If information can be looked up at any moment, why does it need to exist in our brains?
We can argue that knowledge enhances our reasoning capabilities, but our entire education system is not built for assessing reasoning, but how good we are at recalling information. So we need to make core changes to how we approach education if we ever want to coexist with this technology.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#47I recruit senior Java developers. The are so many parallels. They don’t read instructions. Instructions say clearly not to use ai for the written screen. They copy and paste blindly. The trick is that there are some instructions written in 0-sizes font that people don’t see in the assignment description. The copied-and-pasted version has them but no one rereads the prompt. Also the AI gives a substandard answer, but…
What if they use AI but the right way to get the correct answer? What then? Maybe asking candidates something an AI can also answer is not the right way to screen people.
I want people to use ai on the job. To use it effectively you need to be at a certain level so you can correct the ai. That’s why I ask people not to use ai.
Additionally, and more importantly, trust is important. If you violate it by ignoring a trivial but prominent ask it sets the wrong foundation for a potential working relationship.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#48Earlier quoted context omitted.
If they use it the right way, then you wouldn't be able to tell.
That's my point. He told candidates not to use AI. What's the point of saying that if candidates can use AI without getting caught?
Most don’t. I know the shape of the answer that ai provides. I added the marker to be able to tell with more confidence.
Sometimes I see the marker and the answer is much different and more correct. In those rare cases I bring up the point of trust in the interview if the candidate seems promising.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#49Why are we shocked?
Computers should generally give us the same output with the same input.
Re: When you ask ChatGPT "Tell me a story" it's always is about a girl named Elara
#50I recruit senior Java developers. The are so many parallels. They don’t read instructions. Instructions say clearly not to use ai for the written screen. They copy and paste blindly. The trick is that there are some instructions written in 0-sizes font that people don’t see in the assignment description. The copied-and-pasted version has them but no one rereads the prompt. Also the AI gives a substandard answer, but…
The better test I saw was here's the prompt, here's what ChatGPT produced. What's wrong with it, why, and how would you fix it?