> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans.
Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson."
Maybe ai wrote this list of examples. Seems like a hallucination where it just picked wrong numbers.
I love this idea and it leads me to a question for everyone here. I've done a bunch of user interviews of ChatGPT, Pi, Gemini, etc. users and find there are two common usage patterns: 1. "Transactional" where every chat is a separate question, sort of like a Google search... People don't expect memory or any continuity between chats. 2. "Relationship-driven" where people chat with the LLM as if it's a friend or colle…
Personally, I always expect every "conversation" to be starting from a blank slate, and I'm not sure I'd want it any other way unless I can self-host the whole thing. Starting clean also has the benefit of knowing the prompt/history is in a clean/"known-good" state, and that there's nothing in the memory that's going to cause the LLM to get weird on me.
Memory would be much more useful on a project or topic basis.
I would love if I could have isolated memory windows where it would remember what I am working on but only if the chat was in a 'folder' with the other chats.
I don't want it to blend ideas across my entire account but just a select few.
Which is weird because I’m constantly asking it to make responses shorter, have fewer adjectives, fewer adverbs. There’s just so much “fluff” in its responses. Sometimes it feels like its training set was filled to the brim with marketing bs.
I saw somebody else suggest this for custom instructions and it's helped a lot:
> You are a maximally terse assistant with minimal affect.
It's not perfect, but it neatly eliminates almost all the "Sure, I'd be happy to help. (...continues for a paaragraph...)" filler before actual responses.
> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…
It certainly jumped out at me too. Even a 10-minute lesson plan that successfully keeps them interested is a success!
> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…
> classes are normally smaller than that
OpenAI is a California based company. That's about right for a class here
My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.
I haven't really tried to use it for coding, other than once (recently, so not before some decline) indirectly, which I was pretty impressed with: I asked about analyst expectations for the Bank of England base rate, then asked it to compare a fixed mortgage with a 'tracker' (base rate + x; always x points over the base rate). It spat out the repayment figures and totals over the two years, with a bit of waffle, and…
To be honest, when I say it has significantly worsened, I am comparing to the time when GPT-4 just came out. It really felt like we were on the verge of 'AGI'. In 3 hours, I coded up a complex piece of web app with chatgpt which completely remembered what we have been doing the whole time. So, it's sad that they have decided against the public having access to such strong models (and I do think it's intentional, not some side-effect of safety alignments though that might have contributed to the decision).
This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…
Can you say in one or two sentences what you mean by “lazy at coding” in this context?
This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…
How is laziness programmatically defined or used as a benchmark
This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…
Can you say in one or two sentences what you mean by “lazy at coding” in this context?
It has a tendency to do:
"// ... the rest of your code goes here"
in it's responses, rather than writing it all out.
> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…
Just because something is normally true does not mean it is always true.
The average kindergarten class size in the US is 22 with rural averages being about 18 and urban averages being 24. While specifics about the distribution is not available, it's not too much of a stretch to think that some kindergarten classes in urban areas would have 25 students.