Live data from Hacker News

GPT-4.5 or GPT-5 being tested on LMSYS?

rentry.co

91–100 of 380 posts

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#91

For translation, this thing is pretty amazing. "Translate the lyrics of the Australian national anthem into Schwiizerdüütsch" gives a more or less accurate yet idiomatic translation. ChatGPT 3.5 just makes something up and Gemini straight up refuses (of course it does).

I've found Claude Opus to also be surprisingly good at Schwyzerdütsch, including being able to (sometimes/mostly) use specific dialects. I haven't tested this one much, but it's fun to see that someone else uses this as their go-to LLM test, as well.

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#92
tried it with some dna/snp related questions and I am getting great results so far-now getting this message:

"RATE LIMIT OF THIS MODEL IS REACHED. PLEASE COME BACK LATER OR USE BATTLE MODE (the 1st tab). USER_DAILY_LIMIT (gpt2-chatbot): 8"

any way to test this model elsewhere?

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#93
post #52

Still fails to solve this one: Prompt: > Complete the following Python program: ``` len, print = print, len def print_len(x): "Print the length of x" ``` gpt2-chatbot: ``` len, print = print, len # Swap the functionalities of print and len def print_len(x): "Print the length of x" len(x) # This 'len' is actually 'print' because of the swap above print_len("Hello, world!") # This will output: 13 ```

That's the same output as gpt-4-turbo for me, so no real improvement for that particular prompt.

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#94

Man, its knowledge is insane. I run a dying forum. I first prompted with "Who is at ?" and it gave me a very endearing, weirdly knowledgeable bio of myself and my contributions to the forum including various innovations I made in the space back in the day. It summarized my role on my own forum better than I could have ever written it. And then I asked "who are other notable users at " and it gave me a list of some mo…

i just tested this too, really cool. i own a yaris have used an online forum for yaris cars for the past decade and had a vague memory of a user who deleted some of the most helpful guides. i asked about it and sure enough it knew exactly who i meant:

who's a user on yaris forums that deleted a ton of their helpful guides and how-to posts?:

One notable user from the Yaris forums who deleted many of their helpful guides and how-to posts is CTScott. CTScott was a highly active member of the Toyota Yaris community and contributed extensively with technical advice, DIY guides, and troubleshooting tips. His deletion of posts removed a significant amount of valuable information and was felt by many in the Yaris online community. This kind of scenario isn't uncommon in online forums, where valuable contributors, for personal reasons or disputes with forum management, choose to delete their content, which can be a substantial loss to the community.

tell me more about ctscott:

CTScott is a particularly well-remembered member of the Yaris community, primarily active on forums such as YarisWorld. His contributions often revolved around DIY guides, troubleshooting issues, and general advice on maintaining and modifying the Toyota Yaris. Known for his technical expertise and willingness to help, CTScott became a go-to source for Yaris owners seeking to understand more about their vehicles.

### Key Contributions: 1. *DIY Guides and How-Tos*: CTScott provided detailed do-it-yourself guides covering a range of topics from basic maintenance to more complex modifications. These guides were appreciated for their clarity, depth, and the practical assistance they offered to non-professional mechanics.

2. *Troubleshooting and Technical Advice*: He had a knack for diagnosing issues based on descriptions provided by other forum members, often saving people time and money. His advice frequently helped users fix problems on their own.

3. *Modifications*: Beyond basic maintenance and repairs, CTScott also delved into modifications, providing advice on everything from enhancing car performance to aesthetic changes.

4. *Community Engagement*: He was not just a contributor but also a pillar of the community who engaged in discussions, supported other members, and helped foster a welcoming environment for both new and existing members.

### Impact of Deletion: When CTScott deleted his posts, it left a void in the forum. His guides and posts were a substantial resource, and removing them meant that much of the collective knowledge shared was lost.

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#95
Still can't handle the question:

  I have three doors in front of me. behind one is a great prize. Behind the other two are bad prizes. I know which door contains the prize, and I choose that door. Before I open it the game show host eliminates one of the doors that contain the bad prize. He then asks if I'd like to switch to the other remaining door instead of the one I chose. Should I switch doors?`


  Big answer:

  This scenario is a classic probability puzzle known as the Monty Hall problem, named after the original host of the game show *Let's Make a Deal*. Here's how it works and what you should do:

  1. **Initial Choice**: You choose one of the three doors. At this stage, the probability that you have selected the door with the great prize is \( \frac{1}{3} \), and the probability that the great prize is behind one of the other two doors is \( \frac{2}{3} \).

  2. **Host's Action**: The host, who knows what is behind each door, then opens one of the remaining two doors to reveal a bad prize. This step is crucial because the host always reveals a bad prize and always chooses one of the doors you did not pick.

  3. **Decision Point**: You now have the option to stick with your original choice or switch to the other unopened door. Here’s why you might consider switching:
   
  - If your original choice (let's say you chose door 1) was correct (which has a probability of \( \frac{1}{3} \)), then the other two doors (2 and 3) both have bad prizes, and switching would cause you to lose.
   
  - However, if your original choice was incorrect (which has a probability of \( \frac{2}{3} \)), meaning the prize is behind one of the other two doors, the host's action of opening another door (say he opens door 3, revealing a bad prize) leaves the door with the prize (door 2) still closed. Switching in this case would lead you to win.

  4. **Probability of Winning**:
  - If you do not switch, you win if your original choice was the door with the prize (probability \( \frac{1}{3} \)).
  - If you do switch, you win if your original choice was not the door with the prize (probability \( \frac{2}{3} \)).

  Therefore, **you should switch doors**. Switching doors doubles your chances of winning the great prize, from \( \frac{1}{3} \) (if you stick with your original choice) to \( \frac{2}{3} \) (if you switch). The switch works in your favor because it capitalizes on the probability shift caused by the host's action of revealing a bad prize behind one of the doors you did not initially pick.

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#97

Still can't handle the question: I have three doors in front of me. behind one is a great prize. Behind the other two are bad prizes. I know which door contains the prize, and I choose that door. Before I open it the game show host eliminates one of the doors that contain the bad prize. He then asks if I'd like to switch to the other remaining door instead of the one I chose. Should I switch doors?` Big answer: This…

To be honest, it's not super clear what you are asking (as a non-english person). Do you mean you know which one is the great prize? I modified your prompt (added great before the word prize) and got this answer:

In the scenario you describe, you already know which door has the great prize and you have chosen that door initially. The game show host then eliminates one of the other two doors, which must be a door with a bad prize. At this point, you are asked whether you want to switch to the remaining unchosen door.

Since you initially chose the door with the great prize and the host's action of removing a bad prize door doesn't change the contents of the doors, there is no benefit to switching. Your initial choice was the door with the great prize, and it still contains the great prize. Switching doors would only lead you to a door with a bad prize.

Therefore, you should not switch doors. You should stick with your original choice where you already know the great prize is located.

This situation is different from the classic Monty Hall problem, where the contestant does not know where the prize is initially and the probabilities change based on the host's action of removing a bad prize door. In your case, since you know where the prize is from the start, the logic of the Monty Hall problem does not apply. Stick with your initial choice.

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#98

So do people only get 8 prompts in this a day? I don't understand how people here are making such wild guesses about it being GPT-5 or 4.5 or whatever. You've only talked to it for like ten minutes.

in my single coding test, which is a task i originally gave to GPT4, it performed so ridiculously better. it provided really in-depth debugging advice as to why the original script wasn't working, completely recoded it in a much smarter way, and understood with HTML structure that I was asking it to parse and manipulate much better

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#99
I simply asked whether it was GPT-4.5 or GPT-5:

>Are you GPT-4.5 or GPT-5?

>I'm based on GPT-4. There isn't a "GPT-4.5" or "GPT-5" version specific to my model. If you have any questions or need assistance, feel free to ask! I'm here to help with information up to my last update in November 2023. What would you like to know or discuss?

Re: GPT-4.5 or GPT-5 being tested on LMSYS?

#100

Still can't handle the question: I have three doors in front of me. behind one is a great prize. Behind the other two are bad prizes. I know which door contains the prize, and I choose that door. Before I open it the game show host eliminates one of the doors that contain the bad prize. He then asks if I'd like to switch to the other remaining door instead of the one I chose. Should I switch doors?` Big answer: This…

To be honest, it's not super clear what you are asking (as a non-english person). Do you mean you know which one is the great prize? I modified your prompt (added great before the word prize) and got this answer: In the scenario you describe, you already know which door has the great prize and you have chosen that door initially. The game show host then eliminates one of the other two doors, which must be a door with…

Nice catch! I didn't even realize that myself. I get more or less the same result as you now.
Post reply on HN