91–96 of 96 posts
this leaderboard seems easily cheated/gamed. once enough eyes are on it it will be worthless
How would you game it? I think it is clearly the least gameable leaderboard we have. A more valid criticism might be that you don't like the metric it's measuring, but I think it is a useful metric, though certainly not the only useful metric.
Earlier quoted context omitted.
Bard is free, while GPT-4 is not, so it doesn’t seem like a totally fair comparison. Also what a wild comparison, because afaik chat gpt can’t make charts either.
> Bard is free, while GPT-4 is not, so it doesn’t seem like a totally fair comparison. Wait so if Google suddenly started charging for Bard, it would be instantly better?
Bard is far less moderated than GPT-4 eg far fewer requests feel restricted. That alone makes it far better than GPT-4.
By moderation you mean safety filters?
Moderation means no sex, hate, illegal things and religion. I tried to talk about Allah being merciful and got my ass moderated away. I am Buddhist and when I talked about reincarnation being misunderstood that was fine. So the limits are not clear.
Wow. I've suspected for a while that Bard's performance has been limited mostly by cost. Google isn't charging for Bard and they didn't want to run a gigantic model for everyone for free forever. Maybe they made a breakthrough in inference cost for their better models? Or maybe they got tired of everyone clowning on them for being behind and decided to eat the cost for a while. I still think they ought to launch a su…
The trick is to access the "bard-jan-24-gemini-pro" model, available in direct chat mode here: https://chat.lmsys.org/ . Significantly better than the prior model.
Earlier quoted context omitted.
Q: Please write me a function that makes a couple of text edits and a button. A: Certainly! Here is a function that makes a couple of text edits and a button. function renderForm() { var edit = document.createElement('input'); // The rest of the code is similar. }
I don't get what's lazy about this. Is it because it's not appending the elements?
I had a colleague complain to me the other day that he'd asked GPT to help him with a trivial reformatting task and it had said something like "I can't do that but I can guide you on how to do it".
Earlier quoted context omitted.
I don't get what's lazy about this. Is it because it's not appending the elements?
The code snippet is literal - the model will actually write out a comment with something like "// TODO: Implement the rest" instead of actually doing it. I had a colleague complain to me the other day that he'd asked GPT to help him with a trivial reformatting task and it had said something like "I can't do that but I can guide you on how to do it".
agreed. that's pretty "lazy"