Live data from Hacker News

Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

phind.com

91–100 of 358 posts

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#92

I'm glad there's growing competition, but GPT4 still outperforms. Here's a recent question I asked: Could you please provide me with a query for my PostgreSQL table? It consists of three columns: 'id,' 'teaser,' and 'full_text,' all of which are of type 'text.' Most 'full_text' entries are articles around 1000 words in length. I'd like to update the 'teaser' column for each row with the first approximately 200 words…

Running "Ignore Web Context" enabled can improve performance for design tasks like this. I just got a more plausible answer: https://www.phind.com/search?cache=f0fkv5mxscwvagxgkuwnwgtl. Consistency is something we're working on.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#93

Asked it to write a program that I've written before, to compare with gpt4. Didn't really get what I was asking for, gpt4 understood it perfectly, and is ready to continue prompting toward completion. https://www.phind.com/agent?cache=cloeowfla000dl1084ermly3c vs https://chat.openai.com/share/4147da33-3669-4657-88fa-3a9dfc... Might not be representative of the whole thing, but it went on about random things I didn't…

The Pair Programmer mode currently either uses GPT-4 or GPT-3.5 (if you've run out). Please try again in the default search mode to use the Phind Model.

Using the Phind Model in the default search seems to work well: https://www.phind.com/search?cache=ln6dpdtv5auwn4cq1ofg3gs9

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#94
post #57

I know it isn't popular, but I wish there was a way to use this inside Emacs. Or, vim. I just don't want to use VS Code anymore.

The standardizing on VS code is one of the saddest developments over the last several years IMHO. I think it's great that VS Code exists, but we're headed for a world where you have to use VS Code if you want the best tooling because it won't support other options. The same thing happened with Java dev and IntelliJ, and IMHO it has been extremely unhealthy for the ecosystem. I'm immensely glad that Copilot supports v…

Same could have/could be said about Jetbrains products. People are likely always going to use vim/emacs and create tooling around whatever new hotness exists for them. And honestly? VS Code is just a new iteration on how vim/emacs work in a lot of ways: Providing a place to edit text and then a bunch of plugins that do things with that text.

And if you want vim/emacs to keep living, then you should spend time helping! Create your own extensions, maintain/contribute to existing ones, etc. They will only die out when the last person actively contributing to them stops, so keep the chain of people going :)

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#95
post #90

Earlier quoted context omitted.

One example is not enough for performance conclusions

There is a performance conclusion in the title though.

That conclusion is based on benchmark with many examples in different tasks.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#96

Asked it to write a program that I've written before, to compare with gpt4. Didn't really get what I was asking for, gpt4 understood it perfectly, and is ready to continue prompting toward completion. https://www.phind.com/agent?cache=cloeowfla000dl1084ermly3c vs https://chat.openai.com/share/4147da33-3669-4657-88fa-3a9dfc... Might not be representative of the whole thing, but it went on about random things I didn't…

The problem is that it’s doing a search of your relatively niche problem, and probably getting pretty poor results. The text from the search is then more highly weighted than the base model, but with relative junk, so it performs better without the additional (unhelpful) context.

You see this with Bing search on ChatGPT as well, and I’ve seen it in my own projects.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#97
post #57

I know it isn't popular, but I wish there was a way to use this inside Emacs. Or, vim. I just don't want to use VS Code anymore.

In Vim, I tried to assign a shortcut to send the selected text to Phind (or any other LLM) and came up with this:

:'y|call system('firefox ?q='.shellescape(@*).' &')

The only problem left is that the text is not urlencoded.

There probably is some elegant way to urlencode it. But I did not come up with one yet.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#99

I'm glad there's growing competition, but GPT4 still outperforms. Here's a recent question I asked: Could you please provide me with a query for my PostgreSQL table? It consists of three columns: 'id,' 'teaser,' and 'full_text,' all of which are of type 'text.' Most 'full_text' entries are articles around 1000 words in length. I'd like to update the 'teaser' column for each row with the first approximately 200 words…

One example is not enough for performance conclusions

Obviously not. Perfectly reasonable to share anecdotes though.

Also, I ran a few different tests, and every GPT-4 response was superior, but I didn't want to clutter my comment with queries and code.

Post reply on HN