Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

phind.com

Post reply on HN
Print view View original

171–180 of 358 posts

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#171

Post by ilaksh »

rushingcreek wrote: post #23
tinco wrote: post #20

Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing model than GPT-4. If you're planning on keeping pace with competitive models we'd love to integrate the use of your model into our service.

If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.

Please consider releasing an API. Having a faster alternative to GPT-4 would be amazing for so many use cases.

Especially for agents that do function calling.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#173

Post by drcode »

I am a heavy user of GPT4, and Phind was surprisingly able to match GPT4 on several initial programming tasks I gave it. Given the large context window of Phind, it will likely be able to outperform GPT4 for some tasks.

That is quite an accomplishment, I am impressed

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#174

Post by rushingcreek »

drcode wrote: post #173

I am a heavy user of GPT4, and Phind was surprisingly able to match GPT4 on several initial programming tasks I gave it. Given the large context window of Phind, it will likely be able to outperform GPT4 for some tasks. That is quite an accomplishment, I am impressed

[dead]

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#176

Post by bredren »

rushingcreek wrote: post #156
webappguy wrote: post #154

Earlier quoted context omitted.

Do you have custom instructions? Everyone needs to mention and post prompts else entirely antidotal

We support custom instructions at https://phind.com/profile .

I’m trying to get it to answer only in executable Python. I used the template with instructions I use for my system prompt on gpt4. And I tried using the additional context field for the same.

It gets to writing the expected code but it still wants to include formatted headings instead of commenting those out so the entire response is executable Python.

As a follow up I provided an example heading with the hash out front. It didn’t work.

Any ideas on how to get it to this? Fwiw, gpt4 often if ignores this request, but only about half the time. When it does it is typically a single block of explanatory text.

For that, I include prose detection and commenting as part of my post processing.

Also, I don’t see it easily, but do you have an API for this or is it intended to be run by the user?

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#177

Post by shazar »

rushingcreek wrote: post #118
shazar wrote: post #116

I gave it two tries, GPT-4 was much better in both cases. Tried with two Leetcode questions. It came back with an empty response for one, and provided a worse code (O(n2) solutions when it can be done with linear time) for the other one. GPT-4 on the other hand provided a good answer for both questions. Also I guess the UI is buggy w.r.t code formatting, it things the following line is a code and switches to a code b…

I suggest you try enabling "Ignore search results" from the model dropdown for these types of questions. The web results can be distracting for the model for Leetcode-type questions.

I tried with that option enabled and now it can't generate code at all. Here's my prompt:

``` You are given an array prices where prices[i] is the price of a given stock on the ith day.

Find the maximum profit you can achieve. You may complete at most two transactions.

Note: You may not engage in multiple transactions simultaneously (i.e., you must sell the stock before you buy again).

Write Python code to solve this: def maxProfit(self, prices: List[int]) -> int: ```

Output:

``` It seems like you want to find the maximum profit that can be achieved by buying and selling stocks, with the constraint that you can only make at most two transactions. Is that correct?

Could you please provide some example input and output to help me better understand your requirements? ```

I also tried a more basic prompt, but the output is not what I'd consider good code.

Can you maybe share some examples where we can see how it exceeds GPT-4's capabilities? Thanks!

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#179

Post by quickthrower2 »

Could you open source these great models? OK yes you need a competitive advantage. So maybe open source them when you are say 2 models ahead in production?

In any case I am happy there is some competition and that it has come from a more pragmatic scrappy space than one of the multiple billion dollar funded places.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#180

Post by Capricorn2481 »

rushingcreek wrote: post #93
joaodias wrote: post #88

Asked it to write a program that I've written before, to compare with gpt4. Didn't really get what I was asking for, gpt4 understood it perfectly, and is ready to continue prompting toward completion. https://www.phind.com/agent?cache=cloeowfla000dl1084ermly3c vs https://chat.openai.com/share/4147da33-3669-4657-88fa-3a9dfc... Might not be representative of the whole thing, but it went on about random things I didn't…

The Pair Programmer mode currently either uses GPT-4 or GPT-3.5 (if you've run out). Please try again in the default search mode to use the Phind Model. Using the Phind Model in the default search seems to work well: https://www.phind.com/search?cache=ln6dpdtv5auwn4cq1ofg3gs9

Even though the phind model is selected? Is there a technical reason Phind doesn't do pair programming yet?
Post reply on HN