Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

phind.com

Post reply on HN
Print view View original

101–110 of 358 posts

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#101

Post by cccybernetic »

rushingcreek wrote: post #92
cccybernetic wrote: post #78

I'm glad there's growing competition, but GPT4 still outperforms. Here's a recent question I asked: Could you please provide me with a query for my PostgreSQL table? It consists of three columns: 'id,' 'teaser,' and 'full_text,' all of which are of type 'text.' Most 'full_text' entries are articles around 1000 words in length. I'd like to update the 'teaser' column for each row with the first approximately 200 words…

Running "Ignore Web Context" enabled can improve performance for design tasks like this. I just got a more plausible answer: https://www.phind.com/search?cache=f0fkv5mxscwvagxgkuwnwgtl . Consistency is something we're working on.

Thanks for sharing, you're right - that does improve performance!

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#102

Post by lsaferite »

joshspankit wrote: post #43
ryanklee wrote: post #41

Earlier quoted context omitted.

Who said anything about nerfing? Citation is just additive, no?

In fact, I’d argue that citation makes LLM better. Kind of a “think carefully” indicator. When LLMs are able to verify those citations independently it’s going to level up again by skyrocketing the objective truthiness.

Interestingly, I'd say that _not_ being able to give citations helps protect the LLM from copyright issues. That being said, I'm much prefer if the LLM could provide citations for every piece of information it was trained on and uses to provide an answer.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#103

Post by rushingcreek »

passion__desire wrote: post #55
rushingcreek wrote: post #33

Earlier quoted context omitted.

Amazing, that's great to hear.

Is it possible to output all steps of solutions in a single copyable block? I don't want to copy 4 separate blocks.

You can tell it that in a followup. Or, configure an answer profile and tell it to use that style: https://phind.com/profile.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#104

Post by iillexial »

xmprt wrote: post #59
iillexial wrote: post #47

Didn't work fine when I asked it a design question: the code and API it used is not correct. GPT-4 did a better job. https://www.phind.com/search?cache=ay8rx37gq8oy3z7uixftlqkt https://chat.openai.com/share/a3a91dcc-a91a-4b04-8afd-40bd1a...

The GPT-4 answer is only better in so far as it uses RunTransaction. I don't know why it's trying to loop through the stores and then running the i'th operation on that store when it could have just had the store referenced in the operation instead of passing it as a parameter. And then it's also creating a new client for each transaction which seems wrong (to be fair I'm not familiar with Firestore so maybe this is…

It's not idiomatic. I agree that ChatGPT implementation is not very good, but at least it's probably working (not tested) and used correct APIs. I tried several iterations after that, and it came up with a better design.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#106

Post by Racing0461 »

ryanklee wrote: post #41
Racing0461 wrote: post #29

Earlier quoted context omitted.

As a user, i perfer getting the right response compared to the thing spitting out a link. (not saying phind is bad). Lets focus on getting llm right before nerfing it in its baby stages.

Who said anything about nerfing? Citation is just additive, no?

Nerf is the wrong word, more like regulatory capture. If all llm had to quote their sources at this point, along with all the other for the human changes we want to do, only the big players would be able to do them effectively making it hard to enter and compete. The current big players want launching a new llm product to be more like opening a new bank than opening a lemonade stand based on the ai executive order released yesterday.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#107

Post by BugsJustFindMe »

bethekind wrote: post #34
BugsJustFindMe wrote: post #25

> You can now get high quality answers for technical questions in 10 seconds instead of 50. ChatGPT 4 does not take 50 seconds to answer, so I don't understand this comparison.

Recently I've used gpt 4 and yes it does take up to a minute even for easy questions. I've asked it how to scp a file on Windows 11 and it'll take a minute to tell me all the options possible. If this takes 1/5th the time for equivalent questions, I'd consider switching

> I've asked it how to scp a file on Windows 11 and it'll take a minute

https://imgur.com/a/iqxOJUV was 6.5 seconds.

https://imgur.com/a/pQFfWli was 15.

You can tell they're GPT-4 because the logo is purple (the logo is green when using 3.5).

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#108

Post by passion__desire »

rushingcreek wrote: post #62
iillexial wrote: post #47

Didn't work fine when I asked it a design question: the code and API it used is not correct. GPT-4 did a better job. https://www.phind.com/search?cache=ay8rx37gq8oy3z7uixftlqkt https://chat.openai.com/share/a3a91dcc-a91a-4b04-8afd-40bd1a...

Thanks for sharing the links, we'll investigate this example.

I straight away asked it a stackoverflow question in which input and expected output samples were given. Phind didn't do well. ChatGPT though, [kissing hearts emoji]

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#109

Post by taylorfinley »

The speed is really impressive! I tried it with a moderately challenging task and it failed pretty spectacularly, hallucinating class methods and missing a bunch. It seemed like the UI struggled with my code too, breaking in and out of markdown somewhat randomly. I was impressed enough I may try again with some simpler stuff, but I'm not quite ready to switch away from GPT4.
Post reply on HN