Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

phind.com

Post reply on HN
Print view View original

181–190 of 358 posts

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#181

Post by amelius »

riku_iki wrote: post #87
cccybernetic wrote: post #78

I'm glad there's growing competition, but GPT4 still outperforms. Here's a recent question I asked: Could you please provide me with a query for my PostgreSQL table? It consists of three columns: 'id,' 'teaser,' and 'full_text,' all of which are of type 'text.' Most 'full_text' entries are articles around 1000 words in length. I'd like to update the 'teaser' column for each row with the first approximately 200 words…

One example is not enough for performance conclusions

Depends on the claims made.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#182

Post by zoogeny »

fthd wrote: post #136
zoogeny wrote: post #112

I just spent a few minutes doing a comparison between Phind and GPT-4 for a very high-level question on a distributed job queue. I gave them both the same fairly vague sketch of a kind of system I would like to build. Here are my impressions: In the positives of Phind: * Phind was able, even eager, to recommend specific libraries relevant to the implementation. The recommendations matched my own research. GPT-4 takes…

mind providing some of the prompts you use to question them?

Here are the conversation logs:

https://chat.openai.com/share/867ff0c4-d4cf-4af9-a785-31a599...

https://www.phind.com/search?cache=ej8pn1dfjjwfr1tgc6ybwhlg

NOTE: there are a few more question/answer blocks in the phind conversation since I was testing out the follow up question feature.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#183

Post by sounds »

quickthrower2 wrote: post #179

Could you open source these great models? OK yes you need a competitive advantage. So maybe open source them when you are say 2 models ahead in production? In any case I am happy there is some competition and that it has come from a more pragmatic scrappy space than one of the multiple billion dollar funded places.

Can we have a larger discussion about the tradeoffs that come with open sourcing a model?

When fb released Llama they obviously gained a huge amount of developer goodwill but it also required them to invest a serious amount of their own developer time to engage with the community.

I'm asking the community what it can offer the company? Or is this just self-abnegation by the company that releases the model?

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#184

Post by rushingcreek »

Capricorn2481 wrote: post #180
rushingcreek wrote: post #93

Earlier quoted context omitted.

The Pair Programmer mode currently either uses GPT-4 or GPT-3.5 (if you've run out). Please try again in the default search mode to use the Phind Model. Using the Phind Model in the default search seems to work well: https://www.phind.com/search?cache=ln6dpdtv5auwn4cq1ofg3gs9

Even though the phind model is selected? Is there a technical reason Phind doesn't do pair programming yet?

It's because we haven't updated the Phind Model to support function calling yet but we're working on it.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#185

Post by papichulo2023 »

freedomben wrote: post #77
xrd wrote: post #57

I know it isn't popular, but I wish there was a way to use this inside Emacs. Or, vim. I just don't want to use VS Code anymore.

The standardizing on VS code is one of the saddest developments over the last several years IMHO. I think it's great that VS Code exists, but we're headed for a world where you have to use VS Code if you want the best tooling because it won't support other options. The same thing happened with Java dev and IntelliJ, and IMHO it has been extremely unhealthy for the ecosystem. I'm immensely glad that Copilot supports v…

Didnt vscode standardise language servers making much easier for all the rest text-editor-close-almost-ides to integrate? Is it really that sad?

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#187

Post by buildbot »

mensetmanusman wrote: post #82
buildbot wrote: post #69

Well, neither GPT4 or this Phind model where able to answer my torture test: "Write amaranth code that can be used to control the readout of a frame from a kodak CCD with 4096 columns and 2048 rows." Which yes, is missing a lot of detail (you could/I have feed/fed in a datasheet). But Phind goes off on using pyserial (?!), and GPT4 assumes amaranth is a hypothetical CCD control library and makes a useless class contr…

That’s torture for humans as well. The key to LLMs is communicating clearly to the information cloud.

Sure, but a good example of how far certain domains have to go still. These datasheets should be in the models training data, at least one CCD datasheet, and verilog & (migen | nmigen | amaranth) certainly are.

Controlling a CCD is actually pretty easy, I built (very simple, but working) controllers for several CCD chips in undergrad doing research for the ATLAS detector. You just clock a rows out basically, N columns times. Reset first. I'd expect an senior undergrad EE student to be able to design a simple core in a few class projects.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#188

Post by rushingcreek »

shazar wrote: post #177
rushingcreek wrote: post #118

Earlier quoted context omitted.

I suggest you try enabling "Ignore search results" from the model dropdown for these types of questions. The web results can be distracting for the model for Leetcode-type questions.

I tried with that option enabled and now it can't generate code at all. Here's my prompt: ``` You are given an array prices where prices[i] is the price of a given stock on the ith day. Find the maximum profit you can achieve. You may complete at most two transactions. Note: You may not engage in multiple transactions simultaneously (i.e., you must sell the stock before you buy again). Write Python code to solve this…

Seemed to work well just now: https://www.phind.com/search?cache=w1jyatqyia1a8r3pfxlxqby6

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#189

Post by scarface_74 »

I was just discussing using ChatGPT to make working with deploying serverless code easier.

I gave this as an example

“create a CDK typescript app that deploys a lambda + API Gateway where the lambda works with Get request and a dynamodb table. The lambda should have permission to read and write to the Table”

It wrote the code perfectly. I wanted to see if it was trained on the AWS APIs.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#190

Post by Capricorn2481 »

rushingcreek wrote: post #184
Capricorn2481 wrote: post #180

Earlier quoted context omitted.

Even though the phind model is selected? Is there a technical reason Phind doesn't do pair programming yet?

It's because we haven't updated the Phind Model to support function calling yet but we're working on it.

Can you share what your long term monetization model is? I'm noticing Phind is free to use right now.
Post reply on HN