Live data from Hacker News

Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

phind.com

131–140 of 358 posts

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#131
"I have a table called `onboardings` with the state field. I want to return how many people we have in each state. The Postgres query should return the state, how many people count, and what percentage do those people represent."

Claude-2, correct response and rounds the percentage - makes a nice assumption for me.:

    SELECT state, 
           count(*) AS people_count,  
           round(100.0 * count(*) / (SELECT count(*) FROM onboardings), 2) AS percent
    FROM onboardings 
    GROUP BY state
    ORDER BY people_count DESC;
Phind, correct response as well! Really fast too!:

    WITH state_counts AS (
     SELECT state, COUNT(*) as count
     FROM onboardings
     GROUP BY state
    ),
    total_counts AS (
     SELECT COUNT(*) as total
     FROM onboardings
    )
    SELECT sc.state, sc.count, (sc.count::decimal / tc.total::decimal) * 100 as percentage
    FROM state_counts sc, total_counts tc
    ORDER BY sc.count DESC;

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#132
post #20

Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing model than GPT-4. If you're planning on keeping pace with competitive models we'd love to integrate the use of your model into our service.

If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.

If you offer an API then you can be used with tools like https://aider.chat/, which is the best way to use LLMs for coding. But if only available via the web it's not possible. BTW this is the main reason I pay for the OpenAI API.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#133

I just spent a few minutes doing a comparison between Phind and GPT-4 for a very high-level question on a distributed job queue. I gave them both the same fairly vague sketch of a kind of system I would like to build. Here are my impressions: In the positives of Phind: * Phind was able, even eager, to recommend specific libraries relevant to the implementation. The recommendations matched my own research. GPT-4 takes…

> * Phind provides copious relevant sources including github, stackoverflow and others. This is a major advantage, especially if you use these AI assistants as a jumping off ground for further research.

Did you find them to be correct?

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#136

I just spent a few minutes doing a comparison between Phind and GPT-4 for a very high-level question on a distributed job queue. I gave them both the same fairly vague sketch of a kind of system I would like to build. Here are my impressions: In the positives of Phind: * Phind was able, even eager, to recommend specific libraries relevant to the implementation. The recommendations matched my own research. GPT-4 takes…

mind providing some of the prompts you use to question them?

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#138
It failed for me at a much more basic level.

I asked 5 different, and increasing explicit, variations of the following question: "Can you generate HTML and CSS for a JPG mockup I'm going to give you?"

Each time it answered along the following lines: "Sure, here is how you can create HTML and CSS from a JPG mockup. Follow this process..."

In my experience this never happens with GPT-4.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#139
"Python script to extract a list of all Elastic IP's from all regions, from multiple AWS accounts."

ChatGPT4 gave me a solid answer hitting all the points I wanted. Phind din't get the account handling correct, didn't address regions, and didn't handle pagination.

"Write a python based script that uses boto3 to query AWS Route53. It should print a list of every record for a given hosted zone ID."

ChatGPT4 did exactly as requested with pagination, and even smartly decided to use "input" so I could give it a zone ID at run time. Phind didn't handle pagination, or do ANY error handling. It was also slower than ChatGPT4 to generate currently, and it wasn't in a single block of copy/pasteable code.

ChatGPT's solution worked without modification. Copy-Paste. Run.

Re: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context

#140

I just spent a few minutes doing a comparison between Phind and GPT-4 for a very high-level question on a distributed job queue. I gave them both the same fairly vague sketch of a kind of system I would like to build. Here are my impressions: In the positives of Phind: * Phind was able, even eager, to recommend specific libraries relevant to the implementation. The recommendations matched my own research. GPT-4 takes…

> * Phind provides copious relevant sources including github, stackoverflow and others. This is a major advantage, especially if you use these AI assistants as a jumping off ground for further research. Did you find them to be correct?

I don't use Phind for coding, except occasionally, but I like it best for generalised tech search because each para has a reference and there's a list of references down the side -- often the references would really be sufficient for me on their own.

I've had one glaring error, I can't quite remember the details, but it switched the names/characteristics of two different processes (ie was exactly opposite in what it said); it was something to do with instruction caching and TLB, IIRC. I assumed you'd was a problem with the input corpus not allowing antonyms to be disambiguated.

Anyway, for me it's the best of the LLM tools I have access to and had mostly replaced search engine (Google, Dukgo) for my tech-related work.

I've only used chat.openai.com (free), bing chat, HuggingChat.

Post reply on HN