Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Phind-405B and faster, high quality AI answers for everyone

phind.com

Post reply on HN
Print view View original

51–60 of 163 posts

Re: Phind-405B and faster, high quality AI answers for everyone

#51

Post by trees101 »

jadbox wrote: post #36

"Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet". I'd love to see examples of actual code modifications created by Phind and Sonnet back-to-back. This level of transparency would give me the confidence to try to pro. As it is, I'm skeptical by the claim and actual performance as I've yet to see a finetuned model from Llama3.1 that performed notably better in an area without suffering problems…

Hopefully it gets evaluated on this leaderboard https://aider.chat/docs/leaderboards/

Re: Phind-405B and faster, high quality AI answers for everyone

#52

Post by rushingcreek »

spirodonfl wrote: post #48

I just tried. Asked a question on a research topic I'm digging into. It gave me some answers but no references. Then I copy the answers it gave me and specifically ask for references. Then I got: I sincerely apologize for my earlier response. Upon reviewing the search results provided, I realize I made an error in referencing those specific studies. The search results don't contain any relevant information for the cl…

Sorry about that, could you make sure that "Always search" is enabled and try that first query again? It should be able to get the correct answer with references.

Re: Phind-405B and faster, high quality AI answers for everyone

#54

Post by jadbox »

NelsonMinar wrote: post #13

Phind continues to be my favorite AI-enhanced search engine. They do a really nice job giving answers to technical questions with links to references where I can verify the answer or learn more detail. Some recent examples from my history: what video formats does mastodon support? https://www.phind.com/search?cache=jpa8gv7lv54orvpu2c7j1b5j compare xfs and ext4fs https://www.phind.com/search?cache=h9rmhe6ddav1bnb2odtc…

In my tests, it does hallucinate answers, even with Phind 70B. For example, I asked for bluetooth earplugs that have easy battery replacements. It always kept giving me answers for earplugs with I know have their battery soldered into the casing. Tbf, perplexity also fails at this question.

Re: Phind-405B and faster, high quality AI answers for everyone

#55

Post by spirodonfl »

rushingcreek wrote: post #52
spirodonfl wrote: post #48

I just tried. Asked a question on a research topic I'm digging into. It gave me some answers but no references. Then I copy the answers it gave me and specifically ask for references. Then I got: I sincerely apologize for my earlier response. Upon reviewing the search results provided, I realize I made an error in referencing those specific studies. The search results don't contain any relevant information for the cl…

Sorry about that, could you make sure that "Always search" is enabled and try that first query again? It should be able to get the correct answer with references.

It was on. If I ask the same question again it now gets the right answer. Maybe a blip? Not sure.

To be fair, I don't expect these AI models to give me perfect answers every time. I'm just not sure people are vigilant enough to ask follow up questions that criticize how the AI got the answers to ensure the answers come from somewhere reasonable.

Re: Phind-405B and faster, high quality AI answers for everyone

#57

Post by CamperBob2 »

minkles wrote: post #50

I asked it a question and it answered authoritatively. > The impedance of a 22 μH capacitor at 400 THz is approximately 1.80 × 10^-24 Ω. The correct answer should have been “what the hell are you talking about dumbass?”. Capacitors are not measured in henries and the question really has no meaning at 400THz. Another stochastic parrot.

At 400 THz any real-world capacitor will look inductive. :-P

Although it's not gonna look like 22 uH.

Re: Phind-405B and faster, high quality AI answers for everyone

#58

Post by nicce »

dsp_person wrote: post #17

Hmm this versus Kagi Assistant? Plan page says $20/mo Unlimited powerful Phind-405B and Phind-70B searches; Daily GPT-4o (500+) , Claude 3.5 Sonnet (500+), Claude Opus (10) uses > Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet. Any other benchmarks?

I payed and used 6 months for Phind. I am more satisfied with the Kagi Assistant currently. It does not give that many links but overall results are as good or even better, and you can use lenses. You get general search engine too.

There was one UI related annoyance with Phind; scroll bar sometimes jumped randomly, maybe even after each input or during token generation (on Firefox). You start wasting a lot of time if you always need to find again the part you were looking. Or even just scrolling back to bottom.

Primary issue is still that both hallucinate too much when you ask something difficult. But that is the general problem everywhere.

Re: Phind-405B and faster, high quality AI answers for everyone

#59

Post by rushingcreek »

nicce wrote: post #58
dsp_person wrote: post #17

Hmm this versus Kagi Assistant? Plan page says $20/mo Unlimited powerful Phind-405B and Phind-70B searches; Daily GPT-4o (500+) , Claude 3.5 Sonnet (500+), Claude Opus (10) uses > Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet. Any other benchmarks?

I payed and used 6 months for Phind. I am more satisfied with the Kagi Assistant currently. It does not give that many links but overall results are as good or even better, and you can use lenses. You get general search engine too. There was one UI related annoyance with Phind; scroll bar sometimes jumped randomly, maybe even after each input or during token generation (on Firefox). You start wasting a lot of time if…

Thanks for the feedback. We've fixed the UI jumping issue. The new Phind update today should also work as a general search engine.

Re: Phind-405B and faster, high quality AI answers for everyone

#60

Post by freehorse »

rushingcreek wrote: post #21
freehorse wrote: post #20

Earlier quoted context omitted.

> Hmm this versus Kagi Assistant? It has a vscode extension. So if you use that, it makes some sense. Purely for search, I dont know. Ime phind is not that great with internet access, sometimes people disable the search function to get better answers.

Have you tried the new internet answers that are a part of this update?

Not really, as I do not have subscription anymore. Is it better compared to no-internet-access?
Post reply on HN