Live data from Hacker News

Phind-405B and faster, high quality AI answers for everyone

phind.com

41–50 of 163 posts

Re: Phind-405B and faster, high quality AI answers for everyone

#42
post #41

Does an API not make economic sense for you? Personally I would rather use my own tooling (not VSCode based).

So far an API has been less of a priority than focusing on the user-facing product. But it seems there's a reasonable amount of demand for it, which we'll consider.

Re: Phind-405B and faster, high quality AI answers for everyone

#43
post #24

Are the weights available since it's based on Meta Llama 3.1 405B?

Serious question: does the Meta LLama ToS / EULA even allow fine-tuned models based on Llama to be used for commercial purposes without making the weights available?

I believe it does unless you're another tech giant with billions of users / revenue.

Re: Phind-405B and faster, high quality AI answers for everyone

#44
post #36

"Phind-405B scores 92% on HumanEval (0-shot), matching Claude 3.5 Sonnet". I'd love to see examples of actual code modifications created by Phind and Sonnet back-to-back. This level of transparency would give me the confidence to try to pro. As it is, I'm skeptical by the claim and actual performance as I've yet to see a finetuned model from Llama3.1 that performed notably better in an area without suffering problems…

I’ve been a customer of Phind for a number of months now, so I’m familiar with the capabilities of all the models they offer.

I found even Phind-70B to often be preferable to Claude Sonnet and would commonly opt for it. I’ve been using the 405B today and it seems to be even better at answering.

I’ve found it does depend on the task. For instance, for formatting JSON in the past, GPT-4 was actually the best.

Because you can cycle through the models, you can check the output of each one, to get the best answer.

Re: Phind-405B and faster, high quality AI answers for everyone

#45
post #41

Does an API not make economic sense for you? Personally I would rather use my own tooling (not VSCode based).

So far an API has been less of a priority than focusing on the user-facing product. But it seems there's a reasonable amount of demand for it, which we'll consider.

I consider AIs without API access even as non existent. Not everybody wants a web interface and waste time on copy&paste all the time. APIs can hook the filesystem directly with an AI, make complicated prompt engineering and multi file changes a non-issue. And they should also help you to make more money (don't undersell the API access and you're fine). Without an API the community can also not compare Phind-405B to other models easily.

Would be great to have access to your model in a LLM gateway like https://openrouter.ai/

I would give your API a try as minimum.

Re: Phind-405B and faster, high quality AI answers for everyone

#47

Phind continues to be my favorite AI-enhanced search engine. They do a really nice job giving answers to technical questions with links to references where I can verify the answer or learn more detail. Some recent examples from my history: what video formats does mastodon support? https://www.phind.com/search?cache=jpa8gv7lv54orvpu2c7j1b5j compare xfs and ext4fs https://www.phind.com/search?cache=h9rmhe6ddav1bnb2odtc…

I see references here but when I ask questions, I get answer but no citations, and I am logged in. This used to be an issue but was fixed but still an issue for me. If I logout and ask I get reference but the answers are using instant model.

Re: Phind-405B and faster, high quality AI answers for everyone

#48
I just tried. Asked a question on a research topic I'm digging into. It gave me some answers but no references. Then I copy the answers it gave me and specifically ask for references. Then I got:

I sincerely apologize for my earlier response. Upon reviewing the search results provided, I realize I made an error in referencing those specific studies. The search results don't contain any relevant information for the claims I mentioned earlier. As an AI assistant, I should be more careful in providing accurate and supported information. Thank you for bringing this to my attention. In this case, I don't have reliable references to support those particular statements about software tools and their impact on developer experience and software quality.

Not sure about this...

Re: Phind-405B and faster, high quality AI answers for everyone

#50
I asked it a question and it answered authoritatively.

> The impedance of a 22 μH capacitor at 400 THz is approximately 1.80 × 10^-24 Ω.

The correct answer should have been “what the hell are you talking about dumbass?”. Capacitors are not measured in henries and the question really has no meaning at 400THz. Another stochastic parrot.

Post reply on HN