Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Phind-405B and faster, high quality AI answers for everyone

phind.com

Post reply on HN
Print view View original

71–80 of 163 posts

Re: Phind-405B and faster, high quality AI answers for everyone

#71

Post by loktarogar »

josvdwest wrote: post #68

"A key issue with AI-powered search is that it is just too slow compared to classic Google. Even if it generates a better answer, the added latency is discouraging." Is this true? I feel like most complaints I have and hear about is how inaccurate some of the AI results are. I.e. the mistakes it confidently makes when helping you code.

I think they're both key issues - when the results are accurate, they're too slow; and you can't trust the results when you get there because they're often inaccurate

Re: Phind-405B and faster, high quality AI answers for everyone

#72

Post by rainbowjelly »

zx8080 wrote: post #70
rainbowjelly wrote: post #67

I get a blank page with the text "Service is unavailable in this region." Any reason why Phind is region-locked? Is there a list of what countries Phind is available in?

Interesting. I'm not working for phind, but can you share which region are you trying to access it from?

I tried to access it from Malaysia. VPN works but I’d rather not.

Re: Phind-405B and faster, high quality AI answers for everyone

#73

Post by Terretta »

josvdwest wrote: post #68

"A key issue with AI-powered search is that it is just too slow compared to classic Google. Even if it generates a better answer, the added latency is discouraging." Is this true? I feel like most complaints I have and hear about is how inaccurate some of the AI results are. I.e. the mistakes it confidently makes when helping you code.

From hitting enter to seeing something, ofc it's slower.

From hitting enter to a set of relevant answers loaded into your brain, though? Isn't that the goal that should be measured? Against that goal, the two decade old approach seems to have peaked over a decade ago, or phind wouldn't find traction.

For the 20 year old page rankers, time from search to a set of correct answers in your brain is approaching “DNF” -- did not finish.

---

PS. Hallucinations or irrelevant results, both require exercising a brain cell. On a percentage basis, there are fewer hallucinations than irrelevant results, it's just that we gave up on SERP confidence ages ago.

Re: Phind-405B and faster, high quality AI answers for everyone

#75

Post by rushingcreek »

rawrawrawrr wrote: post #74

Title says "for everyone", but post says "Phind-405B is available now for all Phind Pro users". I guess everyone on earth has paid for Phind :)

The "for everyone" part is about the new Phind Instant, trained using similar data to Phind-405B, which is great at fast information retrieval

Re: Phind-405B and faster, high quality AI answers for everyone

#78

Post by swyx »

TaylorAlexander wrote: post #11
sgc wrote: post #7

Earlier quoted context omitted.

I use it, with the phind models, instead of chatGPT. I had to change my user agent to Chrome since too many sites would refuse to work with FF otherwise, and now chatGPT is stuck in an endless captcha loop whenever I go there. I am just a casual user, to help write a quick script or to get some bit of relevant info. It works just as well or better for my use case, and of course having actual citations with links is w…

My friend has the endless captcha loop on ChatGPT too. Does anyone know how to fix it?

change browser, change location. should fix.

Re: Phind-405B and faster, high quality AI answers for everyone

#79

Post by swyx »

rushingcreek wrote: post #30
BikeShuester wrote: post #29

I'd suggest offering at least one free query to allow users to evaluate the service.

Our fast model, Phind Instant, is completely free

> The model, based on Meta Llama 3.1 8B, runs on a Phind-customized NVIDIA TensorRT-LLM inference server that offers extremely fast speeds on H100 GPUs. We start by running the model in FP8, and also enable flash decoding and fused CUDA kernels for MLP.

as far as i know you are running your own GPUs - what do you do in overload? have a queue system? what do you do in underload? just eat the costs? is there a "serverless" system here that makes sense/is anyone working on one?

Re: Phind-405B and faster, high quality AI answers for everyone

#80

Post by wokwokwok »

spirodonfl wrote: post #61
spirodonfl wrote: post #48

I just tried. Asked a question on a research topic I'm digging into. It gave me some answers but no references. Then I copy the answers it gave me and specifically ask for references. Then I got: I sincerely apologize for my earlier response. Upon reviewing the search results provided, I realize I made an error in referencing those specific studies. The search results don't contain any relevant information for the cl…

Just to follow up on this: I asked it to give me a brief explanation on how to use laravel 11 blade fragments, which it did reasonably well. I then offered 3 lines of code of a route I'm using in Laravel and I asked to tell me how to implement fragment usage where the parameter in the url determines the fragment returned. Route::get('/vge-frags/{fragment}', function ($fragment) { return view('vge-fragments'); }); It…

Seems a little bit of an unfair generalisation.

I mean, this is an unsolvable problem with chat interfaces, right?

If you use a plugin that is integrated with tooling that check generated code compiles / passes tests / whatever a lot of this kind of problem goes away.

Generally speaking these models are great at tiny self contained code fragments like what you posted.

It’s longer, more complex, logically difficult things with interconnected parts that they struggle with; mostly because the harder the task, the more constraints have to be simultaneously satisfied; and models don’t have the attention to fix things simultaneously, so it’s just endless fix one thing / break something else.

So… at least in my experience, yes, but honestly, for a trivial fragment like that most of the time is fine, especially for anything you can easily write a test for.

Post reply on HN