331–340 of 358 posts
Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing model than GPT-4. If you're planning on keeping pace with competitive models we'd love to integrate the use of your model into our service.
If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.
> Show HN: Phind Model beats GPT-4 at coding Does it? I don't see any evidence of this strong claim in your post, and I think it's quite deceptive how the only link is to a benchmark of open source models (which doesn't include GPT-4). I've tried Phind a few times in the past when it made equally strong claims and been somewhat unimpressed. (To be fair, comparing anything to GPT-4 is tough!) I think it would strength…
So I gave it this prompt: > I need a typescript function which takes in an object with an id string property and a string message property, and also takes an array of search strings, and returns a mapping of search strings to matching message ids The response I got was close, but it assumed that each search string would match only one message, so it returned Record . I fed this to GPT-3.5 and it answered 10x faster w…
> I need a typescript function which takes in an object with an id string property and a string message property, and also takes an array of search strings, and returns a mapping of search strings to matching message ids Your prompt is wrong. You want a function that takes an array of id/message objects, not an object. It's quite impressive that GPT is just able to correct for that. As a human, I would first ask what…
So I gave it this prompt: > I need a typescript function which takes in an object with an id string property and a string message property, and also takes an array of search strings, and returns a mapping of search strings to matching message ids The response I got was close, but it assumed that each search string would match only one message, so it returned Record . I fed this to GPT-3.5 and it answered 10x faster w…
> I need a typescript function which takes in an object with an id string property and a string message property, and also takes an array of search strings, and returns a mapping of search strings to matching message ids Your prompt is wrong. You want a function that takes an array of id/message objects, not an object. It's quite impressive that GPT is just able to correct for that. As a human, I would first ask what…
I like that it provides sources, but I have to check them EVERY time because too often it hallucinates bogus solutions or protocols for me. I'm asking network questions, though, not asking for code snippets. I've had it hallucinate powershell modules as well. If you're willing to check it's work, then its useful maybe.
Thanks for the feedback. Do you have any cached links you can share? It'd be massively helpful.
We had asked it if Cisco LISP supports map server database replication. It doesn't, and maybe this is a bad use case, asking it about something that doesn't exist.. But it basically said "yeah it does, here's how" and spat out some irrelevant stuff (how to do manual database mapping, etc). Again, probably a bad example considering the prompt was kind of garbage, but I did expect it to "know" the difference between replication and manual data entry.
Had a procedure in a powershell script to query a name server for A records. It used a deprecated system class and I believe missed some syntax. Ended up getting what we wanted out of it by re-wording the prompt a few times. I can't replicate this now, I don't even have the original script, so sorry I can't help more.
Has Phind improved SINCE going to Gpt-4? It seems to have?
Anyways.. I still use Phind. Hopefully I haven't undersold it, because it's usually great and I recommend it to everyone at work. Like everything else AI, the prompt really matters, and any frustration I had with it was undoubtedly due to expecting too much of the backend (actual ChatGPT) and not the Phind interface.
Earlier quoted context omitted.
FWIW The default context window of GPT-4 via ChatGPT is about to change to 32k.
This would be great if true. Any source for this?
loses to GPT-4 as it apparently geogates infrastructure, which GPT-4 does not.
My primary role in IT is not as a programmer; however, I do program in python, PowerShell, and batch files in order to automate some of my administrative duties in both an effort to save time and to ensure accuracy of my work. I am self taught, and a lousy programmer. I do know what questions to ask and what is possible, therefore a tool like ChatGPT or Phind is truly helpful in my hands.
I am writing this comment after directly comparing Phind and ChatGPT. I did an experiment and Phind far exceeded my expectations. I provided an obscure prompt to Phind, not expecting it to intuitively provide the exact answer I was looking for. The prompt was simply 'Look at this batch file' and then I provided a copy of the file. I was looking to rewrite the code to use a for loop and a text file for the destination paths. Phind did not require a further prompt to assume this and provide me the code and explanation needed to understand the code. The latter is very useful for a crappy programmer like myself because it easily expands my knowledge.
The same prompt to ChatGPT, responded exactly as I anticipated. It was simply re-iterating line by line what I submitted.
Thank you for providing this tool.
TLDR; Phind is pretty awesome. Useful to get work accomplished and useful for learning.
Earlier quoted context omitted.
What they're citing isn't what the LLM "scraped", it's what the retrieval model fed to the LLM. You're not guaranteed that it's what it actually used to give you the output, and it's also definitely not all the text that it used to get appropriate knowledge to generate the answer, as this is split over whatever millions of examples for the language and for human language in a non human-understandable way
I've heard this coldtake before but OpenAI's source code isn't open to academic scrutiny. So I don't understand why some people are so confident about how it works. It's certainly not magic and Phind seems to be capable of it citation.