How do you manage "hallucinations?" One of the things I've noticed about using ChatGPT for programming tasks is that it will happily give you garbage.
Launch HN: Bloop (YC S21) – Code Search with GPT-4
121–130 of 131 posts
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#122Earlier quoted context omitted.
That would be akin to giving each of the 'plugins' your GPT API key and pay the usage bill directly to OpenAI. The plugin developers would still want $$$ for the app even if the GPT usage was excluded though.
Wouldn't it be a one-time purchase then? "Buy my prompt for $10 that enables you to search your codebase" And we're back to Prompt Engineers :)
I think an IDE plugin or standalone app takes slightly more work than writing a prompt, but sure
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#123I don’t understand these new saas that rely on GPT. It surely is my lack of understanding, but since the interface to GPT is mainly text: why any company would pay for N different GPT saas (e.g., one for searching for code, another for searching for documentation on confluence, another for allowing your business analysts with their queries, etc.)? Wouldn’t it make more sense for any company to have only ONE interface…
[deleted]
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#124Ok, I'll be the bad guy and say that the linked demo on loom is just not impressive at all. It's just 10x slower than what a simple regex query would've answered. Again, I'll be the bad guy in this comment section, but ML-based search methods for code are just not that useful. They do sound nice for non-coders, that's about it. I also feel like I'm qualified to say this because I have first-hand experience building c…
> nice for non-coders, that's about it. I'm not a coder but I code; not sure if that makes sense. I sort of know a bit of regex, but find it utterly painful and not worth the time. I'm an amateur, effectively, with little time. I like AI tools for coding, because I can input a request, and get sample code. I know enough to be able to read most of the code that I get back, but not enough to be able to easily write suc…
> I'm an amateur, effectively, with little time. I like AI tools for coding, because I can input a request, and get sample code.
This sounds kinda like contemporary Chinese text entry. Nobody remembers exactly which strokes in what order, but can feed some parameters into an app and get back candidate characters.
Of course the characters are a simple enumeration, while what you get from a coding-helper app is still a form of electronic hairball and requires a second look, and a third.
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#125I don’t understand these new saas that rely on GPT. It surely is my lack of understanding, but since the interface to GPT is mainly text: why any company would pay for N different GPT saas (e.g., one for searching for code, another for searching for documentation on confluence, another for allowing your business analysts with their queries, etc.)? Wouldn’t it make more sense for any company to have only ONE interface…
To me, your question seems to boil down to the economics of vertical integration. Two thoughts: First, GPT is all marginal cost, no fixed cost. So the marginal economics of 1 super app vs 10 specialized mini apps is roughly the same. Second, imagine the same argument applied to a utility like electricity. "Why would any company pay for lightbulbs from one company, HVAC from a second company, and appliances from a thi…
Slight nitpicking:
Edison used lots of different companies for their own business cases and I think the Edison Illuminating Company only built electric generators. So indeed in the beginning of electricity, when the field was most untested/starting up, you did shop at special companies for a generator or lamps or whatever instead of using an integrated whole-in-one solution of a mega corp! Wikipedia:
> Edison Lamp Company, a lamp manufacturer in East Newark, New Jersey; Edison Machine Works, a manufacturer of dynamos and large electric motors in Schenectady, New York; Bergmann & Company, a manufacturer of electric lighting fixtures, sockets, and other electric lighting devices; and Edison Electric Light Company, the patent-holding company and financial arm for Edison's lighting experiments
These were only later consolidated into General Electric.
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#126How do you manage "hallucinations?" One of the things I've noticed about using ChatGPT for programming tasks is that it will happily give you garbage.
ChatGPT to my understanding is only meant for one purpose, to be extremely good at conversing. That’s it! It should be so good at it that it almost convinces you.
OpenAi’s codex and the newer models should be used for actual coding related prompts.
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#127Earlier quoted context omitted.
what is a high-pass filter?
What a coincidence, just learned about those in my EE class lol It filters out low frequencies (e.g. motorcycle) and only lets higher frequencies (like a human voice) be expressed Edit: mixed em up, rookie mistake :p
What’s EE? Electrical Engineering?
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#128I don’t understand these new saas that rely on GPT. It surely is my lack of understanding, but since the interface to GPT is mainly text: why any company would pay for N different GPT saas (e.g., one for searching for code, another for searching for documentation on confluence, another for allowing your business analysts with their queries, etc.)? Wouldn’t it make more sense for any company to have only ONE interface…
I think it's because variations are in themselves valuable new stand-alone applications.
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#129Earlier quoted context omitted.
That would be akin to giving each of the 'plugins' your GPT API key and pay the usage bill directly to OpenAI. The plugin developers would still want $$$ for the app even if the GPT usage was excluded though.
Wouldn't it be a one-time purchase then? "Buy my prompt for $10 that enables you to search your codebase" And we're back to Prompt Engineers :)
Yes, prompt engineering is the future.
Re: Launch HN: Bloop (YC S21) – Code Search with GPT-4
#130Earlier quoted context omitted.
Posting about your company when relevant is one thing, advertising it another’s launch thread is another, and it’s pretty gauche… especially when, in this very thread, one of your testimonials is saying he doesn’t actually use your product: https://news.ycombinator.com/item?id=35236557
I don't see the issue with this. It happens on most of these Launch threads and is a common occurrence. I don't think there are rules that prohibit it either.
There's no formal rule against it but it's often done in bad taste. When people overpromote their thing in someone else's launch thread, we tend to scold them. Someone else's launch is not a great place for competitive promotion—each product or project deserves its day in the sun. On the other hand, users like to discuss alternatives and comparables, and that seems healthy.
I'd say the sweet spot is somewhere between just leaving the competitor's launch thread alone, or, if you must, then (1) mention it once and stop there; and (2) when you have any relationship with the alternative thing, disclose it.
That's the sort of thinking we apply in practice but wouldn't make a formal rule out of, partly because it's always evolving, but mainly because we don't want the list of rules to be too long. If we tried to codify all such things we'd end up with a bureaucratic list of hundreds of rules—ugh!