Live data from Hacker News

Launch HN: Sidekick (YC W23) – AI support bot for developers

news.ycombinator.com

51–60 of 92 posts

Re: Launch HN: Sidekick (YC W23) – AI support bot for developers

#51
Congrats on this launch!

We at IngestAI[1] are in similar space albeit with different focus - we answer from all internal documentation in Slack/Discord/Whatsapp. We did a show hn just a few weeks ago[2] & has been wild since then - we have close to 10k+ users and counting.

If you would like build slack/discord/whatsapp/telegram bots answer your customer questions from internal docs - please try us

[1] : https://ingestai.io/

[2] : https://news.ycombinator.com/item?id=34909921

Re: Launch HN: Sidekick (YC W23) – AI support bot for developers

#54
post #42

Great work! In your medium post, in the Post-processing section (step 1) you wrote: "If so, we re-run the evaluation prompt and force content_contains_answer to be false." I assume you do this forcing by adding 'false' to the prompt (as if GPT completed it), just like to seed the JSON structure itself. Could you explain what you do with the justification in that case? Use it in the same way as if the result was 'fals…

If we force content_contains_answer to false, we always re-run the evaluation step first to get a new justification for why the content doesn't have enough information. Then we run that justification through another prompt to convert it to a user-facing response.

It happens pretty rarely, off the top of my head probably 5% of the time. However we do see a pretty wide range in binary token probabilities anywhere from low 50% to something that asymptotically approaches 100%.

Re: Launch HN: Sidekick (YC W23) – AI support bot for developers

#56
post #42

Great work! In your medium post, in the Post-processing section (step 1) you wrote: "If so, we re-run the evaluation prompt and force content_contains_answer to be false." I assume you do this forcing by adding 'false' to the prompt (as if GPT completed it), just like to seed the JSON structure itself. Could you explain what you do with the justification in that case? Use it in the same way as if the result was 'fals…

[deleted]

Re: Launch HN: Sidekick (YC W23) – AI support bot for developers

#57
Congrats on the launch! We're building something similar [1] and are also observing a lot of the same usage patterns.

What seems to happen when the chatbot says "Hmmm, I don't know..." is that the DevRel team uses that to guide them to missing documentation sections. That's why we're building a whole analytics suite and documentation heatmap around the product to give insights about doc usage. Here's a quick demo [2].

[1] https://www.kapa.ai/ [2] https://www.loom.com/share/cb2b008141ae4ccda50b526a7597873e

Re: Launch HN: Sidekick (YC W23) – AI support bot for developers

#60
post #43

Interesting idea, however the sign up process is confusing: - "Add to Slack" opens a Stripe page which says $49 is due today while the landing page claims there's a 30 day trial - "Get Sidekick now" opens a contact us form

Thanks for the feedback! It was just something we added for our Product Hunt launch since that community loves promo codes. You can use the code SIDEKICKPH2023 for the 30 day free trial :). The code works until the end of the week!
Post reply on HN