Viewing profile — sourabh03agr

I have experienced such issues with GPT-4 returning the wrong syntax, especially when asking questions about complex operations in Polars. We are actually running performance monit…

Hello HN! I am happy to share the Monitoring reports we have been running for the past few months to identify regression in popular LLMs like GPT-4-turbo, Claude-2, etc. There have…

Congrats on the launch! Do you need Github permissions to answer questions on open-source repos as well?

A quick answer is both, and here is why. Many of us may have seen posts where Google's Gemini model inadvertently generated images with an incorrect skin tone for some well-known i…

Great read! On being visible on social media efforts, how do you measure the ROI of your efforts, like how much time do you spend vs how much revenue does it bring?

Nice idea! From the perspective of someone who is in need of such a solution, I have explored similar apps before, and one of the biggest issues was that I don't look for events re…

That's fair, but a lot of use cases require strict information retrieval and don't want the LLM to get creative. I am of the opinion that having an LLM which is always factually co…

Hallucinations are an interesting artifact of LLMs where the model tends to make up facts or generate outputs that are not factually correct. There are two broad approaches for det…

Nice work! I see you have an evaluation module - what all are you evaluating for? Primarily Question-answer accuracy via Exact Match?

I was very intrigued after reading "The Power of Noise: Redefining Retrieval for RAG Systems" paper (https://arxiv.org/pdf/2401.14887.pdf), where they explored the impact of releva…

Guess Indian is far better than US and Japan when it comes to producing plastic waste. A lot of Indian states have plastic bans, drastically reducing the amount of plastic wasted v…

Love the product, a happy user here!