Benchmarks?
Launch HN: Nia (YC S25) – Give better context to coding agents
21–30 of 92 posts
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#22Cursor promises to do this[0] in the product, so, especially on HN, it'd be best to start with "why this is better than Cursor". > favorite doc sites so I do not have to paste URLs into Cursor This is especially confusing, because cursor has a feature for docs you want to scrape regularly. 0 - https://cursor.com/docs/context/codebase-indexing
The goal here is not to replace Cursor’s own local codebase indexing. Cursor already does that part well. What Nia focuses on is external context. It lets agents pull in accurate information from remote sources like docs, packages, APIs, and broader knowledge bases
That’s what GP is saying. This is the Docs feature of Cursor. It covers external docs/arbitrary web content.
`@Docs` — will show a bunch of pre-indexed Docs, and you can add whatever you want and it’ll show up in the list. You can see the state of Docs indexing in Cursor Settings.
The UX leaves a bit to be desired, but that’s a problem Cursor seems to have in general.
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#23Benchmarks?
Arlan had this in his text but I cut it for brevity - sorry about that! Here's the bit:
In our internal benchmark on bleeding edge SDK and library features, Nia produced the lowest hallucination rate among the context providers and search tools we tested (context7, exa code, etc), and I wrote up the setup and results in a separate blog post: https://www.nozomio.com/blog/nia-oracle-benchmark
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#24Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#25Absolutely insane that we celebrated coding agents getting rid of RAG, only with the next innovation being RAG
"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."
"Don't be snarky."
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#26Earlier quoted context omitted.
The goal here is not to replace Cursor’s own local codebase indexing. Cursor already does that part well. What Nia focuses on is external context. It lets agents pull in accurate information from remote sources like docs, packages, APIs, and broader knowledge bases
That’s what GP is saying. This is the Docs feature of Cursor. It covers external docs/arbitrary web content. `@Docs` — will show a bunch of pre-indexed Docs, and you can add whatever you want and it’ll show up in the list. You can see the state of Docs indexing in Cursor Settings. The UX leaves a bit to be desired, but that’s a problem Cursor seems to have in general.
yeah ux is pretty bad and overall functionality. it still relies on a static retrieval layer and limited index scope.
+ as I mentioned above there are many more use cases than just coding.Think docs, APIs, research, knowledge bases, even personal or enterprise data sources the agent needs to explore and validate dynamically.
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#27I've no idea what their architecture/implementation looks like, but I've built a similar tool for my own use and the improvements are dramatic to say the least.
Mine's a simple BM25 index for code keyword search (I use it alongside serena-mcp) and for some use cases the speeds and token efficiency are insane.
https://gitlab.com/rhobimd-oss/shebe#comparison-shebe-vs-alt...
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#28I've no idea what their architecture/implementation looks like, but I've built a similar tool for my own use and the improvements are dramatic to say the least. Mine's a simple BM25 index for code keyword search (I use it alongside serena-mcp) and for some use cases the speeds and token efficiency are insane. https://gitlab.com/rhobimd-oss/shebe#comparison-shebe-vs-alt...
looks cool, what's the largest codebase you have tested it on?
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#29I've no idea what their architecture/implementation looks like, but I've built a similar tool for my own use and the improvements are dramatic to say the least. Mine's a simple BM25 index for code keyword search (I use it alongside serena-mcp) and for some use cases the speeds and token efficiency are insane. https://gitlab.com/rhobimd-oss/shebe#comparison-shebe-vs-alt...
looks cool, what's the largest codebase you have tested it on?
OpenEmr and Istio.
https://gitlab.com/rhobimd-oss/shebe/-/blob/main/docs/Perfor...
Re: Launch HN: Nia (YC S25) – Give better context to coding agents
#30[under-the-rug stub] [see https://news.ycombinator.com/item?id=45988611 for explanation]
Amazing product.
As an individual heavy user I must say it does what it is supposed to do and it does it well.