Show HN: Public and Free SWE-bench-lite evaluations
swebenchevals.com
Show HN: Public and Free SWE-bench-lite evaluations
1–2 of 2 posts
Re: Show HN: Public and Free SWE-bench-lite evaluations
#2While I was working on building SIMA, a multi-agent software-engineer (which recently achieved 27.67% on SWE-bench-lite: https://www.swebench.com/), I realized that evaluations on the actual benchmark were quite inconsistent, resource-intensive, and computation heavy. That's why I built swebenchevals.com, a really easy hosted solution for anyone that is working with the SWE benchmark right now.