Viewing profile — kimjune01

for throughput, you can use a stopwatch and a big movie transfer from one end to another

It only takes a small minority to ruin it for the rest of us. for example, bike theft

Vancouver dream, not achievable with a median income

would you let taste make withdrawls from your bank account

Thinking that harnesses and agents can improve without human involvement, even if it works, will yield a much lower growth rate than if a human gets involved in the loop.

it should be entirely acceptable to filter out factually incorrect or unverifiable submissions without human intervention

paper submissions require LLM disclosure

nowhere near plateau, but right at the inflection point of diminishing returns imo

i think it's a rite of passage to have attempted encoding thinking and the scientific process for AI/ML researchers

the issues were already validated by the maintainers, and the maintainers merged it into their repo voluntarily. When maintainers accepted the PRs, they were the ones who found it …

actor paradigm is huge for clamping down on agents

as the proof of verification decreases, the value of credentials that act as shortcut proofs of human competence will decrease, too.

i learned that no matter how good i am at writing prose, it doesnt matter if nobody reads it. so i write for AI agents instead, hoping that it'll get picked up by an agent and find…

for small to medium sized bugs I managed to get a bit more than half of my PRs to get merged. ~90 PRs since May https://june.kim/speedrunning-open-source Verify yourself: { merged:…

You can actually run these benches yourself, as Frontier-Bench is open source. Also have a look at these other coding benchmarks I audited. Frontier-Bench v0.1: all 74 tasks grade …

the bottleneck for these open source repos is maintainer attention. AI seemingly does not yet improve that throughput.

one time i told a google voice to kill itself and i could never get it to work again

someone's promotion depends on benching harder

it's not just social science, even AI papers that would be trivial to replicate dont

anyone else notice that the topline numbers are effort xhigh? anybody actually use the models at those levels?

end the fed?

it's magic!

i like the tiny vision but it's yet to break out from its research project phase

vibe coding becomes much more tolerable when you disambiguate your agents with goals, constraints and heuristics up front.

this kind of benchmark is particularly susceptible to a narrow grader, where the input request is vague and therefore a significant range of SQL output would be valid, yet graded i…