Live data from Hacker News

Klara and the Sun Essay Contest – $1k Prize – AI Use Allowed

willpenman.com

21–23 of 23 posts

Re: Klara and the Sun Essay Contest – $1k Prize – AI Use Allowed

#22

> In today's world, what's the best way to get to a top-tier analytic essay? I'm curious to see. AI generated content graded by AI for what goal exactly? I don't understand this contest at all.

Thanks for the feedback, I should revise the copy there. I think when I started the contest I wasn't fully sure myself. Here are the goals that stand out to me. 1. Is auto-scoring an essay really possible? (Meaning, cost-effective, reliable, valid) This is more of a personal motivation - I worked hard on the 190 items and receiving responses will help me figure out if they're full of shit. 2. It would be super cool to see an “ideal” essay on this! AI safety is so topical. The contest asks entrants, in part, to say: Is Klara and the Sun in favor of AI safety efforts? If no, that’s awkward! If yes, on what grounds? You would think since I made up the rubric that I know what the "right" answer is here. But there's a lot of ambiguity in the text. 3. (For people writing their essays via AI) What is the value of prompting if/when we get to ASI? For most prompt engineering-style entries, I figure they aren't also a scholar in the humanities. So entering the contest is a test case of trying to prompt AI to do something "better" beyond what they can already do themselves. You could spin that up as prototypical of what life in general might be like in some amount of time. What prompt techniques even survive when you can't really assess what "Now make it better!" should look like? That's interesting! 4. (For people writing their essays as humans) Maybe this contest format is more humane than typical peer review? You always know where you stand. You get a score back in a few minutes, as soon as the scorer finishes going through the rubric. And the revision process is private, with no loss of face. In contrast, scholars in the humanities sometimes have to wait up to a year to hear back about a submission.

Re: Klara and the Sun Essay Contest – $1k Prize – AI Use Allowed

#23

Earlier quoted context omitted.

I mean it's obvious that note is trolling

unless you have seen the submission, i have no idea how you could possibly know. so, if you don't mind, what are the 'tells'? what "obvious" things did i miss?

I worked a lot with designing and implementing agentic grading at my job, there's a ~0 chance that on a rubric with 180 items, changing 1 char out of 6000 words would result in a flip in 10+ grading items :)
Post reply on HN