Live data from Hacker News

Anthropic's original take home assignment open sourced

github.com

381–390 of 394 posts

Re: Anthropic's original take home assignment open sourced

#381

Earlier quoted context omitted.

I’m trying to imagine what would make it impossible to not pay attention to your children for four hours and the only thing I can think of that can’t be scheduled around is…a very young newborn, maybe? If they’re prone to waking up constantly?

Babies and toddlers need parental care and attention too.

Usually you can get four hours of time where they’re not likely to bother you from them.

Re: Anthropic's original take home assignment open sourced

#382

Earlier quoted context omitted.

I didn’t ask you to be rude or wrong either, yet here we are. The assignment is explicitly single core and cycle accurate. Your point is completely irrelevant and shows a disconnect with the content being discussed.

It's neither rude nor wrong to ask for evidence to support claims being made in what appears to be corporate advertising. The claim is their LLM is better than a person, I asked for evidence. None was presented. It's not complicated.

You first claimed this task was poorly specified (it’s not) and then completely misrepresented what it’s looking for. When I pointed this out you became defensive and claimed this was not your point at all. That’s what I’m talking about.

Re: Anthropic's original take home assignment open sourced

#383

Earlier quoted context omitted.

Lately with Gemini CLI / Jules it doesn't seem like time spent is a good proxy for difficulty. It has a big problem with getting into loops of "I am preparing the response for the user. I am done. I will output the answer. I am confident. Etc etc". I see this directly in Gemini CLI as the harness detects loops and bails the reasoning. But I've also just occasionally seen it take 15m+ to do trivial stuff and I suspect…

I've noticed using antigravity and vscode, Gemini 3 pro often comes back with model too busy or something like that and basically 500s. Seems like capacity because it works a lot better late at night. I don't see the same with the claude models in antigravity.

Yeah that's a separate issue though, it predates the time when the looping issues got really common, for me at least.

Re: Anthropic's original take home assignment open sourced

#384

Earlier quoted context omitted.

There are some other failure modes that all feel kinda vaguely related that probably help with building a hypothesis about what's going wrong: Sometimes Gemini tools will just randomly stop and pass the buck back to you. The last thing will be like "I will read the code to understand " and then it waits for another prompt. So I just type "continue" and it starts work again. And, sometimes it will spit out the interna…

At one point it started spitting out its CoT in the comments of the code it’s supposed to be changing.

Ah yeah I've seen that too. Definitely seems related.

I suspect this is also something like the "inverse" of a prompt hijacking situation. Basically it's losing track of where its output is flowing to (whereas prompt injection is when it loses track of where its input is flowing from).

Re: Anthropic's original take home assignment open sourced

#385
post #379
post #173

Earlier quoted context omitted.

Since it's a CPU, you start with the idea that there is an ALU and spiral outward from that. That gives you something concrete to wrap your head around while you climb up the abstraction levels. However, when I hit "scratch_write" and it wasn't in the Machine class and it wasn't coming from some Decorator and it was getting defined and deleted by a member function ... I stopped. That's paying lip service to the varia…

What is variable typing?

The types on the variables. Python recently adopted "gradual typing", but it isn't enforced by default. Consequently, you may have to actually execute a Python program to determine what an unlabeled variable type is.

A lot of people write Python code and then run "AI" on it to fill in the variable types. This, of course, is error prone and shitty. And the AI will miss strange usages like the one I flagged.

Although I am sorry for phrasing it as "variable typing". I can see how you might read that as "typing that varies" instead.

Re: Anthropic's original take home assignment open sourced

#386

Earlier quoted context omitted.

It's neither rude nor wrong to ask for evidence to support claims being made in what appears to be corporate advertising. The claim is their LLM is better than a person, I asked for evidence. None was presented. It's not complicated.

You first claimed this task was poorly specified (it’s not) and then completely misrepresented what it’s looking for. When I pointed this out you became defensive and claimed this was not your point at all. That’s what I’m talking about.

Still not addressing any of my points & making it personal is not going to make you any less confused.

Re: Anthropic's original take home assignment open sourced

#387

Earlier quoted context omitted.

You first claimed this task was poorly specified (it’s not) and then completely misrepresented what it’s looking for. When I pointed this out you became defensive and claimed this was not your point at all. That’s what I’m talking about.

Still not addressing any of my points & making it personal is not going to make you any less confused.

You’re going to have to lay out “your points” or there is no way anybody is going to respond to them. I’ve been replying to what you’ve been writing.

Re: Anthropic's original take home assignment open sourced

#388

Earlier quoted context omitted.

Still not addressing any of my points & making it personal is not going to make you any less confused.

You’re going to have to lay out “your points” or there is no way anybody is going to respond to them. I’ve been replying to what you’ve been writing.

People manage to respond to them just fine.

Re: Anthropic's original take home assignment open sourced

#389

Earlier quoted context omitted.

You’re going to have to lay out “your points” or there is no way anybody is going to respond to them. I’ve been replying to what you’ve been writing.

People manage to respond to them just fine.

Well, I won't.
Post reply on HN