Live data from Hacker News

Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

github.com

41–50 of 54 posts

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#41

Earlier quoted context omitted.

i read around launch that anthropic will fallback to opus if fable is used for frontier LLM development. did you run into anything like that?

Strangely, I did not. I was expecting it and looking out for it the whole time. At least I never say a warning!

that's because they said they'll silently fallback in case of model training. Then they backtracked, and said they wont silently fallback, but how will anyone ever know?

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#42

No idea why you got downvoted into oblivion with the context post. Cool idea!

Because HN detects AI comments and automatically makes them dead. I vouched for it as it's important for this post as context.

Trying to understand, So you downvote the post because of AI comments in HN ?

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#43

No idea why you got downvoted into oblivion with the context post. Cool idea!

Because HN detects AI comments and automatically makes them dead. I vouched for it as it's important for this post as context.

That wasn't AI detection.. it was self-promotion detection, but hey.. you've helped a promoter out.

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#44

Earlier quoted context omitted.

Because HN detects AI comments and automatically makes them dead. I vouched for it as it's important for this post as context.

Trying to understand, So you downvote the post because of AI comments in HN ?

HN the software, not HN the community (and no.. that isn't what happened)

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#49

How do you prevent the agent from reward-hacking the hidden eval? e.g. writing training data that effectively leaks the eval distribution rather than teaching a general skill?

Great question. Today the answer is that there is nothing stopping this, but you are right this is a 100% valid reward hacking possibility.

No signs of it in the run I did, but for any future larger scale runs, it would be wise to dedicate some focus to prevent this.

Re: Show HN: I RL-trained an agent that trains models with RL (for ~$1.3k)

#50

I RL-trained an agent whose job is to write RL training jobs for smaller models, and open-sourced the whole thing. The setup is two nested RL loops: - Outer loop: the trainer agent (Qwen3.6-35B-A3B, LoRA) is handed a task spec ("teach a small model to do X"). It works in a sandboxed workspace with file tools and writes a complete prime-rl training job: a verifiers environment + rubric, a dataset, and a hyperparameter…

Curious whst was your prompt/spec design process. How did u maintain the goal?
Post reply on HN