Viewing profile — wujerry2000

Hi all! Sharing some of our recent work around building RL envs and sims for agent training. There are a lot more technical details on building the benchmark in the post. If you ar…

This is a really important question. I definitely think as companies begin optimizing for an "Agent first" economy, they will start figuring out how to optimize their sites for age…

Lets do it! There's a cal link on our website if you wanna chat more

Self driving cars are a really good place to derive intuitions. Robotics as well! Both those spaces are still optimizing on the last mile performance gains that get exponentially h…

OpenAI agent is very impressive! That being said, there are still a lot of use cases its not good at, and also looking at long trajectory tasks, enterprise work tasks, etc. I imagi…

I think this is totally going to be the case! AI vibe coding tools already prefer some solutions over others, probably because of training data distribution/post training preferenc…

Theses are really good questions! we share the public/consumer simulators, but we also build bespoke environments on a per customer basis (think enterprise sites or even full VMs l…

Computer use agents are starting to perform well on websites/apps that are in their training distribution, but still struggle a lot when dealing with tasks outside their distributi…

A few common ones we've heard Engineering: QA automation is huge, closes the loop on "fully automated" software engineering if another computer use system is able to click around a…

UI refreshes knocking down simulator realism is a real issue that we're still trying to solve. I think this will probably be a mixture of automated QA/engineering and scale. Anothe…

We agree that as a demo flight booking is probably overused. However, in talking with my AI Labs, their perspective on flight booking is a little different. "Solving" flight bookin…

Yea haha ... early idea was illuminate + hallucinations. Naming isn't our strength :)

Hi everyone, Jerry and Wyatt here from Halluminate ( https://halluminate.ai/ ). We help AI labs train computer use agents with high quality data and RL environments. Training AI ag…

Running a test with browser agents and asked it to leave a comment on a Medium article. Came back 1 month later and found it had risen to be the most liked comment on the thread. I…

For fun, I calculated how this stacks up against other humanity-scale mega projects. Mega Project Rankings (USD Inflation Adjusted) The New Deal: $1T, Interstate Highway System: $6…

My takeaways (1) Companies will probably increasingly invest in building their own evals for their use cases because its becoming clear public/allegedly private benchmarks have mis…

Companies with LLM-based products (specifically Retrieval-Augmented Generation)deployed in production - how are you monitoring outputs for hallucinations? What's your process?