Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

github.com

Post reply on HN
Print view View original

11–20 of 75 posts

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#11

Post by gregpr07 »

bravura wrote: post #5

It would be amazing if you: a) There were a test / eval suite to determine which model works best for what. It could be divided into a training suite and test suite. (Training tasks can be used for training, test tasks only for evaluation.) Possibly a combination of unit tests against known xpaths, and integration tests that are multi-step and end in a measurable result. I know the web is constantly changing, so I'm…

A) we plan on thoroughly testing that with Mind2Web dataset. They have a very robust set of (persistant) selectors

B) so, shadcn for prompts for web agents haha :) but I agree, that would be SICK! Just go to browseruse and get the prompt for your specific use case

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#12

Post by Oras »

This looks interesting. I am really impressed with MultiOn [0], and I tried to make something similar, but it's quite challenging doing it with a Chrome extension.

I also saw one doing Captcha solving with Selenium [1].

I will keep an eye on your development, good luck!

[0] https://www.multion.ai/ [1] https://github.com/VRSEN/agency-swarm

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#14

Post by gregpr07 »

daft_pink wrote: post #13

I was really excited about the original claude computer use until I watched the youtube videos and saw it was only running in a docker container. I wish I could run something like this on a real machine.

You can run browser use in your terminal, no need for Docker containers. Just clone it and run it

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#15

Post by craftkiller »

daft_pink wrote: post #13

I was really excited about the original claude computer use until I watched the youtube videos and saw it was only running in a docker container. I wish I could run something like this on a real machine.

What makes a docker container not a "real machine"? Docker programs are running natively, just like any other program, without emulation/virtualization. Its not like a virtual machine (unless you're on one of the lesser operating systems like Windows or OSX), its just configuring some settings in the Linux kernel to isolate the process from other processes. Its basically just an enhanced chroot.

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#17

Post by gregpr07 »

Oras wrote: post #12

This looks interesting. I am really impressed with MultiOn [0], and I tried to make something similar, but it's quite challenging doing it with a Chrome extension. I also saw one doing Captcha solving with Selenium [1]. I will keep an eye on your development, good luck! [0] https://www.multion.ai/ [1] https://github.com/VRSEN/agency-swarm

Thanks! Have you tried captcha solving with [1]? It's very tricky sometimes, especially with non standard "verify human" - maybe you could solve it by writing Selenium/Javascript code directly and then execute it.

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#18

Post by aethelingas »

Oras wrote: post #12

This looks interesting. I am really impressed with MultiOn [0], and I tried to make something similar, but it's quite challenging doing it with a Chrome extension. I also saw one doing Captcha solving with Selenium [1]. I will keep an eye on your development, good luck! [0] https://www.multion.ai/ [1] https://github.com/VRSEN/agency-swarm

what are the challenges with the Chrome extension path?

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#19

Post by gregpr07 »

soham123 wrote: post #16

I have built something similar at https://github.com/ComposioHQ/composio/tree/master/python/co... Compatible with any LLMs and agentic framework

Looks nice. I find the cleaning HTML step in our cleaning pipeline extremely important, otherwise there is no real benefit from just using a general vision model and clicking coordinates (and whole HTML is just way too many tokens). How do you guys handle that?

Re: Show HN: I wrote an open-source browser alternative for Computer Use for any LLM

#20

Post by theredsix »

Awesome project, starred! Here are some other projects for agentic browser interactions:

* Cerebellum (Typescript): https://github.com/theredsix/cerebellum

* Skyvern: https://github.com/Skyvern-AI/skyvern

Disclaimer: I am the author of Cerebellum

Post reply on HN