Using GPT-4 Vision with Vimium to browse the web
1–10 of 133 posts
Re: Using GPT-4 Vision with Vimium to browse the web
#2Personally. This is what Im really excited about chatgpt for. Data has just become alot more free to access.
Re: Using GPT-4 Vision with Vimium to browse the web
#3This is amazing, I feel like these vision models are going to make everything so much more accessible. Between the Be My Eyes app integration and now this, I'm really excited for how this transforms the web.
Re: Using GPT-4 Vision with Vimium to browse the web
#4Hey! Creator here, thanks for sharing! Let me know if anyone has questions and feel free to contribute, I've left some potential next steps in the README.
Re: Using GPT-4 Vision with Vimium to browse the web
#5This is amazing, I feel like these vision models are going to make everything so much more accessible. Between the Be My Eyes app integration and now this, I'm really excited for how this transforms the web.
I agree, and I think we're a year or two away from a full end-to-end trained screen reader. The ground truth from existing systems would provide great training material.
As a technical blind person, my only concern is the inherent loss of privacy while sharing stuff with the big models.
Re: Using GPT-4 Vision with Vimium to browse the web
#6At my work there are a large contingent of people who essentially do manual data copying between legacy programs (govt), because the tech debt is so large that we can't figure out a way to plug these things together. Excited for tools like this to eventually act as a layer that can run over these sort of problems, as bizarre a solution as it is from a compute perspective
Re: Using GPT-4 Vision with Vimium to browse the web
#7Hey! Creator here, thanks for sharing! Let me know if anyone has questions and feel free to contribute, I've left some potential next steps in the README.
Very cool use for Vimium, I like the approach!
Re: Using GPT-4 Vision with Vimium to browse the web
#8Looks extremely cool. Trying to run it though, I get stuck at "Getting actions for the given objective..." (using the example on the repo)
Re: Using GPT-4 Vision with Vimium to browse the web
#9It's so cool. I was wondering if we can make crawler tool much easier and better. It's more similar to the "human" way to interact with a website.
Re: Using GPT-4 Vision with Vimium to browse the web
#10At my work there are a large contingent of people who essentially do manual data copying between legacy programs (govt), because the tech debt is so large that we can't figure out a way to plug these things together. Excited for tools like this to eventually act as a layer that can run over these sort of problems, as bizarre a solution as it is from a compute perspective
Kinda sci-fi, we're so close to a future where when/if original source code is lost, a mainframe runs in an emulator and the human operating it is also emulated.