I started a similar experiment if anyone else is thinking along the same lines :)
Using GPT-4 Vision with Vimium to browse the web
61–70 of 133 posts
Re: Using GPT-4 Vision with Vimium to browse the web
#62Re: Using GPT-4 Vision with Vimium to browse the web
#631. receiving payslips from the accountant, and then
2. manually initiating bank transfers to each employee for the amount in the corresponding payslip, and then
3. manually initiating a bank transfer to the tax authority to pay the withholded salary taxes.
This is completely useless manual labor. There should be no reason for this to be a manual procedure. And yet it's almost impossible to automate this. The accountant portal either has no API, or it has an API but lets you download the data as PDF, and/or the API costs good money. The bank either has no API, or it requires you to sign up for a developer account as if you're going to publish a public app, when you're just looking to automate some internal procedures.
So the easiest way to pay salaries and taxes is still to hire a person to do it manually. Hopefully one day that won't be necessary anymore. I wouldn't trust an AI to actually initiate the bank transfers, but maybe they can just prepare the transactions and then a person has to approve the submission.
Re: Using GPT-4 Vision with Vimium to browse the web
#64At my work there are a large contingent of people who essentially do manual data copying between legacy programs (govt), because the tech debt is so large that we can't figure out a way to plug these things together. Excited for tools like this to eventually act as a layer that can run over these sort of problems, as bizarre a solution as it is from a compute perspective
Re: Using GPT-4 Vision with Vimium to browse the web
#65Re: Using GPT-4 Vision with Vimium to browse the web
#66Re: Using GPT-4 Vision with Vimium to browse the web
#67At my work there are a large contingent of people who essentially do manual data copying between legacy programs (govt), because the tech debt is so large that we can't figure out a way to plug these things together. Excited for tools like this to eventually act as a layer that can run over these sort of problems, as bizarre a solution as it is from a compute perspective
Funny that you and others on here don't seem to realize that literally everybody who uses the internet has the exact same data entry problem all the time. Blame it on "old software", but how about the entire internet? copying (or in most cases even worse: re-typing) form data from one location on the screen into yet another webform. Username, password, email address, physical address, credit card info etc etc. Some e…
Simple: it's because not solving this problem is how our godawful industry makes most of its money. Empowering the user means relinquishing control over their "journey"[0]. Ergonomics means fewer opportunities to upsell or show ads.
I don't have the link handy, but I'm reminded of one of the earliest Windows user interface guidelines documents, back from Windows 95/98 era, which, in a section about theming/visual style, already recognized that they have to allow for full flexibility, because vendors will insist on fucking the experience up for the sake of branding anyway, and resisting it is futile[1].
--
[0] - I'm trying really hard to hold back my contempt towards terms like this, and the whole salesy way of viewing human-computer interactions.
[1] - They put it in much more polite terms, but the feeling of helplessness was already there.
Re: Using GPT-4 Vision with Vimium to browse the web
#68Why not build a new browser with GPT baked in?
Re: Using GPT-4 Vision with Vimium to browse the web
#69Earlier quoted context omitted.
From OpenAI docs[1]: "For safety reasons, we have implemented a system to block the submission of CAPTCHAs." [1] https://platform.openai.com/docs/guides/vision
Yeah, I've been feeding screenshots from selenium to the vision API, and when I trigger bot detection on a website, chatgpt refuses to process the image.
Re: Using GPT-4 Vision with Vimium to browse the web
#70Earlier quoted context omitted.
Funny that you and others on here don't seem to realize that literally everybody who uses the internet has the exact same data entry problem all the time. Blame it on "old software", but how about the entire internet? copying (or in most cases even worse: re-typing) form data from one location on the screen into yet another webform. Username, password, email address, physical address, credit card info etc etc. Some e…
consistently filling out username and password is all I wanted from my password manager, but it turns out it handles credit card number and other bits of information for me as well.