Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I recorded a screen capture of a task. Gemini generated code to replicate it

twitter.com

Post reply on HN
Print view View original

61–70 of 101 posts

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#61

Post by g-b-r »

littlestymaar wrote: post #18
eden_hazard wrote: post #3

I feel like most engineers on hackernews/reddit have been underestimating AI tech. People always say it sucks and it gets starts hallucinating nonexistent libraries and what not but we are still in the early phase of this technology. And that how it could never replace them as AI will make current engineers more efficient. I've been scared of AI since seeing chatgbt a couple of years ago. I feel like it's only a matt…

I feel literally the opposite: the reason why I'm disappointed by the current state of AI is because I really want it to work so I can focus on the actually useful part of my job instead of doing boring stuff. What's the useful part of my job? It's bringing values to my customers: they want to do something, and they need help. But today, unfortunately I must always tell them to reduce their ambition because they woul…

> from the perspective of the dude who hold the money, our job is to be the weirdo that talks to machines to deliver what the his ego want his company to be. Hence, the more you are able to deliver, the happier the money holder, and the more money you make. Our job will be threatened when the guys with money will be willing to actually make the effort of talking with the machine, but I don't see this day coming anytime soon.

There's plenty of managers who prefer hacking an excel and vba than relying on developers; those will probably be more than glad of using some IA tool, to do something more advanced; of course mostly just for internal stuff, in the short term.

Anyhow many managers have a distaste for developers; they consider them overpaid slackers who'll lose time on anything, rather than producing money for the business.

They'll be more than glad to turn the job to the cheapest unqualified guy around, if with an LLM he can make something that looks passable

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#62

Post by g-b-r »

Buttons840 wrote: post #23

If an AI can do this, an AI can also watch my screen and blank out all ads and edit out the sound. The controversy and panic that will happen when such an AI is eventually revealed will be interesting.

I mean, adblockers have existed for a while...

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#63

Post by dvngnt_ »

eden_hazard wrote: post #3

I feel like most engineers on hackernews/reddit have been underestimating AI tech. People always say it sucks and it gets starts hallucinating nonexistent libraries and what not but we are still in the early phase of this technology. And that how it could never replace them as AI will make current engineers more efficient. I've been scared of AI since seeing chatgbt a couple of years ago. I feel like it's only a matt…

i don't see how the posted video is easier than just using the playback and recording tools that have been around for years

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#64

Post by from-nibly »

babyshake wrote: post #29

One thing I am now wondering is why bother with the Selenium script at all? Why not have the AI model describe the same things it would do in a Selenium script in detailed natural language, you could always store that in a DB or file with more efficiency than storing the video, and you could just feed the natural language description to a model for automation? And the major benefit is it is much easier for humans to…

Selenium scripts are already so flaky. Why would you want to add more ambiguity to them?

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#65

Post by MetalGuru »

babyshake wrote: post #29

One thing I am now wondering is why bother with the Selenium script at all? Why not have the AI model describe the same things it would do in a Selenium script in detailed natural language, you could always store that in a DB or file with more efficiency than storing the video, and you could just feed the natural language description to a model for automation? And the major benefit is it is much easier for humans to…

Eventually; openai, adept, etc. are working on these types of agents. But currently, name a model that can replace selenium (ie. engage with the browser)

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#66

Post by [deleted] »

dotty- wrote: post #32
xyst wrote: post #27

Earlier quoted context omitted.

HN also underestimated cryptocurrency craze. Yet years later, it is busted. Seeing the same patterns with AI. Every startup is now incorporating “AI” or “deep learning” or “OpenAI” into their decks/motto/pitch. Have yet to see anything worth using beyond the initial hype. Using AI to me is like learning another programming language. Same shit. Different interface.

Is cryptocurrency busted? Sure, it didn't replace the global monetary system, but it seems to be a proven technology now. And sure, it had its crashes, but BTC is up 112% over 1Y, and lots of cryptos have legitimate payment purposes.

[deleted]

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#67

Post by MetalGuru »

urbandw311er wrote: post #11

I am really sorry to whinge but is there any way at all to avoid posting links to tweets? Visiting twitter is such a horrible soul destroying experience. I can’t work out how to full screen the video if it’s even possible. The resolution on the video is too poor for me to be able to read the code. There are ads and troll comments everywhere. It seems to want me to create an account. It’s just horrific. Is there reall…

People post on twitter. It's a thing. Asking to avoid posting links to twitter is ridiculous

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#68

Post by qlk1123 »

tomatohs wrote: post #44
eden_hazard wrote: post #3

I feel like most engineers on hackernews/reddit have been underestimating AI tech. People always say it sucks and it gets starts hallucinating nonexistent libraries and what not but we are still in the early phase of this technology. And that how it could never replace them as AI will make current engineers more efficient. I've been scared of AI since seeing chatgbt a couple of years ago. I feel like it's only a matt…

We're building an AI Agent that can perform manual testing on feature branches [1]. I can tell you, it works, and it's going to get better, and it's going to happen fast. It's not hard at all for an AI to read text on the screen and click it. What's amazing is the social impact this has - often people don't believe it's real. It feels like when I had to explain to my parents that in my online multiplayer game, that t…

> You can't test for "fun."

Sounds intuitive, but there are gaming researches working on that regard. Two related terms (learnt from IEEE Conference of Games) that come to mind:

1. Game refinement theory. The inventors of this theory see games as if they were evolving species, so this is to describe how game became more interesting, more challenging, more "refined". Personally I don't buy that theory because the series of papers had only a limited number of examples and it is questionable how related statistics were generated (especially the repeatedly occured baselines Go and Mahjong), but nonetheless there is theory on that.

2. Deep Player Behaviory Modeling (DPBM): This is the more interesting one. Game developers want their game to be automatically testable, but the agents are often not ready or not true enough. Says AlphaZero for Go or AlphaStar for StarCraft II, they are impressive ones but super-human, so the agnet's behavior give us little insight on how the quality of the game is and how to further improve the game. With DPBM, the signature of real human play can be captured and reproduced by agents, and thus auto-play testing is possible. Balance, fairness, engagement, etc. can then be used as the indirect keys to reassemble "fun."

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#69

Post by a1o »

65 wrote: post #56
xyst wrote: post #27

Earlier quoted context omitted.

HN also underestimated cryptocurrency craze. Yet years later, it is busted. Seeing the same patterns with AI. Every startup is now incorporating “AI” or “deep learning” or “OpenAI” into their decks/motto/pitch. Have yet to see anything worth using beyond the initial hype. Using AI to me is like learning another programming language. Same shit. Different interface.

A lot of the AI programming things you can do would be easier to either 1. type out yourself 2. copy and paste from StackOverflow 3. find a library that does the thing you want It's not like CoPilot is any better. It's like when Microsoft and Google tried to force text completion on emails, it just gets in the way and makes me lose my train of thought. AI is really great for very specific tasks that would be difficul…

> It's like when Microsoft and Google tried to force text completion on emails, it just gets in the way and makes me lose my train of thought

I have been using a paper notebook to take my notes for a while and I like that I can remember what I scribble spacially.

Recently I decided to also use the notebook to sketch the really important e-mails - the ones you send to people either really high up or that you value a lot but can't reach often - in paper. I have been able to scribble rather quickly in paper and come up with concise but also complete write-ups and also noticed I am happy to not be looking at the computer screen.

I started this because I noticed there was a lot of noise going on when using outlook with all the notifications popping-up and the hard to understand new interface that just scales like ass and becomes unreadable in my 4k laptop, and the autocomplete kept axing my thoughts.

Re: I recorded a screen capture of a task. Gemini generated code to replicate it

#70

Post by dvngnt_ »

tomatohs wrote: post #44
eden_hazard wrote: post #3

I feel like most engineers on hackernews/reddit have been underestimating AI tech. People always say it sucks and it gets starts hallucinating nonexistent libraries and what not but we are still in the early phase of this technology. And that how it could never replace them as AI will make current engineers more efficient. I've been scared of AI since seeing chatgbt a couple of years ago. I feel like it's only a matt…

We're building an AI Agent that can perform manual testing on feature branches [1]. I can tell you, it works, and it's going to get better, and it's going to happen fast. It's not hard at all for an AI to read text on the screen and click it. What's amazing is the social impact this has - often people don't believe it's real. It feels like when I had to explain to my parents that in my online multiplayer game, that t…

Your site says 'No more writing automated tests or waiting on manual testing.'

but this solution only appears to do e2e testing ignoring api and unit testing. Additionally, automated test are mostly used for regression testing not exploratory testing of new features where most bugs will be found.

Post reply on HN