Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

Post reply on HN
Print view View original

31–40 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#31

Post by simonw »

daft_pink wrote: post #28

I feel that while youtubers and influencers are heavily interested in video tools, most average users aren’t that interested in creating video. I write a lot more email than sending out videos and the value of those videos is mostly just for sharing my life with friends and family, but my emails are often related to important professional communications. I don’t think video tools will ever reach the level of usefulne…

That's why I'm excited about this particular example: indexing your bookshelf by shooting a 30s video of it isn't producing video for publication, it's using your phone as an absurdly fast personal data entry device.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#32

Post by valleyer »

daft_pink wrote: post #28

I feel that while youtubers and influencers are heavily interested in video tools, most average users aren’t that interested in creating video. I write a lot more email than sending out videos and the value of those videos is mostly just for sharing my life with friends and family, but my emails are often related to important professional communications. I don’t think video tools will ever reach the level of usefulne…

Recall that TFA discusses analyzing video, not generating video.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#39

Post by smartmic »

That is impressive at first glance, no question. To stay with the example of the bookshelf, you would only follow this path for several or very many books, as in the example with the cookbooks. I have no idea how good the Geminis or GPTs of this world currently are, but let's optimistically assume a 3% error rate due to hallucinations or something. If I want to be sure that the results are correct, then I have to go through and check each entry manually. I want to rule out the possibility that there are titles listed in the 3% that would completely turn an outsider's world view of me upside down.

So, even if data entry is incredibly fast, curation is still time-consuming. On balance, would it even be faster to capture the ISBN code of 100 books with a scanner app, assuming that the index lookup is correct, or to compare 100 JSON objects with title and author for correctness?

The example is only partly serious. I just think that as long as hallucinations occur, Generative AI will only get part of my trust - and I don't know about you, but if I knew that a person was outright lying to me in 3% of all his statements, I wouldn't necessarily seek his proximity in things that are important to me...

Post reply on HN