What do the tokens for an image even look like? I understand that tokens for text are just fragments of text... but that obviously doesn't make sense for images.
The killer app of Gemini Pro 1.5 is using video as an input
51–60 of 507 posts
Re: The killer app of Gemini Pro 1.5 is using video as an input
#52That is impressive at first glance, no question. To stay with the example of the bookshelf, you would only follow this path for several or very many books, as in the example with the cookbooks. I have no idea how good the Geminis or GPTs of this world currently are, but let's optimistically assume a 3% error rate due to hallucinations or something. If I want to be sure that the results are correct, then I have to go…
This isn't a problem that's unique to LLMs though.
Pay a bunch of people to go through and index your book collection and you'll get some errors too.
What's interesting about LLMs is they take tasks that were previously impossible - I'm not going to index my book collection, I do not have the time or willpower to do that - and turned them into things that I can get done to a high but not perfect standard of accuracy.
I'll take a searchable index of my books that's 95% accurate over no searchable index at all.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#53Title should have input added to the end "The killer app of Gemini Pro 1.5 is video input" Seems like a good way to do video moderation (YouTube) at scale, if they can keep costs down...
yeah I need a live updated chart that tells me what kind of multimodal input and output a model or service can do
its super confusing now because each i/o method is novel and exciting to that team and their users may not know what else is out there
but for the rest of us looking for competing services its confusing
Re: The killer app of Gemini Pro 1.5 is using video as an input
#54I can't access that Google AI Studio link because I'm in some strange place called the UK so I'm unable to verify or prototype with it currently. People at Deepmind, what's with that?
Re: The killer app of Gemini Pro 1.5 is using video as an input
#55hehe, this is great, I was just (2 days ago) playing with a similar problem in a web app form: browsing books in the foreign literature section of a Portuguese bookstore! My (less serious) ultimate goal is a universal sock pairing app: never fold your socks together again, just dump them in the drawer and ask the phone to find a match when you need them! This seems more like a visual segmentation problem though and s…
I employ a different strategy: I own 25 pairs of the same gray socks (gray was chosen so that it matches most outfits) and I just wear those all the time. Obviously I do own other socks (for suits etc.) but it has cumulatively saved me hours of sock searching.
Yes, I tried to employ this same strategy, but maybe it's because of my ADD or something, but I never manage to buy the same bulk socks, and eventually I run out and try to buy another bulk of socks which starts to get mixed with the last ones.
I need a robot that can physically sort and organize absolutely everything in my living space.
I have ideas for different strategies, but I am never able to actually implement those, so it ends up that I panic search for good pair of socks when there's an important event or just any scenario where someone would see me in socks and it would be good if socks looked similar enough.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#56hehe, this is great, I was just (2 days ago) playing with a similar problem in a web app form: browsing books in the foreign literature section of a Portuguese bookstore! My (less serious) ultimate goal is a universal sock pairing app: never fold your socks together again, just dump them in the drawer and ask the phone to find a match when you need them! This seems more like a visual segmentation problem though and s…
I'd prefer an app that can find the missing socks for all the singletons that emerge from each load of laundry. We'll probably have to wait for a super AGI though.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#57I was thinking about this a while back, once AI is able to analyze video, images and text and do so cheap & efficiently. It's game over for privacy, like completely. Right now massive corps have tons of data on us, but they can't really piece it together and understand everything. With powerful AI every aspect of your digital life can be understood. The potential here is insane, it can be used for so many different things good and bad. But I bet it will be used to sell more targeted goods and services.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#58[deleted]
Re: The killer app of Gemini Pro 1.5 is using video as an input
#59I was thinking about this a while back, once AI is able to analyze video, images and text and do so cheap & efficiently. It's game over for privacy, like completely. Right now massive corps have tons of data on us, but they can't really piece it together and understand everything. With powerful AI every aspect of your digital life can be understood. The potential here is insane, it can be used for so many different t…
Unless you live in the EU and have laws that should protect you from that.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#60I was thinking about this a while back, once AI is able to analyze video, images and text and do so cheap & efficiently. It's game over for privacy, like completely. Right now massive corps have tons of data on us, but they can't really piece it together and understand everything. With powerful AI every aspect of your digital life can be understood. The potential here is insane, it can be used for so many different t…
Unless you live in the EU and have laws that should protect you from that.
incentives cannot be fixed with just prohibitive laws, war on drags should've taught you something