Live data from Hacker News

Gemini Omni

deepmind.google

61–70 of 152 posts

Re: Gemini Omni

#61
post #60

> Prompt: Make it look like the weird shape of my hand hole super zooms and magnifies the ground it's looking at in sharper quality. There's got to be a reason this is phrased so insanely, right?

Even weirder: > Prompt: A skeuomorphism stop motion explainer about how the brain hippocampus works with a compelling voiceover. Don’t add seahorses. No voice cuts at the end. Don’t add text Seahorses???

The genus of the seahorse is _Hippocampus_.

Re: Gemini Omni

#62
post #36

In my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver. As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic." It gave me a video of where bricks suddenly…

> But I am a bit reasurred that at least my job won't be fully replaced with AI :)

I honestly can't comment with certainty that training from videos alone and whatever tokenization scheme they're using will ever get perfect dynamics.

However it is worth noting that transformers can do a pretty good job at learning dynamics with the right pipeline (not video): https://arxiv.org/pdf/2605.15305 https://arxiv.org/pdf/2605.09196

My point here being that representationally, it might be possible to learn good dynamics without a radically different approach/arch. There are already models that extract 3D tracking points from videos, so they could possibly be leveraged for learning dynamics (which on its own gives precedent for end-to-end approaches also possibly working).

Re: Gemini Omni

#63
post #44

Earlier quoted context omitted.

For a few weeks, YouTube thought I wanted to see videos of package thieves being surprised by a booby-trapped box that was actually a glitter bomb. Video after video were these AI created shorts of supposed doorbell camera footage showing a thief running away with a box that explodes into a giant pink cloud. I eventually picked one and opened the comments and the top comment was something like "This is obviously an A…

> and the reply was along the lines of "me because I like seeing thieves get what's coming to them". I really wish a subject matter expert would pitch in to tell us what this is about? like a totally made up thing that is fake, somehow gives a sense of justice and satisfaction? is it something about imagining it happening in reality, or what? for me, if I see that something is AI, it's like I just feel nothing. becau…

Do you ever feel a sense of satisfaction watching a movie? I'm thinking of scenarios like when the bad guy is finally defeated or the hero achieves their goal.

Re: Gemini Omni

#64
post #61
post #60

Earlier quoted context omitted.

Even weirder: > Prompt: A skeuomorphism stop motion explainer about how the brain hippocampus works with a compelling voiceover. Don’t add seahorses. No voice cuts at the end. Don’t add text Seahorses???

The genus of the seahorse is _Hippocampus_.

This guy prompts. Insanely astute.

Re: Gemini Omni

#65
post #44

Earlier quoted context omitted.

For a few weeks, YouTube thought I wanted to see videos of package thieves being surprised by a booby-trapped box that was actually a glitter bomb. Video after video were these AI created shorts of supposed doorbell camera footage showing a thief running away with a box that explodes into a giant pink cloud. I eventually picked one and opened the comments and the top comment was something like "This is obviously an A…

> and the reply was along the lines of "me because I like seeing thieves get what's coming to them". I really wish a subject matter expert would pitch in to tell us what this is about? like a totally made up thing that is fake, somehow gives a sense of justice and satisfaction? is it something about imagining it happening in reality, or what? for me, if I see that something is AI, it's like I just feel nothing. becau…

This is the whole Dhar Mann genre, which is so cringe, but it definitely tickles something in us.

Re: Gemini Omni

#66

Browser crashes while scrolling because of all the auto playing videos. Please use IntersectionObserver to pause the video when not in display.

Not to negate your experience, but seems fine on Firefox 150 on my Windows ThinkPad X1.

Re: Gemini Omni

#67

> Prompt: Make it look like the weird shape of my hand hole super zooms and magnifies the ground it's looking at in sharper quality. There's got to be a reason this is phrased so insanely, right?

Yes, if you watch the video closely you can see that the "lensing" effect only really covers a circular area—this prompt probably went through multiple iterations where the author was trying to improve it so that the shape of the hand was reflected more closely.

Re: Gemini Omni

#68
post #9

At first usage I'm not impressed. I've probably spent a couple grand on Seedance 2 to date, and I can't find anything google omni flash does better than Seedance from running a handful of samples through the system. You can find some of the videos I've made in my HN bio link.

Seedance 2 is amazing, compared with anything else American tech is producing. It does struggle with consistency like all other models.

The other problem is Seedance is heavily censored because of copyright concerns.

Re: Gemini Omni

#69
post #25
post #19

Earlier quoted context omitted.

you would watch a movie generated with the sterility of an LLM?

AI is already in a bunch of creative workflows. Just look at modern Photoshop. Selecting and hitting delete has AI infill for the background replacement. Creates can these video gen AI in various ways. There are some youtube channels of people using these in creative workflows that are really impressive, from mocap replacement, character insertion, background replacement, changing camera angle in post, animating/inse…

I do wonder how studios are working around consistent human faces, it's a problem on almost every discussion forum I have read for AI videos and not something that seems to be solved yet.

Do you have any examples of those creative workflows that have made it into Hollywood for example?

Re: Gemini Omni

#70

I'm an AI optimist. But AI video is probably the one thing that does depress me. Seeing that we can make anything visually, there's nothing that impresses me visually. I watch a video that two years ago I would've thought was really cool, and now my first thought is, "Yawn, is this AI?". Video, more than anything else, is the place where I really care if something is AI or not. If I could get a TikTok that had no AI…

You get back as much as you put in. Just like with all generative tools the quality of the output depends on the quality of input. Slapping a prompt together will only get you so far, if you want the models to generate something really striking and unique you need to get your hands dirty. Gotta break out ComfyUI and build yourself a specific workflow, once you dig deep and understand how things are put together, why and so on, you can make really amazing stuff with any generative models. But you have to pay for that experience in patience and knowledge.
Post reply on HN