Live data from Hacker News

Gemini Omni

deepmind.google

81–90 of 152 posts

Re: Gemini Omni

#81
post #36

In my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver. As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic." It gave me a video of where bricks suddenly…

thanks for intro to streamable

In my experience (from a couple of years ago), Streamable can be great but it's just worth checking what their current retention policy is like.

We were sharing game clips with each other and after a while realised our old clips were just gone, being deleted after 30 or 90 days or something.

Re: Gemini Omni

#82
post #50
post #38

Earlier quoted context omitted.

yeah, it's all about keeping everything grounded in reality.

But it looks so fake that I wouldn't waste time visiting a property advertised like that.

Agreed, the author surely must see and know this?

Re: Gemini Omni

#83

I think Hollywood is in for a rough era. The disruption is happening at break neck speeds.

Hollywood is already in a rough era but it’s because they can’t create original human stories any more. This tech won’t change anything.

Theres a Steve Jobs quote about this

Re: Gemini Omni

#84

I'm an AI optimist. But AI video is probably the one thing that does depress me. Seeing that we can make anything visually, there's nothing that impresses me visually. I watch a video that two years ago I would've thought was really cool, and now my first thought is, "Yawn, is this AI?". Video, more than anything else, is the place where I really care if something is AI or not. If I could get a TikTok that had no AI…

It ruined the whole category of "cute animals acting goofy" content for sure.

Yeah, I'm kinda sad about that one. Most of my friends and family are aware many of these are fake now, but argue that it still invokes the same response in us so it's okay. For me, though, however intangible or irrational it may be, I do feel a sense of loss.

Funny enough, this is actually one of the few things which has bothered me with the AI boom, and I'm mostly pro-acceleration. A lot of what's happening seems inevitable. But surprisingly, knowing that cat or dog or bird or lizard or butterfly or whatever has a strong chance of being generated really does take something out of it to my mind. And I say that also knowing the extreme amount of staging which has long gone on with traditional nature videography. Somehow, knowing the animal is real means something... I'm still trying to figure out how to better understand and express this.

Re: Gemini Omni

#85
post #74

Earlier quoted context omitted.

Was it? Hollywood has been caught lying about that to seem more authentic before. https://www.redsharknews.com/why-do-movies-still-insist-ther...

There are tons of behind the scenes pictures and video of the Rocky puppet being used on set, and Andy Weir talks in interviews about how almost no CG was used to enhance the puppet. I guess it's possible to fake all that, but it's a lot of lie to cover up.

Andy Weir is a wonderful novelist and was truthfully relating his understanding but he's not a VFX person.

I didn't see the quote you did but he probably confused the fact that PHM used physical elements in place of some CGI in certain scenes and the separate fact that a realistic physical puppet was used on set for reference. Some parts of that puppet are seen on-screen in some shots but most of the creature in most shots was CGI or CG enhanced (which looked great thanks to the ideal in-camera puppet reference it replaced). I explained more here: https://news.ycombinator.com/item?id=48198851

Re: Gemini Omni

#86
While at a cursory glance it looks as impressive as always, subtle spatial errors, and geometry that changes as it goes out of sight and comes back again hints at the fact that Google has still yet to solve the problem of deep spatial understanding.

Which considering just how pretty and detailed this whole thing looks, imo points at a fundamental issue at how these things are trained - it's as if there's no structure to its knowledge and training, like how an artist trained to draw would first try to understand simple 2d composition, then perspective, then light and shadow, mastering each concept and gradually building up a hierarchical understanding - it seems like its trying to learn everything at once.

I would rather see an AI model that I could give a floorplan of a building and it would generate an accurate flythrough on any path, even if it looked like butt.

Im not just talking out of my arse, I did work for a while in data science/engineering, and one of the big lessons people needed to be reminded of is to clean/downsample the data - a dataset consisting of a million samples could very well take 1000x as long to process as if we downsampled the whole thing to just a couple of thousand samples and we could learn the same conclusions with the fraction of expended time/effort.

I'm sure there's a similar logic in RL, that if you dump a trillion samples into the datacenter that consumes the same power as a city, what the model learns is what it could've learned with a much more curated training set and directed approaches.

Re: Gemini Omni

#87
post #36

In my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver. As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic." It gave me a video of where bricks suddenly…

thanks for intro to streamable

it was the first link I got after googling free video hosting sites

Re: Gemini Omni

#88
post #50
post #38

Earlier quoted context omitted.

yeah, it's all about keeping everything grounded in reality.

But it looks so fake that I wouldn't waste time visiting a property advertised like that.

I agree, looks pretty terrible...

Re: Gemini Omni

#89
post #36

In my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver. As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic." It gave me a video of where bricks suddenly…

Totally unrelated, but what would you say the feasibility of writing simulation software for simulation of/replicating body movements during/in a martial arts technique would be?

I’ve often thought it would be very handy to have a proper simulator for being able to simulate and identify inefficiencies in one’s technique, but no idea whether it would be feasible to do.

Re: Gemini Omni

#90
What I'm hoping/waiting for is IMDB users creating alternative endings of movies.

It could make the comments section even more fun.

Post reply on HN