I tried making one, but I couldn't make through the camera position tracking bit, software was super unintuitive. Very interested in gaming applications for this tech, but still waiting for it to be more approachable from a layman's point of view.
Show HN: Gaussian Splat of a Strawberry
101–110 of 211 posts
Re: Show HN: Gaussian Splat of a Strawberry
#102Just wow! As I scrolled through the website, I was even more impressed with this one though! https://superspl.at/scene/c67edb74
Beautiful and quite neat to 'walk' up into the ceiling and look down. Feels like you're either quasimodo or God, depending on how nuts you are.
Re: Show HN: Gaussian Splat of a Strawberry
#103Wow this is a time killer... ended up here: https://superspl.at/scene/ff1d0393 beautiful!
It’s amazing this runs perfectly smooth on my iPhone 12 mini That is indeed a very cool scene being about to wander around and still have decent resolution
Ah the timeless joy of falling through the floor geometry.
Seriously though - it's breathtaking.
The first guy who figures out the bridge between splats and dynamism - animation, editing, responsiveness - is going to be one of the immortals of 3d design.
Re: Show HN: Gaussian Splat of a Strawberry
#104I know feelings about AI are mixed. But when AI can dream up gaussian splats in real time, from a prompt, and do refinement as you get closer to things... That's going to be pretty bonkers.
This will be the future of a class of 3d Game. the prompt may not be text however.
An input of a kind of schematic representation of what the designer wants would be better. It may resemble a storyboard or a collection of organised notes that large projects tend to already use.
Fully generative could probably do some cool things, but people will still want to bring their peronal vision to life.
Re: Show HN: Gaussian Splat of a Strawberry
#105Also interesting: https://github.com/apple/ml-sharp
Apples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro.
It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling. But ml-sharp has 2.6 GB weights, a bit too big to run in the browser.
Re: Show HN: Gaussian Splat of a Strawberry
#106How did they decide what the inside of the strawberry looks like? Because that seems very incorrect.
Re: Show HN: Gaussian Splat of a Strawberry
#107Also interesting: https://github.com/apple/ml-sharp Apples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro. It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling . But ml-sharp has 2.6 GB we…
Any idea what kind of vram is needed to run this on Nvidia?
Re: Show HN: Gaussian Splat of a Strawberry
#108Beautiful. What I love about gaussian splats is the way they degrade - instead of a hard cutoff or LoD changing spheres into cubes etc., they get increasingly "dreamy" - the basic idea is still there, just less detailed. Take for example this scene: https://superspl.at/scene/e721ea7c If you navigate closer to the trees, things around you become blurry - as if the very fabric of reality unraveled.
its funny that sky features like clouds and blue patches end up being fit very close to ground level because there isn't a difference in perspective to cue in the algorithm that the skybox should be tall, I wonder if there is any way to incorporate the fitting algorithm with simultaneous lidar data about true distances of things to allow scenes to be viewed from further up
Re: Show HN: Gaussian Splat of a Strawberry
#109This is like a beautiful little miniature. It's cool to see gaussian splatting applied to a detailed small thing versus a big scene. I have a question about perhaps the most boring aspect of this strawberry: the license. you write, "You can download it under CC BY license, but attribution is appreciated rather than required." IANAL, but I'm pretty sure you can't license your work CC-BY and then waive the BY requireme…
I'm pretty sure it's allowed, just as saying "do what you want with it" is an informal license, it's just a little pointless.
Re: Show HN: Gaussian Splat of a Strawberry
#110Earlier quoted context omitted.
That's kinda what NERFs are (neural radience fields). They actually preceeded this Gaussian story, with Gaussians coming in and outperforming them. Maybe they'll merge later for something even better, I don't know enough about them.
Sure, but NERFs were trying to match your input photos and poses, not some arbitrary prompt, if I understand correctly.
Yes they are image generators. You want image generator generators.
A diffusion style process generating gausians instead of pixels. You could possibly do nerfs that way, but it would be effectively generating a trained network. If you managed to do that it would have broad application throughout the field of AI.