Hey Olli, I think the reason the render was worse at 4k (the AI generated resolution) is because the AI takes its educated guess of what it should look like in that frame, in other words the ai won’t give us an accurate 3d upscale every frame, while the 720p one was 100% accurate because that’s how it is
Hi Olli, Really enjoy your videos on photogrammetry and Nerf themes. A while ago I tried the same thing with Spidermann an Narhan Drake in Polycam. Spider turned out ok - a bit better thean yours since I used a capture card with higher Bitrate and resolution. The Drake character was a mess because the light changed as he turned - that confused the software. If I can find those clips again I‘ll try them in luma fusion. See what happens.. anyway good to see I‘m not the only one with odd ideas. Keep up the good work Kai
Nice to hear that you have also found this option that console games offers. And those trophy characters which we can found in Naughty Dog gemas are just like made for this type of scanning method. But on those trophys there are these light issues where the character statue actually moves and not the camera. Luma and 3Dpresso works best if you can move camera around the object. Fortunately these games can give great material to test many scanning methods.
This is really cool. I'm wondering if those photo modes had a way to seperate the subject from the background more... such as setting the focal length? The ideal would be if you could put them on a green screen. Also I'm thinking that none of your photo angles likely went through the fingers cleanly and so that's why they couldn't detect the gaps. Are you able to provide more than 3 angles? Are you restricted to the type of camera motion? I thought nerf allowed you to record things in a more natrual way? If you could instead scan in more of a high frequency wave form while doing a 360 around the character, surely that would produce much better coverage of all the smaller details. I also can't wait till you combine this with Gaussian Splatting and then use it to 3d print a game model!
Hey Olli, I think the reason the render was worse at 4k (the AI generated resolution) is because the AI takes its educated guess of what it should look like in that frame, in other words the ai won’t give us an accurate 3d upscale every frame, while the 720p one was 100% accurate because that’s how it is
Hi Olli,
Really enjoy your videos on photogrammetry and Nerf themes. A while ago I tried the same thing with Spidermann an Narhan Drake in Polycam. Spider turned out ok - a bit better thean yours since I used a capture card with higher Bitrate and resolution. The Drake character was a mess because the light changed as he turned - that confused the software. If I can find those clips again I‘ll try them in luma fusion. See what happens.. anyway good to see I‘m not the only one with odd ideas.
Keep up the good work
Kai
Nice to hear that you have also found this option that console games offers. And those trophy characters which we can found in Naughty Dog gemas are just like made for this type of scanning method. But on those trophys there are these light issues where the character statue actually moves and not the camera. Luma and 3Dpresso works best if you can move camera around the object. Fortunately these games can give great material to test many scanning methods.
Great experiment :))
This is really cool. I'm wondering if those photo modes had a way to seperate the subject from the background more... such as setting the focal length? The ideal would be if you could put them on a green screen.
Also I'm thinking that none of your photo angles likely went through the fingers cleanly and so that's why they couldn't detect the gaps. Are you able to provide more than 3 angles? Are you restricted to the type of camera motion? I thought nerf allowed you to record things in a more natrual way? If you could instead scan in more of a high frequency wave form while doing a 360 around the character, surely that would produce much better coverage of all the smaller details.
I also can't wait till you combine this with Gaussian Splatting and then use it to 3d print a game model!
thanks!
I think you ought to try this same thing with gaussian splatting! :)
Any idea how to do similar process with games with no photo mode like house of ashes?
Ha. I've had this idea for years.