Apple recently released a Gaussian splatting model that turns 2D images into immersive 3D images perfect for viewing in the AVP.
The setup isn’t totally intuitive so here are a couple of links worth checking out if you’re interested in turning your 2D images into 3D immersive imagery.
This requires a Mac to install and run the model, then a download of a Gaussian image viewer. I learned about MetalSplatter (free) from the linked tutorial thread.
If you want to get a taste of what the results will be like, there are a few sample images supplied with MetalSplatter (found here: https://apps.apple.com/us/app/metalsplatter/id6476895334 ).
Here are two links to check out. The first is a link to a Reddit thread that walks one through setup and usage, as well as shutdown and deinstallation for completeness.
The second link is to a fork of Apple’s project, which includes a single-click installer, and a web interface to handle 3DGS (3D Gaussian Splat) generation.
github.com
If nothing else, check out the sample images in MetalSplatter to see what’s happening with this research. Totally worth and totally free.
ETA: download and install going the manual route took about 20 minutes. The SHARP model is almost 3GB so be prepared to wait a minute when the model downloads.
I haven’t tried the single click route yet but may do so just for the web front end portion.
The setup isn’t totally intuitive so here are a couple of links worth checking out if you’re interested in turning your 2D images into 3D immersive imagery.
This requires a Mac to install and run the model, then a download of a Gaussian image viewer. I learned about MetalSplatter (free) from the linked tutorial thread.
If you want to get a taste of what the results will be like, there are a few sample images supplied with MetalSplatter (found here: https://apps.apple.com/us/app/metalsplatter/id6476895334 ).
Here are two links to check out. The first is a link to a Reddit thread that walks one through setup and usage, as well as shutdown and deinstallation for completeness.
The second link is to a fork of Apple’s project, which includes a single-click installer, and a web interface to handle 3DGS (3D Gaussian Splat) generation.
GitHub - cjgaspari/ml-sharp: Sharp Monocular View Synthesis in Less Than a Second
Sharp Monocular View Synthesis in Less Than a Second - cjgaspari/ml-sharp
github.com
If nothing else, check out the sample images in MetalSplatter to see what’s happening with this research. Totally worth and totally free.
ETA: download and install going the manual route took about 20 minutes. The SHARP model is almost 3GB so be prepared to wait a minute when the model downloads.
I haven’t tried the single click route yet but may do so just for the web front end portion.
Last edited: