Gaussian Splatting: online and local

Gaussian splatting offers an interesting alternative to photogrammetry for specific use cases, particularly where real-time rendering, photorealistic results, and the ability to capture reflective and transparent surfaces are necessary.

There are lots of online options for Gaussian splatting, paid and unpaid. Kiri Engine seems to be a very complete suite and now has the option to make meshes out of splats,splats, for use in for instance Blender in the paid version.

For all online platforms, please be aware of your data and privacy! 

If you don't want to be reliant on external systems, you can make Gaussian splats (and photogrammetry) locally with a somewhat beefy computer.

Running Gaussian Splatting locally

Workflow in Postshot:

• Install Postshot from https://www.jawset.com/
  
• NeemMake eena video opof van hetthe object ofor despace. ruimte.You Jecan kuntimport meerderemultiple video's importerenvideos in dethe tool,software, alletaking video'sall metvideos dezelfdewith the same camera geeftwill dehave bestebetter resultatenresults.
• SleepDrag dethe video'svideos ininto Postshot
• Render. DePostshot softwaremainly draaitruns voornamelijkon opGPU. jeThe grafischerender kaart.below Op(50 eensec Nvidiavideo) 3080took duurt dit ongeveerabout 20 minminutes.
• NaAfter renderenrendering kunyou jecan hetcrop beeldthe croppenimage omto alleexclude extraall ruisthe verfuzzy vanblobs. hetFor objectthis weglook teunder filteren. Ga hiervoor rechts in het menu onder ParametersParamters - Edit in the menu on the right
• NaAfter renderrendering kunyou jecan hetexport object exporteren naar eento .ply
• OmTo teimport impoterento in anderedifferent software hebyou jewill eenneed extraa plugin nodig
  

ErThere zijnare plugins voor:for

• After Effects 
  
• Unreal (betaaldepaid plugin)
• Blender (geeftlower eenresolution, meerslightly more abstract beeld)results). Het resultaat in Blender isdoes GEENnot mesh!produce a Mesh!
• Unity 
  

Hieronder: dezelfde stoel in Postshot en Blender

Postshot	Zelfde model in Blender

Compared to local photogrammetry (RealityCapture)

We've used the same source video for a render in RealityCapture. This render took about three minutes and shows one of the problems with photogrammetry: shiny objects become invisible. You can fix this by using a polarizing filter over your lens.

In RealityCapture

.obj imported in Blender

Render with lighting in Blender

Diverse

Various tutorials gaussianon splatting:

Gaussian Splatting

importing .ply gaussian splat in Blender