Skip to content

Tool that takes a video and creates a 3d model from it#6

Draft
calledit wants to merge 6 commits intomainfrom
video_in_2_background_3d_model
Draft

Tool that takes a video and creates a 3d model from it#6
calledit wants to merge 6 commits intomainfrom
video_in_2_background_3d_model

Conversation

@calledit
Copy link
Copy Markdown
Owner

@calledit calledit commented Mar 4, 2025

Tool that stitches together a 3D mesh baed on depth maps from various angles.

People generally use point clouds for this or KinectFusion for this. Point clouds work by give unsatisfactory results. Ans it seams like KinectFusion assumes that the depth map is more accurate than todays monocular depth maps.
Python KinectFusion

This tool just tries to stitch the models as they are.

@calledit
Copy link
Copy Markdown
Owner Author

calledit commented Mar 4, 2025

The basic functionality of the tool is done.
The one thing that is left is bridging the gap between the stitched meshes.

This would be done by walking along the edges if each stitch and connecting every two vertexes to the closest vertex on the other side of the edge, once for each side of the edge.

The big problem is tracking, the current tracking accuracy does not seam good enough to generate nice meshes. Working on improving megasam camera tracking by supplementing it with new tracking markers might solve this.

@calledit
Copy link
Copy Markdown
Owner Author

calledit commented Mar 5, 2025

Tried to move over to open3ds Tensor version...
Note: don't try that it again. That version is not done, you cant render headless on OSX you cant render without shadows at all. Nah.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant