Make 3D models from ANYTHING (Free and Open Source)
Summary
Meta's SAM 3D is an open-source, open-weights model that converts 2D images into 3D models, offering significant utility across various applications. Available for free in Meta's SAM Playground, it features "Create 3D Scenes" for extracting and generating 3D models of objects like speakers or buildings, and "Create 3D Bodies" which accurately renders human figures and their skeletal structures from complex images. These 3D models, downloadable in PLY and GB formats, can be used for 3D printing, video games, VFX, prosthetics, and even streamline animation by automatically generating skeletons. The platform also provides manual controls, 3D effects, and style changes, making it a powerful yet "dead simple" tool for diverse creative and technical uses.
Key takeaway
Meta's free, open-source, open-weights SAM 3D empowers AI/ML professionals to rapidly generate 3D models of complex objects (e.g., White House, game characters) and accurately approximate human body skeletons from 2D images using its "Create 3D Scenes" and "Create 3D Bodies" features, significantly streamlining asset creation for 3D printing, VFX, and animation, despite potential approximations on unseen model sides.
Topics
- 2D to 3D Conversion
- Meta SAM 3D
- 3D Model Generation
- Computer Vision
- Open-Source AI
Best for: Creative Technologist, Software Engineer, General Interest
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Matthew Berman.