3D Printing Processes3D Scanning SevicesAM SoftwareProduct Launch

Body Labs Mush App Uses AI to Predict 3D Human Poses and Shape from Single Image

Stay up to date with everything that is happening in the wonderful world of AM via our LinkedIn community.

Body Labs, a NYC based 3D vizualization and capturing app developer, just released Mosh (click to download from the App Store), a Body Labs mobile photo experiment empowering new forms of creative expression. Mosh is the first app to use artificial intelligence to instantly detect your pose in a photo and offers a set of 3D filters that interact and react to you. This gives you the power to add stunning new 3D effects, seamlessly drape on animated outfits, and create amazing 3D environments that respond to you. With Mosh we want to empower users to create something truly magical. And we’re just getting started.

Add 3D effects

Mosh knows where your head, hands, and feet are in a photo. This enables you to automatically add 3D effects like summoning fire, transforming friends into a mythical sea creatures, and more. With gestures you can also easily control each effect while you record.

Seamlessly try on animated outfits

Use Mosh’s character creator to swipe through animated outfits that conform to you or your friends. Mix and match different styles or character features to make each one your own. Each outfit also comes with live animations to bring them to life.

3D environments that respond to you

Mosh can recognize your 3D shape to unlock environments and objects that react to you. This enables you to enhance your photos with realistic interactions that behave in response to your pose and shape.

Paint or write freely in the background

Mosh automatically separates your friends from the background enabling you to freely paint or write in front or behind them. Quickly toggle between the background and foreground to customize your masterpiece.

How the magic is made

To make Mosh possible we combined deep learning with Body Labs’ generative 3D body models. We start by predicting major joints, toes, and facial features. From this foundation, we then predict the 3D landmark locations and fit our generative 3D model called “SMPL” (Skinned Multi-Person Linear Model) to them. We do this by estimating the 3D pose and shape parameters of the model based off the 3D landmark locations as well as each landmark’s projected location in the original 2D image.

Our CNN (convolutional neural network) runs on a backend server and delivers the 3D predicted pose and shape transparently over the subject in the photo. From there we can render client-side 3D graphics locally on the iPhone inside of the Mosh app to enable the user to efficiently swipe through a series a filters without relying additionally on the server. The server is only required for the 3D pose estimation of the subject.

We see 3D body shape and pose estimation from conventional images and commoditized RGB sensors as an emerging technology. The detection, tracking, and augmentation of faces is already widely in use in an array of mobile applications. Body shape is much harder because they are highly articulated in nature, self occluding, have a wide variety of shapes, and can be obscured by clothing.

By combining deep learning with our 3D body models we address these issues and create a platform for all sorts of amazing interactions, controls, and novel 3D content. We see Mosh as just a first step towards mobile applications that augment the body for fun, games, communication, shopping, and a whole lot more.

Composites AM 2024

746 composites AM companies individually surveyed and studied. Core composites AM market generated over $785 million in 2023. Market expected to grow to $7.8 billion by 2033 at 25.8% CAGR. This new...


VoxelMatters is the online trade media portal published by 3dpbm, a leading marketing and market research firm specializing in the AM industry. 3dpbm also publishes the 3D Printing Business Directory, the AM Focus eBook series and the 3dpbm Research AM Market Reports. 3D Printing Media Network was founded with the goal to provide the latest industry news, insights and opinions to a global audience of professionals and decision makers.

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button
Close Popup
Privacy Settings saved!
Privacy Settings

When you visit any web site, it may store or retrieve information on your browser, mostly in the form of cookies. Control your personal Cookie Services here.

These cookies are necessary for the website to function and cannot be switched off in our systems.

Technical Cookies
In order to use this website we use the following technically required cookies
  • wordpress_test_cookie
  • wordpress_logged_in_
  • wordpress_sec

Decline all Services
Accept all Services


Join our 12,000+ Professional community and get weekly AM industry insights straight to your inbox. Our editor-curated newsletter equips executives, engineers, and end-users with crucial updates, helping you stay ahead.