Subscribe to Our Newsletter

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn't arrive within 3 minutes, check your spam folder.

Ok, Thanks

AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling

In their new work, AutoAvatar, researchers have made implicit avatar modeling possible for the first time. It is an autoregressive approach for modeling dynamically deforming human bodies directly from raw scans. 0:00/1× Animated 3D models of the human body are a key tool for applications ranging from virtual

Dmitry Spodarets profile image
by Dmitry Spodarets
AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling

In their new work, AutoAvatar, researchers have made implicit avatar modeling possible for the first time. It is an autoregressive approach for modeling dynamically deforming human bodies directly from raw scans.

0:00
/

Animated 3D models of the human body are a key tool for applications ranging from virtual fitting to social telepresence. AutoAvatar models body geometry implicitly -- using a signed distance field (SDF) -- and can learn directly from raw scans without requiring temporal matches for control. In addition, like physics-based modeling, AutoAvatar determines the full shape of the avatar, given the history of shapes and movements.

The approach is an autoregressive model that takes a person's pose and shape history as input, and then creates an implicit surface for the future frame. The model is supervised directly with raw body scans, and requires a training dataset of 4D scans (a sequence of 3D scans) along with fitted SMPL body models.

0:00
/

Because the explicit representation of shapes as implicit surface level sets is prohibitively expensive for end-to-end training, the researchers introduced the notion of hinged observation points - vertex locations on the base articulation model - that are used as a local point to define the entire body geometry.

The base implicit surface is encoded as a field of elevations relative to the articulated observer points. These are then converted into dynamic latent feature maps in UV space and the resulting features are mapped to SDF, linking a continuous three-dimensional space with the learned features on the SMP vertices.

You can read all the details by clicking on the links below.

We also recall the equally interesting Fundamental AI Research (FAIR) study on audio data hypercompression, which shows how AI can be used to ensure that audio messages do not glitch or slow down when the Internet connection is poor.

Dmitry Spodarets profile image
by Dmitry Spodarets

Data Phoenix Digest

Subscribe to the weekly digest with a summary of the top research papers, articles, news, and our community events, to keep track of trends and grow in the Data & AI world!

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn’t arrive within 3 minutes, check your spam folder.

Ok, Thanks

Read More