Sign in Subscribe

Back to Dmytro Spodarets

Dmytro Spodarets

Articles by Dmytro Spodarets

163 items

Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution
Box2Mask is a novel single-shot instance segmentation approach, which integrates the classical level-set evolution model into deep neural network learning to achieve accurate mask prediction with only bounding box supervision. Check the paper out!
Jan 15, 2023
Zero-Shot Text-Guided Object Generation with Dream Fields
Dream Fields can generate the geometry and color of a wide range of objects without 3D supervision. It combines neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions. Take a look!
Jan 11, 2023
Data Phoenix Digest - ISSUE 1.2023
Building a GitOps ML model registry with DVC and GTO, 10 metrics to evaluate supervised ML models, scaling ML model development with MLflow, ChatGPT and DALL·E 2 in a panel app, scalable diffusion models with transformers, NeRF-Art, ECON, InstantAvatar, DifFace, TextBox 2.0, ClimateNeRF, and more.
Jan 11, 2023
InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds
InstantAvatar is a system that can reconstruct human avatars from a monocular video within seconds, and these avatars can be animated and rendered at an interactive rate. It converges 130x faster and can be trained in minutes instead of hours, way faster than competitors.
Jan 6, 2023
Scalable Diffusion Models with Transformers
In this work, the researchers explore a new class of diffusion models based on the transformer architecture; train latent diffusion models, replacing the U-Net backbone with a transformer that operates on latent patches; and analyze the scalability of Diffusion Transformers (DiTs).
Jan 3, 2023
NeRF-Art: Text-Driven Neural Radiance Fields Stylization
Neural radiance fields (NeRF) enable high-quality novel view synthesis. Editing NeRF, however, remains challenging. In this paper, the authors present NeRF-Art, a text-guided NeRF stylization approach that manipulates the style of a pre-trained NeRF model with a single text prompt.
Dec 30, 2022
ECON: Explicit Clothed humans Obtained from Normals
ECON combines the best aspects of implicit and explicit surfaces to infer high-fidelity 3D humans, even with loose clothing or in challenging poses. ECON is more accurate than the state of the art. Perceptual studies also show that ECON’s perceived realism is better by a large margin.
Dec 27, 2022
Data Phoenix Digest - ISSUE 62
AI image generator, data versioning for ML in Airflow, the illustrated stable diffusion, into the transformer, building Airbnb categories with ML and Human-in-the-Loop, novel view synthesis with diffusion models, RANA, UDE, 3DHumanGAN, courses, books, and more.
Dec 27, 2022
3DHumanGAN: Towards Photo-realistic 3D-Aware Human Image Generation
3DHumanGAN is a 3D-aware generative adversarial network (GAN) that synthesizes images of full-body humans with consistent appearances under different view-angles and body-poses. The model is adversarially learned from a collection of web images needless of manual annotation.
Dec 26, 2022
Novel View Synthesis with Diffusion Models
3DiM is a diffusion model for 3D novel view synthesis from as few as a single image. Comparing it to the SRN ShapeNet dataset, it is clear that 3DiM's generated videos from a single view achieve much higher fidelity while being approximately 3D consistent.
Dec 23, 2022
UDE: A Unified Driving Engine for Human Motion Generation
Unified Driving Engine (UDE) is the first unified driving engine that enables generating human motion sequences from natural language or audio sequences. It can support both text-driven and audio-driven human motion generation.
Dec 21, 2022
RANA: Relightable Articulated Neural Avatars
RANA is a relightable and articulated neural avatar for the photorealistic synthesis of humans under arbitrary viewpoints, body poses, and lighting. It is a novel framework to model humans while disentangling their geometry, texture, and lighting environment from monocular RGB videos.
Dec 18, 2022