Open Problems

Digital Humans, Avatars & Virtual Try-On

Joint Pose Refinement and Error-Tolerant Conditioning for Downstream Human Avatar Synthesis

Barrier to removePartly addressed
Strong candidate · 5/5 runs8 papers report this25% from 2025+

Generated automatically from the limitations stated in 8 papers (CVPR, ICCV, ECCV), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.

The problem

Current avatar creation and virtual try-on pipelines treat SMPL/SMPL-X estimations, camera calibrations, and segmentation masks as fixed, ground-truth preconditions. When off-the-shelf estimators inevitably produce misaligned or out-of-distribution body parameters on in-the-wild images, these errors cascade into severe geometric distortion, stitching artifacts, and generation failure. Because existing downstream pipelines do not jointly optimize human body parameters or account for parameter uncertainty, high-fidelity human generation remains restricted to controlled studio captures with pristine initializations.

Why it matters

Enables photorealistic digital human avatars and virtual try-on to run reliably on unconstrained monocular images and videos without requiring manual mask correction or calibrated multi-camera rigs.

Ways to approach it

Prior-work checks are free with an account. Results someone already ran are shown to everyone.

  1. 1

    Joint photometric-geometric refinement: Formulate avatar reconstruction to backpropagate rendering and perceptual losses into SMPL-X pose and camera parameters during downstream fitting rather than freezing upstream estimates, measuring surface reconstruction error (Chamfer distance, PVE) and image alignment on in-the-wild benchmarks.

  2. 2

    Uncertainty-aware conditioning for generative try-on/avatar models: Inject probabilistic pose distributions or dense vertex correspondence maps instead of rigid SMPL meshes into generation networks, measuring synthesized image fidelity (FID, LPIPS) across controlled levels of synthetic and real pose estimation noise.

  3. 3

    Iterative test-time pose adjustment via featuremetric alignment: Implement feature-space gradient descent on SMPL parameters guided by self-supervised neural rendering discrepancies, evaluating keypoint reprojection accuracy and artifact reduction across diverse lighting and occlusion conditions.

Have a different approach?

Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.

Free · 3 checks per day

Why it might fail

Foundation human mesh recovery models might improve to near-perfect pixel alignment on arbitrary in-the-wild inputs, dissolving the upstream error problem at the estimator stage before downstream refinement methods mature.

Evidence

Each paper's own statement of the limitation, verbatim.

Nearest existing work

Related open problems

Digital Humans, Avatars & Virtual Try-On

UnclassifiedPartly addressed

Overcoming Parametric 3DMM Expressiveness and Mouth Interior Bottlenecks in Monocular Facial Avatars

Neural head avatar pipelines universally rely on parametric mesh models like FLAME as geometric proxies, inheriting their topological limitations. Because FLAME lacks internal oral anatomy (teeth and tongue) and fine-grained geometric detail, avatars suffer from severe projection artifacts such as teeth textures baked directly onto lip surfaces and distorted speech articulation. Furthermore, low-dimensional linear expression spaces cap the capture of dynamic micro-expressions, dynamic wrinkles, and non-parametric regions like hair.

Possible candidate · 3/5 runs11 papers report this91% from 2025+

Digital Humans, Avatars & Virtual Try-On

Barrier to removePartly addressed

Reducing Downstream Dependency of Garment/Avatar Generation on Upstream 2D and 3D Human-Parsing Predictions

Every pipeline in this space chains off-the-shelf estimators — pose keypoint detectors, DensePose, SMPL/SMPL-X fitting, segmentation/parsing models, SAM — and treats their outputs as ground truth. When these upstream predictions are noisy, fail on exaggerated poses, unusual garments, or garment-only imagery, the downstream model inherits or amplifies the errors (garment leaking, misinitialized garment geometry, failed reposing). No one measures or controls how error propagates through this preprocessing chain, so each new pipeline is brittle in its own undocumented way.

Possible candidate · 3/5 runs8 papers report this60% from 2025+

Digital Humans, Avatars & Virtual Try-On

Effect to explainPartly addressed

Benchmarking and Improving 3D Human Body Model Robustness Across Underrepresented Demographics and Non-Standard Morphologies

Existing 3D statistical body models and avatar pipelines are predominantly trained on narrow demographic subsets (such as adult European CAESAR scans) and evaluated solely on standard normative body templates. Consequently, downstream avatars and virtual try-on methods systematically produce distorted geometry, unnatural surface artifacts, and inaccurate anthropometric measurements on children, adolescents, diverse global populations, individuals with disabilities, and non-standard body proportions. Because existing benchmarks do not measure generalization across diverse body shapes, failure modes on these populations remain unquantified and unaddressed.

Possible candidate · 2/5 runs4 papers report this50% from 2025+
Generated automatically, not curated by hand. Automated prior-work checks catch about a third of existing work, so treat this problem as a lead to investigate.