Open Problems

Digital Humans, Avatars & Virtual Try-On

Reducing Downstream Dependency of Garment/Avatar Generation on Upstream 2D and 3D Human-Parsing Predictions

Barrier to removePartly addressed
Possible candidate · 3/5 runs8 papers report this60% from 2025+

Generated automatically from the limitations stated in 8 papers (ICCV, CVPR), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.

The problem

Every pipeline in this space chains off-the-shelf estimators — pose keypoint detectors, DensePose, SMPL/SMPL-X fitting, segmentation/parsing models, SAM — and treats their outputs as ground truth. When these upstream predictions are noisy, fail on exaggerated poses, unusual garments, or garment-only imagery, the downstream model inherits or amplifies the errors (garment leaking, misinitialized garment geometry, failed reposing). No one measures or controls how error propagates through this preprocessing chain, so each new pipeline is brittle in its own undocumented way.

Why it matters

Garment and avatar pipelines that degrade gracefully on exaggerated poses, unusual garments, and image types the off-the-shelf estimators were never trained for, without requiring bespoke compensating steps.

Ways to approach it

Prior-work checks are free with an account. Results someone already ran are shown to everyone.

  1. 1

    Error-propagation audit: take one existing garment/avatar pipeline, inject controlled perturbations (keypoint jitter, mask erosion, SMPL mis-fit) at each preprocessing stage, and measure output degradation (garment IoU, leaking pixels, per-vertex error) to produce the first quantitative sensitivity map of where pipeline failures originate.

  2. 2

    Confidence-aware consumption of upstream predictions: augment parsing/pose outputs with per-pixel/per-joint uncertainty and train the downstream garment model to weigh or fallback on uncertain regions, measuring whether leaking and shape errors drop on perturbed and out-of-distribution inputs.

  3. 3

    Joint fine-tuning: co-train the parser and the garment generator so preprocessing adapts to downstream needs, evaluated on poses and garment types underrepresented in the original training sets.

Have a different approach?

Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.

Free · 3 checks per day

Why it might fail

The perturbation study may reveal errors are irreducibly idiosyncratic per pipeline — each fails in ways too different to share a fix — leaving only a diagnostic benchmark rather than a general remedy.

Sub-problems

  • Robust Virtual Try-On and Clothed Human Modeling Under Upstream Preprocessing Noise

    Current virtual try-on and clothed avatar pipelines rely on a brittle multi-stage preprocessing cascade comprising 2D garment parsing, SAM segmentation, and SMPL/SMPL-X body fitting. Upstream estimation errors directly propagate into the downstream generation stage, causing severe visual artifacts such as garment leakage, unnatural boundary tearing, and shape distortion. Because existing pipelines assume clean segmentation masks and accurate parametric fits, they fail completely on unconstrained real-world imagery featuring loose clothing, complex poses, or partial occlusions.

Evidence

Each paper's own statement of the limitation, verbatim.

Nearest existing work

Related open problems

Digital Humans, Avatars & Virtual Try-On

UnclassifiedPartly addressed

Overcoming Parametric 3DMM Expressiveness and Mouth Interior Bottlenecks in Monocular Facial Avatars

Neural head avatar pipelines universally rely on parametric mesh models like FLAME as geometric proxies, inheriting their topological limitations. Because FLAME lacks internal oral anatomy (teeth and tongue) and fine-grained geometric detail, avatars suffer from severe projection artifacts such as teeth textures baked directly onto lip surfaces and distorted speech articulation. Furthermore, low-dimensional linear expression spaces cap the capture of dynamic micro-expressions, dynamic wrinkles, and non-parametric regions like hair.

Possible candidate · 3/5 runs11 papers report this91% from 2025+

Digital Humans, Avatars & Virtual Try-On

Barrier to removePartly addressed

Joint Pose Refinement and Error-Tolerant Conditioning for Downstream Human Avatar Synthesis

Current avatar creation and virtual try-on pipelines treat SMPL/SMPL-X estimations, camera calibrations, and segmentation masks as fixed, ground-truth preconditions. When off-the-shelf estimators inevitably produce misaligned or out-of-distribution body parameters on in-the-wild images, these errors cascade into severe geometric distortion, stitching artifacts, and generation failure. Because existing downstream pipelines do not jointly optimize human body parameters or account for parameter uncertainty, high-fidelity human generation remains restricted to controlled studio captures with pristine initializations.

Strong candidate · 5/5 runs8 papers report this25% from 2025+

Digital Humans, Avatars & Virtual Try-On

Effect to explainPartly addressed

Benchmarking and Improving 3D Human Body Model Robustness Across Underrepresented Demographics and Non-Standard Morphologies

Existing 3D statistical body models and avatar pipelines are predominantly trained on narrow demographic subsets (such as adult European CAESAR scans) and evaluated solely on standard normative body templates. Consequently, downstream avatars and virtual try-on methods systematically produce distorted geometry, unnatural surface artifacts, and inaccurate anthropometric measurements on children, adolescents, diverse global populations, individuals with disabilities, and non-standard body proportions. Because existing benchmarks do not measure generalization across diverse body shapes, failure modes on these populations remain unquantified and unaddressed.

Possible candidate · 2/5 runs4 papers report this50% from 2025+
Generated automatically, not curated by hand. Automated prior-work checks catch about a third of existing work, so treat this problem as a lead to investigate.