Open Problems

Offline & Model-Based RL

Stabilizing Value Learning and Policy Extraction in Sparse-Reward Offline Reinforcement Learning

Effect to explainOpen
Strong candidate · 4/5 runs5 papers report this60% from 2025+

Generated automatically from the limitations stated in 5 papers (ICML, NeurIPS, ICLR), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.

The problem

Current offline reinforcement learning algorithms suffer from catastrophic training instability, late-training policy collapse, and extreme variance on sparse-reward, long-horizon tasks such as AntMaze. To achieve reported benchmark numbers, practitioners routinely resort to unprincipled workarounds, including online pre-training interactions, domain-specific hyperparameter schedules, and checkpoint selection via test-environment rollouts. Without stable training dynamics under sparse feedback, offline RL cannot be deployed in high-stakes or real-world settings where offline checkpoint selection and online environment querying are strictly prohibited.

Why it matters

Reliable, hands-off offline reinforcement learning deployments on long-horizon sparse-reward environments without requiring oracle checkpoint selection or online tuning.

Ways to approach it

Prior-work checks are free with an account. Results someone already ran are shown to everyone.

  1. 1

    Diagnostic ablation of value propagation dynamics: Systematically measure temporal-difference error propagation, critic divergence, and target value explosion across training iterations on D4RL AntMaze variants to isolate whether instability stems from out-of-distribution value overestimation, gradient norm explosion, or actor-critic policy extraction mismatch.

  2. 2

    Value regularization and conservative target filtering: Implement and evaluate spectral norm bounds, value difference penalties, or distributional critic parameterizations on standard offline benchmarks, measuring training run variance, final success rate without oracle checkpoint selection, and late-training performance degradation.

  3. 3

    Adaptive uncertainty-weighted temporal-difference updates: Design an intrinsic temporal-consistency or reward-propagation mechanism that handles long zero-reward trajectories without requiring task-specific critic pre-initialization, evaluated across sparse-reward navigation (AntMaze) and sparse manipulation (Adroit) benchmarks.

Have a different approach?

Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.

Free · 3 checks per day

Why it might fail

If the observed instability is fundamentally an insurmountable sample coverage deficit in existing static datasets rather than an algorithmic value-propagation defect, meaning no purely offline training objective can prevent value ambiguity on unvisited state transitions without active exploration.

Evidence

Each paper's own statement of the limitation, verbatim.

Nearest existing work

Related open problems

Offline & Model-Based RL

Scope to testOpen

Cross-Modality and Sim-to-Real Robustness Evaluation of Offline and Model-Based Reinforcement Learning

Current offline and model-based reinforcement learning algorithms are almost exclusively benchmarked on state-observation continuous-control locomotion tasks in simulation (e.g., standard MuJoCo suites). Because papers routinely restrict evaluations to low-dimensional proprioceptive states, the performance, sample efficiency, and stability of these algorithms remains unknown when applied to visual observations, discrete action spaces, manipulation tasks, or physical platforms. Consequently, practitioners cannot determine whether published algorithmic gains reflect genuine advancements in decision-making or overfitting to low-dimensional simulation dynamics.

Possible candidate · 3/5 runs10 papers report this50% from 2025+

Offline & Model-Based RL

Scope to testOpen

Cross-Domain Evaluation and Robustness of Offline Model-Based RL Across State-Action Representations

Offline and model-based reinforcement learning algorithms are almost universally developed, theoretically analyzed, and benchmarked exclusively on either discrete (tabular/gridworld) or continuous (continuous control) domains. Because individual methods are rarely evaluated across alternative state-action representations or stochasticity regimes, it is currently unknown whether standard conservatism mechanisms, planning rollouts, and uncertainty bounds remain robust outside their design scope. As a result, practitioners facing mixed, hybrid, or converted state-action spaces cannot anticipate failure modes or know whether existing offline RL algorithms transfer reliably.

Strong candidate · 5/5 runs8 papers report this50% from 2025+

Offline & Model-Based RL

Scope to testOpen

Empirical Robustness of Model-Based RL Across Simulator Differentiability, Parallelism, and Task Horizons

Current model-based RL and planning algorithms are developed under disjoint simulation assumptions, variously requiring fully differentiable GPU physics engines, massive parallel batch environments, or short-horizon dense rewards. Because these methods are rarely tested outside their native simulator regimes, practitioners cannot determine whether algorithms relying on analytic dynamics or extreme parallel throughput transfer to standard non-differentiable environments or long-horizon agentic tasks. This leaves the empirical boundaries and failure modes of existing model-based approaches unknown across differing simulator capabilities.

Possible candidate · 2/5 runs3 papers report this67% from 2025+
Generated automatically, not curated by hand. Automated prior-work checks catch about a third of existing work, so treat this problem as a lead to investigate.