Scientific ML: PDEs & Neural Operators
Semi-Supervised Neural Operator Learning for Parameter-Scarce Trajectories
Generated automatically from the limitations stated in 4 papers (ICML, CVPR, NeurIPS), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.
The problem
Existing neural operators and trajectory surrogate models for continuum mechanics require dense, ground-truth physical parameter labels for every training trajectory. In experimental and real-world physical systems, recording state trajectories is feasible, but measuring underlying continuum or constitutive parameters is often costly, destructive, or impossible. Because existing methods lack semi-supervised formulations, they cannot leverage unlabeled experimental trajectories and remain restricted to fully labeled synthetic simulations.
Why it matters
Enables learning neural operators and physics surrogates directly from real-world trajectory observations where ground-truth material or system parameters are known for only a small subset of runs.
Ways to approach it
Prior-work checks are free with an account. Results someone already ran are shown to everyone.
- 1
Implement a semi-supervised pseudo-labeling framework using an inverse model to estimate parameters on unlabeled trajectories, measuring rollout RMSE and parameter recovery error across label fractions (5% to 50%) on standard PDE and MPM trajectory benchmarks.
- 2
Design a trajectory-consistency regularization objective based on physical symmetries and temporal sub-sampling on unlabeled trajectories, measuring sample-efficiency scaling curves compared to fully supervised baselines.
- 3
Test sim-to-real adaptation by training on parameter-labeled synthetic trajectories combined with unlabeled real/experimental physical trajectories, measuring rollout prediction error on held-out physical sequences.
Have a different approach?
Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.
Why it might fail
If the mapping from state trajectories to physical parameters is severely non-unique or ill-conditioned, pseudo-labeling will amplify parameter errors and cause the forward operator's autoregressive rollouts to diverge.
Evidence
Each paper's own statement of the limitation, verbatim.
- Zebra: In-Context Generative Pretraining for Solving Parametric PDEsICML 2025
Requires a large number of training trajectories with substantial parameter-space diversity; unsuited to data-scarce regimes.
- UniPhy: Learning a Unified Constitutive Model for Inverse Physics SimulationCVPR 2025
Trained and evaluated only on simulated MPM trajectories; no real-world visual/physical data demonstrated
- RIGNO: A Graph-based Framework For Robust And Accurate Operator Learning For PDEs On Arbitrary DomainsNeurIPS 2025
Requires a large number of training samples to reach small error (e.g., 1024 trajectories), as evidenced by scaling curves; no theoretical approximation or generalization guarantees
- Disentangled Generative Models for Robust Prediction of System DynamicsICML 2023
Requires ground-truth parameter labels for every training trajectory, which is costly and mostly unavailable outside simulation; authors note semi-supervised extension is needed for real-world use
Nearest existing work
- Learning Neural Constitutive Laws from Motion Observations for Generalizable PDE DynamicsICML 2023
- Physics-informed Temporal Alignment for Auto-regressive PDE Foundation ModelsICML 2025
- Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context LearningNeurIPS 2024
- Learning Physical Operators using Neural OperatorsAISTATS 2026
- Scaling physics-informed hard constraints with mixture-of-expertsICLR 2024
- Neural Emulator Superiority: When Machine Learning for PDEs Surpasses its Training DataNeurIPS 2025
- PIED: Physics-Informed Experimental Design for Inverse ProblemsICLR 2025
- Physics-informed Reduced Order Modeling of Time-dependent PDEs via Differentiable SolversNeurIPS 2025
- Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics DiscoveryNeurIPS 2024
- Test-time Generalization for Physics through Neural Operator SplittingICML 2026
- APIC: Orthogonalized Neuro-Symbolic Modeling for Nonlinear Dissipative DynamicsICML 2026
- Discovering Nonlinear PDEs from Scarce Data with Physics-encoded LearningICLR 2022
- Characterizing possible failure modes in physics-informed neural networksNeurIPS 2021
- CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural OperatorsICLR 2026
- Operator Learning with Neural Fields: Tackling PDEs on General GeometriesNeurIPS 2023