Scientific ML: PDEs & Neural Operators
Systematic Generalisation and Robustness Evaluation of Neural Operators in 3D PDE Systems
Generated automatically from the limitations stated in 6 papers (NeurIPS, ICLR, ICML), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.
The problem
Current neural operator architectures are evaluated almost exclusively on 2D planar domains, leaving their predictive accuracy and robustness in 3D systems completely unmeasured. Without multi-dimensional benchmarks and controlled cross-dimensional studies, it is unknown whether empirical performance, discretization invariance, and error characteristics observed in 2D transfer to three-dimensional physical systems. Consequently, researchers and practitioners cannot determine whether 2D results provide reliable evidence for full 3D simulation tasks.
Why it matters
Provides the first empirical ground truth on how neural operator models generalize from 2D to 3D physical systems, establishing reliable baselines for high-dimensional scientific machine learning.
Ways to approach it
Prior-work checks are free with an account. Results someone already ran are shown to everyone.
- 1
Curate a standardized suite of paired 2D and 3D PDE benchmarks (such as Navier-Stokes, Poisson, and wave propagation problems) with comparable boundary condition variability, measuring relative $L_2$ error, training stability, and sample efficiency across leading neural operator models (e.g., FNO, DeepONet, and message-passing neural operators).
- 2
Measure compute, memory footprint, and scaling trade-offs as spatial discretization extends from 2D slices to 3D volumes, evaluating whether standard architectural parameterizations maintain their representational capacity under constrained compute budgets.
Have a different approach?
Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.
Why it might fail
Generating and training high-resolution 3D PDE datasets may exceed available academic compute budgets, or concurrent community benchmark releases may standardize 3D evaluations before the study is complete.
Evidence
Each paper's own statement of the limitation, verbatim.
- Imposing Boundary Conditions on Neural Operators via Learned Function ExtensionsICML 2026
Experiments are limited to 2D problems; 3D evaluation is constrained by lack of benchmarks with comparable BC variability.
- RIGNO: A Graph-based Framework For Robust And Accurate Operator Learning For PDEs On Arbitrary DomainsNeurIPS 2025
Restricted to two spatial dimensions; 3D extension untested due to lack of public 3D benchmarks
- Physics-aligned field reconstruction with diffusion bridgeICLR 2025
Validation limited to 2D systems; 3D extension untested due to compute constraints.
- P$^2$C$^2$Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamicsNeurIPS 2024
Limited to 2D problems; extension to 3D systems is left as future work
- Accurate Interpolation for Scattered Data through Hierarchical Residual RefinementNeurIPS 2023
Evaluation is limited to 2D interpolation tasks; no higher-dimensional or 1D results are reported
- Learning Incompressible Fluid Dynamics from Scratch - Towards Fast, Differentiable Fluid Models that GeneralizeICLR 2021
Only 2D simulations are demonstrated; 3D extension is future work
Nearest existing work
- Beyond Regular Grids: Fourier-Based Neural Operators on Arbitrary DomainsICML 2024
- Operator Learning with Neural Fields: Tackling PDEs on General GeometriesNeurIPS 2023
- Neural Emulator Superiority: When Machine Learning for PDEs Surpasses its Training DataNeurIPS 2025
- Training Deep Surrogate Models with Large Scale Online LearningICML 2023
- DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-TrainingICML 2024
- Convolutional Neural Operators for robust and accurate learning of PDEsNeurIPS 2023
- Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential EquationsICML 2024
- EqGINO: Equivariant Geometry-Informed Fourier Neural Operators for 3D PDEsICML 2026
- Neural Green’s FunctionsNeurIPS 2025
- GNOT: A General Neural Operator Transformer for Operator LearningICML 2023
- NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform DataICML 2023
- Fourier Neural Operator for Parametric Partial Differential EquationsICLR 2021
- Domain Agnostic Fourier Neural OperatorsNeurIPS 2023
- Riesz Neural Operator for Solving Partial Differential EquationsICLR 2026
- Generic bounds on the approximation error for physics-informed (and) operator learningNeurIPS 2022