Out-of-Distribution & Anomaly Detection
Representation Adaptation and End-to-End Learning for Anomaly Detection Beyond ImageNet Backbones
Generated automatically from the limitations stated in 4 papers (CVPR, ICLR, ECCV), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.
The problem
Modern visual anomaly and out-of-distribution (OOD) detection methods rely almost entirely on frozen feature representations extracted from ImageNet-pretrained backbones. In specialized domains such as medical imaging, industrial inspection, or scientific imaging, ImageNet features fail to encode domain-specific normal variation, capping downstream anomaly scoring accuracy. Because current pipelines do not adapt or learn backbone representations end-to-end from in-distribution data, anomaly detection is structurally unviable wherever high-quality pre-trained foundation models do not already exist.
Why it matters
Enables high-performance anomaly and OOD detection in non-natural and data-scarce domains where off-the-shelf vision foundation models lack representative semantic features.
Ways to approach it
Prior-work checks are free with an account. Results someone already ran are shown to everyone.
- 1
Benchmark parameter-efficient adaptation (e.g., LoRA, adapter layers) on pre-trained backbones using normal-only self-supervised objectives (such as masked feature reconstruction or self-distillation), measuring anomaly AUROC across non-natural image datasets (e.g., histopathology, semiconductor inspection).
- 2
Design an end-to-end representation learning objective that regularizes encoder updates against feature collapse while training exclusively on normal target data, measuring linear probe separation and anomaly detection precision/recall relative to frozen backbone baselines.
Have a different approach?
Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.
Why it might fail
If normal-only backbone fine-tuning inherently suffers representation collapse across non-contrastive objectives, or if scaled domain-specific foundation models quickly emerge that render local backbone adaptation unnecessary.
Evidence
Each paper's own statement of the limitation, verbatim.
- Intermediate Layer Classifiers for OOD generalizationICLR 2025
No fine-tuning of backbone weights is considered, so improvements are capped by the frozen pre-trained representations and do not address cases where no useful features exist at any layer
- Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly DetectionCVPR 2025
Requires strong self-supervised pretrained ViT backbones; performance tracks ImageNet linear-probing accuracy and MAE-pretrained models fail, so applicability depends on foundation model quality of the domain
- Continuous Memory Representation for Anomaly DetectionECCV 2024
Requires a pre-trained backbone and normal-only training data; performance depends on features of the encoder network rather than end-to-end learned representations
- SimpleNet: A Simple Network for Image Anomaly Detection and LocalizationCVPR 2023
Dependence on pre-trained ImageNet backbones may limit effectiveness if the target domain features are not representable by the backbone.
Nearest existing work
- Anomaly Detection Under Distribution ShiftICCV 2023
- Normal-Abnormal Guided Generalist Anomaly DetectionNeurIPS 2025
- AnomalyVFM -- Transforming Vision Foundation Models into Zero-Shot Anomaly DetectorsCVPR 2026
- Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier SynthesisECCV 2024
- PANDA: Adapting Pretrained Features for Anomaly Detection and SegmentationCVPR 2021
- Unseen Visual Anomaly GenerationCVPR 2025
- Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language ModelsCVPR 2025
- SimpleNet: A Simple Network for Image Anomaly Detection and LocalizationCVPR 2023
- One-to-Normal: Anomaly Personalization for Few-shot Anomaly DetectionNeurIPS 2024
- Rethinking Out-of-Distribution (OOD) Detection: Masked Image Modeling Is All You NeedCVPR 2023
- Learning to Detect Multi-class Anomalies with Just One Normal Image PromptECCV 2024
- VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision TransformerCVPR 2026
- Latent Outlier Exposure for Anomaly Detection with Contaminated DataICML 2022
- Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution AdaptationNeurIPS 2024
- SubspaceAD: Training-Free Few-Shot Anomaly Detection via Subspace ModelingCVPR 2026