π Submission Tsunami at NeurIPS 2025: Is Peer Review About to Collapse?
Artificial intelligence & Machine Learning
1
Posts
1
Posters
80
Views
-
Headline number β NeurIPS 2025βs main track received roughly 25,000 submissions.
That's 60 times the submission volume of 2010, nearly triple since 2019, and a staggering compound annual growth rate (CAGR) of about 29% since 2017 (3,240 submissions).
Why It Matters
Pressure Point What 25,000 submissions really meanβ¦ Reviewer overload π₯΅ 30 minutes per paper = 12,500 person hours β over 6 years full-time. A 2-hour review? Try 50+ person-years. Quality signal-to-noise Reports of rushed literature reviews, LLM rewritten old ideas, shaky benchmarks, and duplicates are up. ~20,000 papers may be rejected. Corporate gravity Industry labs are driving submission growth, shifting focus toward product oriented, compute heavy research. Carbon cost Reproducibility runs + thousands of flights = a large environmental footprint. Calls grow for greener workflows.
If Growth Continuesβ¦
- The first 1 million submissions/year may arrive around 2040 (25,000 Γ 1.29ΒΉβ΅ β 1.1M).
- By ~2075, NeurIPS could theoretically receive one paper per human on Earth.
- Maintaining todayβs 6 paper per reviewer workload would require 20,000+ active reviewers.
οΈ Emerging Counter-Measures
Symptom Experiments Underway Crushing review load Paid professional reviewers, AI-assisted triage, multi-stage screen-then-review pipelines Reproducibility gaps Shared GPU clusters for automatic verification, stronger code/data release mandates Conference bloat Rolling deadlines, and specialised sub-tracks Carbon footprint Regional hubs, default-virtual attendance, and energy disclosure in reviews
Quick Facts to Drop in Conversation
- 29% CAGR β ~5 million submissions/year by mid-2040s if nothing changes
- 6 full-time years just to skim this yearβs submissions; 3Γ more for deep review
- NeurIPS was called βNIPSβ until 2018
- Acceptance rate has remained steady at 20 to 25% despite the submission explosion
- Reviewer travel + GPU training now factor into AIβs carbon ledger
Bottom Line
The milestone of 25,000 submissions at NeurIPS 2025 is both thrilling and alarming. It highlights the global appetite for AI progress, but also exposes the strain on a volunteer-run, deadline-driven mega-conference. Unless we rethink publication and validation workflows, peer review may soon collapse under its own success.