Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Paper Copilot
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
CSPaper

CSPaper: review sidekick

Go to CCFDDL
Go to CSRankings
Go to OpenReview
  1. Home
  2. Peer Review in Computer Science: good, bad & broken
  3. Artificial intelligence & Machine Learning
  4. 🌊 Submission Tsunami at NeurIPS 2025: Is Peer Review About to Collapse?

🌊 Submission Tsunami at NeurIPS 2025: Is Peer Review About to Collapse?

Scheduled Pinned Locked Moved Artificial intelligence & Machine Learning
1 Posts 1 Posters 78 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • JoanneJ Offline
    JoanneJ Offline
    Joanne
    wrote last edited by
    #1

    dd54529a-df25-48c5-a46e-416154d64095-image.png

    Headline number β€” NeurIPS 2025’s main track received roughly 25,000 submissions.

    That's 60 times the submission volume of 2010, nearly triple since 2019, and a staggering compound annual growth rate (CAGR) of about 29% since 2017 (3,240 submissions).


    πŸ“Œ Why It Matters

    Pressure Point What 25,000 submissions really mean…
    Reviewer overload πŸ₯΅ 30 minutes per paper = 12,500 person hours β€” over 6 years full-time. A 2-hour review? Try 50+ person-years.
    Quality signal-to-noise πŸ“‰ Reports of rushed literature reviews, LLM rewritten old ideas, shaky benchmarks, and duplicates are up. ~20,000 papers may be rejected.
    Corporate gravity 🏒 Industry labs are driving submission growth, shifting focus toward product oriented, compute heavy research.
    Carbon cost 🌍 Reproducibility runs + thousands of flights = a large environmental footprint. Calls grow for greener workflows.

    πŸ“ˆ If Growth Continues…

    • The first 1 million submissions/year may arrive around 2040 (25,000 Γ— 1.29¹⁡ β‰ˆ 1.1M).
    • By ~2075, NeurIPS could theoretically receive one paper per human on Earth.
    • Maintaining today’s 6 paper per reviewer workload would require 20,000+ active reviewers.

    πŸ› οΈ Emerging Counter-Measures

    Symptom Experiments Underway
    Crushing review load πŸ”₯ Paid professional reviewers, AI-assisted triage, multi-stage screen-then-review pipelines
    Reproducibility gaps πŸ” Shared GPU clusters for automatic verification, stronger code/data release mandates
    Conference bloat 🎈 Rolling deadlines, and specialised sub-tracks
    Carbon footprint πŸƒ Regional hubs, default-virtual attendance, and energy disclosure in reviews

    🎯 Quick Facts to Drop in Conversation

    • 29% CAGR β†’ ~5 million submissions/year by mid-2040s if nothing changes
    • 6 full-time years just to skim this year’s submissions; 3Γ— more for deep review
    • NeurIPS was called β€œNIPS” until 2018
    • Acceptance rate has remained steady at 20 to 25% despite the submission explosion
    • Reviewer travel + GPU training now factor into AI’s carbon ledger

    🚩 Bottom Line

    The milestone of 25,000 submissions at NeurIPS 2025 is both thrilling and alarming. It highlights the global appetite for AI progress, but also exposes the strain on a volunteer-run, deadline-driven mega-conference. Unless we rethink publication and validation workflows, peer review may soon collapse under its own success.

    1 Reply Last reply
    0
    Reply
    • Reply as topic
    Log in to reply
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes


    • Login

    • Don't have an account? Register

    • Login or register to search.
    Β© 2025 CSPaper.org Sidekick of Peer Reviews
    Debating the highs and lows of peer review in computer science.
    • First post
      Last post
    0
    • Categories
    • Recent
    • Tags
    • Popular
    • World
    • Paper Copilot