OpenPrint 20260805.0004v1SurveyReleased: June 29, 20263 Views

From Instruction Following to Cognitive Navigation: A Survey on the Evolution of Vision-and-Language Navigation

Kailin Lyu|Kangyi Wu|Pengna Li|Wenxuan Song|Di Wu|Jianwei He|Junting Chen|Ning Yang|Zebin Han|Kaiwen Luo|Liang Lin|Long Xiao|Xi Lin|Weigang Xue|Yongen Zhao|Kaiwen Xue|Zhiqiang Yuan|Yang Liu|WeiZhong Huang|Liwei Yang|Jinwei He|Nanxing Hu|Jinjun Wang|Ye Deng|Shaoqing Xu|Lin Zhao|Shengqian Qin|Bingheng Wang|Fan Xu|Qingyi Si|Keji He|Xudong Wang|Haoang Li|Jiaqi Peng|Hao Wu|Hao Chen|Xiaoyu Ma|Zhenghong Zhou|Zeqin Liao|Qiankun Li|Kun Wang|Ce Hao|Lianyu Hu|Dongrui Liu|Chuang Zhu|Yonggang Qi|Xingjun Ma|Hao Chen|Qing Guo|Weinan Zhang|Shanghang Zhang|Qi Li|Zhigang Zeng|Zhenan Sun|Yu-Gang Jiang|Liang Wang|Yang Liu

Abstract

Vision-and-Language Navigation (VLN) requires embodied agents to ground natural language instructions in visual perception and make navigation decisions in complex 3D environments, making it a central problem in embodied artificial intelligence. Since the introduction of the Room-to-Room (R2R) benchmark, VLN has made substantial progress. In recent years, as research settings have gradually expanded from closed and single indoor benchmark scenarios to open-world environments, the field has undergone a profound paradigm shift from passive instruction following on fixed benchmarks to autonomous cognitive navigation in open-world settings. However, existing surveys mainly organize prior work according to technical taxonomies, lacking a systematic characterization of this paradigm evolution. To address this gap, this survey proposes an evolution-centered unified analytical framework that reviews contemporary VLN research across four progressive layers: perception, cognition, learning, and generalization. It reveals the intrinsic connections and evolutionary logic among different technical lines, identifies key open challenges at each dimension, and outlines future research directions. This survey aims to provide VLN researchers with a clear panoramic view of capability evolution, while offering the broader embodied intelligence community a systematic roadmap from closed-benchmark evaluation toward trustworthy open-world deployment.

Keywords

vision-and-language navigationembodied intelligenceparadigm evolutionfoundation modelsopen-world generalization

External Source

This is an externally sourced paper. It was originally published independently.
From Instruction Following to Cognitive Navigation: A Survey on the Evolution of Vision-and-Language Navigation | OpenPrint 20260805.0004v1 — CSPaper