Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptions

Tzuf Paz-Argaman, Sayali Kulkarni, John Palowitch, Jason Baldridge, Reut Tsarfaty

פרסום מחקרי: פרק בספר / בדוח / בכנספרסום בספר כנסביקורת עמיתים

תקציר

When communicating routes in natural language, the concept of acquired spatial knowledge is crucial for geographic information retrieval (GIR) and in spatial cognitive research. However, NLP navigation studies often overlook the impact of such acquired knowledge on textual descriptions. Current navigation studies concentrate on egocentric local descriptions (e.g., 'it will be on your right') that require reasoning over the agent's local perception. These instructions are typically given as a sequence of steps, with each action-step explicitly mentioning and being followed by a landmark that the agent can use to verify they are on the right path (e.g., 'turn right and then you will see...'). In contrast, descriptions based on knowledge acquired through a map provide a complete view of the environment and capture its overall structure. These instructions (e.g., 'it is south of Central Park and a block north of a police station') are typically non-sequential, contain allocentric relations, with multiple spatial relations and implicit actions, without any explicit verification. This paper introduces the Rendezvous (RVS) task and dataset, which includes 10, 404 examples of English geospatial instructions for reaching a target location using map-knowledge. Our analysis reveals that RVS exhibits a richer use of spatial allocentric relations, and requires resolving more spatial relations simultaneously compared to previous text-based navigation benchmarks.

שפה מקוריתאנגלית
כותר פרסום המארחEACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference
עורכיםYvette Graham, Matthew Purver, Matthew Purver
מוציא לאורAssociation for Computational Linguistics (ACL)
עמודים1026-1040
מספר עמודים15
מסת"ב (אלקטרוני)9798891760882
סטטוס פרסוםפורסם - 2024
פורסם באופן חיצוניכן
אירוע18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024 - St. Julian�s, מלטה
משך הזמן: 17 מרץ 202422 מרץ 2024

סדרות פרסומים

שםEACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference
כרך1

כנס

כנס18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024
מדינה/אזורמלטה
עירSt. Julian�s
תקופה17/03/2422/03/24

הערה ביבליוגרפית

Publisher Copyright:
© 2024 Association for Computational Linguistics.

טביעת אצבע

להלן מוצגים תחומי המחקר של הפרסום 'Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptions'. יחד הם יוצרים טביעת אצבע ייחודית.

פורמט ציטוט ביבליוגרפי