Full bibliography

Design and evaluation of a global workspace agent embodied in a realistic multimodal environment

Resource type
Journal Article
Authors/contributors
Title
Design and evaluation of a global workspace agent embodied in a realistic multimodal environment
Abstract
As the apparent intelligence of artificial neural networks (ANNs) advances, they are increasingly likened to the functional networks and information processing capabilities of the human brain. Such comparisons have typically focused on particular modalities, such as vision or language. The next frontier is to use the latest advances in ANNs to design and investigate scalable models of higher-level cognitive processes, such as conscious information access, which have historically lacked concrete and specific hypotheses for scientific evaluation. In this work, we propose and then empirically assess an embodied agent with a structure based on global workspace theory (GWT) as specified in the recently proposed “indicator properties” of consciousness. In contrast to prior works on GWT which utilized single modalities, our agent is trained to navigate 3D environments based on realistic audiovisual inputs. We find that the global workspace architecture performs better and more robustly at smaller working memory sizes, as compared to a standard recurrent architecture. Beyond performance, we perform a series of analyses on the learned representations of our architecture and share findings that point to task complexity and regularization being essential for feature learning and the development of meaningful attentional patterns within the workspace.
Publication
Frontiers in Computational Neuroscience
Date
2024-6-14
Volume
18
Pages
1352685
Journal Abbr
Front. Comput. Neurosci.
Accessed
2/1/26, 9:18 AM
ISSN
1662-5188
Library Catalog
DOI.org (Crossref)
Citation
Dossa, R. F. J., Arulkumaran, K., Juliani, A., Sasai, S., & Kanai, R. (2024). Design and evaluation of a global workspace agent embodied in a realistic multimodal environment. Frontiers in Computational Neuroscience, 18, 1352685. https://doi.org/10.3389/fncom.2024.1352685