Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study

Lucy Albertella; Rebecca Kirkham; Amy B. Adler; John Crampton; Sean P.A. Drummond; Gerard J. Fogarty; James J. Gross; Leonard Zaichkowsky; Judith P. Andersen; Paul T. Bartone; Danny Boga; Jeffrey W. Bond; Tad T. Brunyé; Mark J. Campbell; Liliana G. Ciobanu; Scott R. Clark; Monique F. Crane; Arne Dietrich; Tracy J. Doty; James E. Driskell; Ivar Fahsing; Stephen M. Fiore; Rhona Flin; Joachim Funke; Justine M. Gatt; P. A. Hancock; Craig Harper; Andrew Heathcote; Kristin J. Heatown; Werner F. Helsen; Erika K. Hussey; Robin C. Jackson; Sangeet Khemlani; William D.S. Killgore; Sabina Kleitman; Andrew M. Lane; Shayne Loft; Clare MacMahon; Samuele M. Marcora; Frank P. McKenna; Carla Meijen; Vanessa Moulton; Gene M. Moyle; Eugene Nalivaiko; Donna O'Connor; Dorothea O’Conor; Debra Patton; Mark D. Piccolo; Coleman Ruiz; Linda Schücker; Ron A. Smith; Sarah J.R. Smith; Chava Sobrino; Melba Stetz; Damien Stewart; Paul Taylor; Andrew J. Tucker; Haike van Stralen; Joan N. Vickers; Troy A.W. Visser; Rohan Walker; Mark W. Wiggins; Andrew Mark Williams; Leonard Wong; Eugene Aidman; Murat Yücel

doi:10.3389/fpsyg.2022.1017675

Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study

Lucy Albertella
, Rebecca Kirkham
, Amy B. Adler
, John Crampton
, Sean P.A. Drummond
, Gerard J. Fogarty
, James J. Gross
, Leonard Zaichkowsky
, Judith P. Andersen
, Paul T. Bartone
, Danny Boga
, Jeffrey W. Bond
, Tad T. Brunyé
, Mark J. Campbell
, Liliana G. Ciobanu
, Scott R. Clark
, Monique F. Crane
, Arne Dietrich
, Tracy J. Doty
, James E. Driskell

Ivar Fahsing, Stephen M. Fiore, Rhona Flin, Joachim Funke, Justine M. Gatt, P. A. Hancock, Craig Harper, Andrew Heathcote, Kristin J. Heatown, Werner F. Helsen, Erika K. Hussey, Robin C. Jackson, Sangeet Khemlani, William D.S. Killgore, Sabina Kleitman, Andrew M. Lane, Shayne Loft, Clare MacMahon, Samuele M. Marcora, Frank P. McKenna, Carla Meijen, Vanessa Moulton, Gene M. Moyle, Eugene Nalivaiko, Donna O'Connor, Dorothea O’Conor, Debra Patton, Mark D. Piccolo, Coleman Ruiz, Linda Schücker, Ron A. Smith, Sarah J.R. Smith, Chava Sobrino, Melba Stetz, Damien Stewart, Paul Taylor, Andrew J. Tucker, Haike van Stralen, Joan N. Vickers, Troy A.W. Visser, Rohan Walker, Mark W. Wiggins, Andrew Mark Williams, Leonard Wong, Eugene Aidman, Murat Yücel

Monash University
Walter Reed Army Institute of Research
APS College of Sport and Exercise Psychologists
University of Southern Queensland
Stanford University
Boston University
University of Toronto
National Defense University
Australian Army
U.S. Army DEVCOM Analysis Center
University of Adelaide
Macquarie University
American University of Beirut
Florida Maxima Corporation
Norwegian Police University College
University of Central Florida
Robert Gordon University
Heidelberg University
University of New South Wales
Neuroscience Research Australia
University of Newcastle
United States Army Research Institute of Environmental Medicine
KU Leuven
Defense Innovation Unit
Loughborough University
Naval Research Laboratory
University of Arizona
University of Sydney
University of Wolverhampton
University of Western Australia
La Trobe University
University of Bologna
University of Reading
St Mary's University, Twickenham
Mindflex Group Ltd
Queensland University of Technology
Department of Defense
United States Department of Defense
Fire Rescue Victoria
Mission Critical Team Institute
University of Münster
Consultant
Defence Science and Technology Laboratory
NSW Institute of Sport and Diving
Room23 Psychology
Altrecht Institute for Mental Health Care
University of Calgary
Institute for Human & Machine Cognition
United States Army
Defence Science & Technology Group

Research output: Contribution to journal › Article › peer-review

Abstract

Introduction: The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure. Methods: International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance. Results: Sixty-eight experts completed the first Delphi round, with 94% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control—Performance Monitoring; (3) Arousal and Regulatory Systems—Arousal; (4) Cognitive Control—Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control—Response Selection and Inhibition/Suppression; (6) Working memory—Flexible Updating; (7) Working memory—Active Maintenance; (8) Perception and Understanding of Self—Self-knowledge; (9) Working memory—Interference Control, and (10) Expert-suggested—Shifting. Discussion: Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.

Original language	English
Article number	1017675
Journal	Frontiers in Psychology
Volume	13
DOIs	https://doi.org/10.3389/fpsyg.2022.1017675
Publication status	Published - 18 Jan 2023

Keywords

assessment
cognition
expert consensus
high performance
transdisciplinary

Access to Document

10.3389/fpsyg.2022.1017675

Cite this

Albertella, L., Kirkham, R., Adler, A. B., Crampton, J., Drummond, S. P. A., Fogarty, G. J., Gross, J. J., Zaichkowsky, L., Andersen, J. P., Bartone, P. T., Boga, D., Bond, J. W., Brunyé, T. T., Campbell, M. J., Ciobanu, L. G., Clark, S. R., Crane, M. F., Dietrich, A., Doty, T. J., ... Yücel, M. (2023). Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study. Frontiers in Psychology, 13, Article 1017675. https://doi.org/10.3389/fpsyg.2022.1017675

@article{ebed7ce7ff77460cb2e5bbd6e2e78043,

title = "Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study",

abstract = "Introduction: The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure. Methods: International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance. Results: Sixty-eight experts completed the first Delphi round, with 94\% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control—Performance Monitoring; (3) Arousal and Regulatory Systems—Arousal; (4) Cognitive Control—Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control—Response Selection and Inhibition/Suppression; (6) Working memory—Flexible Updating; (7) Working memory—Active Maintenance; (8) Perception and Understanding of Self—Self-knowledge; (9) Working memory—Interference Control, and (10) Expert-suggested—Shifting. Discussion: Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.",

keywords = "assessment, cognition, expert consensus, high performance, transdisciplinary",

author = "Lucy Albertella and Rebecca Kirkham and Adler, \{Amy B.\} and John Crampton and Drummond, \{Sean P.A.\} and Fogarty, \{Gerard J.\} and Gross, \{James J.\} and Leonard Zaichkowsky and Andersen, \{Judith P.\} and Bartone, \{Paul T.\} and Danny Boga and Bond, \{Jeffrey W.\} and Bruny{\'e}, \{Tad T.\} and Campbell, \{Mark J.\} and Ciobanu, \{Liliana G.\} and Clark, \{Scott R.\} and Crane, \{Monique F.\} and Arne Dietrich and Doty, \{Tracy J.\} and Driskell, \{James E.\} and Ivar Fahsing and Fiore, \{Stephen M.\} and Rhona Flin and Joachim Funke and Gatt, \{Justine M.\} and Hancock, \{P. A.\} and Craig Harper and Andrew Heathcote and Heatown, \{Kristin J.\} and Helsen, \{Werner F.\} and Hussey, \{Erika K.\} and Jackson, \{Robin C.\} and Sangeet Khemlani and Killgore, \{William D.S.\} and Sabina Kleitman and Lane, \{Andrew M.\} and Shayne Loft and Clare MacMahon and Marcora, \{Samuele M.\} and McKenna, \{Frank P.\} and Carla Meijen and Vanessa Moulton and Moyle, \{Gene M.\} and Eugene Nalivaiko and Donna O'Connor and Dorothea O{\textquoteright}Conor and Debra Patton and Piccolo, \{Mark D.\} and Coleman Ruiz and Linda Sch{\"u}cker and Smith, \{Ron A.\} and Smith, \{Sarah J.R.\} and Chava Sobrino and Melba Stetz and Damien Stewart and Paul Taylor and Tucker, \{Andrew J.\} and \{van Stralen\}, Haike and Vickers, \{Joan N.\} and Visser, \{Troy A.W.\} and Rohan Walker and Wiggins, \{Mark W.\} and Williams, \{Andrew Mark\} and Leonard Wong and Eugene Aidman and Murat Y{\"u}cel",

note = "Publisher Copyright: Copyright {\textcopyright} 2023 Albertella, Kirkham, Adler, Crampton, Drummond, Fogarty, Gross, Zaichkowsky, Andersen, Bartone, Boga, Bond, Bruny{\'e}, Campbell, Ciobanu, Clark, Crane, Dietrich, Doty, Driskell, Fahsing, Fiore, Flin, Funke, Gatt, Hancock, Harper, Heathcote, Heaton, Helsen, Hussey, Jackson, Khemlani, Killgore, Kleitman, Lane, Loft, MacMahon, Marcora, McKenna, Meijen, Moulton, Moyle, Nalivaiko, O{\textquoteright}Connor, O{\textquoteright}Conor, Patton, Piccolo, Ruiz, Sch{\"u}cker, Smith, Smith, Sobrino, Stetz, Stewart, Taylor, Tucker, van Stralen, Vickers, Visser, Walker, Wiggins, Williams, Wong, Aidman and Y{\"u}cel.",

year = "2023",

month = jan,

day = "18",

doi = "10.3389/fpsyg.2022.1017675",

language = "English",

volume = "13",

journal = "Frontiers in Psychology",

issn = "1664-1078",

}

Albertella, L, Kirkham, R, Adler, AB, Crampton, J, Drummond, SPA, Fogarty, GJ, Gross, JJ, Zaichkowsky, L, Andersen, JP, Bartone, PT, Boga, D, Bond, JW, Brunyé, TT, Campbell, MJ, Ciobanu, LG, Clark, SR, Crane, MF, Dietrich, A, Doty, TJ, Driskell, JE, Fahsing, I, Fiore, SM, Flin, R, Funke, J, Gatt, JM, Hancock, PA, Harper, C, Heathcote, A, Heatown, KJ, Helsen, WF, Hussey, EK, Jackson, RC, Khemlani, S, Killgore, WDS, Kleitman, S, Lane, AM, Loft, S, MacMahon, C, Marcora, SM, McKenna, FP, Meijen, C, Moulton, V, Moyle, GM, Nalivaiko, E, O'Connor, D, O’Conor, D, Patton, D, Piccolo, MD, Ruiz, C, Schücker, L, Smith, RA, Smith, SJR, Sobrino, C, Stetz, M, Stewart, D, Taylor, P, Tucker, AJ, van Stralen, H, Vickers, JN, Visser, TAW, Walker, R, Wiggins, MW, Williams, AM, Wong, L, Aidman, E & Yücel, M 2023, 'Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study', Frontiers in Psychology, vol. 13, 1017675. https://doi.org/10.3389/fpsyg.2022.1017675

TY - JOUR

T1 - Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure

T2 - An international multi-panel Delphi study

AU - Albertella, Lucy

AU - Kirkham, Rebecca

AU - Adler, Amy B.

AU - Crampton, John

AU - Drummond, Sean P.A.

AU - Fogarty, Gerard J.

AU - Gross, James J.

AU - Zaichkowsky, Leonard

AU - Andersen, Judith P.

AU - Bartone, Paul T.

AU - Boga, Danny

AU - Bond, Jeffrey W.

AU - Brunyé, Tad T.

AU - Campbell, Mark J.

AU - Ciobanu, Liliana G.

AU - Clark, Scott R.

AU - Crane, Monique F.

AU - Dietrich, Arne

AU - Doty, Tracy J.

AU - Driskell, James E.

AU - Fahsing, Ivar

AU - Fiore, Stephen M.

AU - Flin, Rhona

AU - Funke, Joachim

AU - Gatt, Justine M.

AU - Hancock, P. A.

AU - Harper, Craig

AU - Heathcote, Andrew

AU - Heatown, Kristin J.

AU - Helsen, Werner F.

AU - Hussey, Erika K.

AU - Jackson, Robin C.

AU - Khemlani, Sangeet

AU - Killgore, William D.S.

AU - Kleitman, Sabina

AU - Lane, Andrew M.

AU - Loft, Shayne

AU - MacMahon, Clare

AU - Marcora, Samuele M.

AU - McKenna, Frank P.

AU - Meijen, Carla

AU - Moulton, Vanessa

AU - Moyle, Gene M.

AU - Nalivaiko, Eugene

AU - O'Connor, Donna

AU - O’Conor, Dorothea

AU - Patton, Debra

AU - Piccolo, Mark D.

AU - Ruiz, Coleman

AU - Schücker, Linda

AU - Smith, Ron A.

AU - Smith, Sarah J.R.

AU - Sobrino, Chava

AU - Stetz, Melba

AU - Stewart, Damien

AU - Taylor, Paul

AU - Tucker, Andrew J.

AU - van Stralen, Haike

AU - Vickers, Joan N.

AU - Visser, Troy A.W.

AU - Walker, Rohan

AU - Wiggins, Mark W.

AU - Williams, Andrew Mark

AU - Wong, Leonard

AU - Aidman, Eugene

AU - Yücel, Murat

N1 - Publisher Copyright: Copyright © 2023 Albertella, Kirkham, Adler, Crampton, Drummond, Fogarty, Gross, Zaichkowsky, Andersen, Bartone, Boga, Bond, Brunyé, Campbell, Ciobanu, Clark, Crane, Dietrich, Doty, Driskell, Fahsing, Fiore, Flin, Funke, Gatt, Hancock, Harper, Heathcote, Heaton, Helsen, Hussey, Jackson, Khemlani, Killgore, Kleitman, Lane, Loft, MacMahon, Marcora, McKenna, Meijen, Moulton, Moyle, Nalivaiko, O’Connor, O’Conor, Patton, Piccolo, Ruiz, Schücker, Smith, Smith, Sobrino, Stetz, Stewart, Taylor, Tucker, van Stralen, Vickers, Visser, Walker, Wiggins, Williams, Wong, Aidman and Yücel.

PY - 2023/1/18

Y1 - 2023/1/18

N2 - Introduction: The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure. Methods: International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance. Results: Sixty-eight experts completed the first Delphi round, with 94% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control—Performance Monitoring; (3) Arousal and Regulatory Systems—Arousal; (4) Cognitive Control—Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control—Response Selection and Inhibition/Suppression; (6) Working memory—Flexible Updating; (7) Working memory—Active Maintenance; (8) Perception and Understanding of Self—Self-knowledge; (9) Working memory—Interference Control, and (10) Expert-suggested—Shifting. Discussion: Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.

AB - Introduction: The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure. Methods: International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance. Results: Sixty-eight experts completed the first Delphi round, with 94% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control—Performance Monitoring; (3) Arousal and Regulatory Systems—Arousal; (4) Cognitive Control—Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control—Response Selection and Inhibition/Suppression; (6) Working memory—Flexible Updating; (7) Working memory—Active Maintenance; (8) Perception and Understanding of Self—Self-knowledge; (9) Working memory—Interference Control, and (10) Expert-suggested—Shifting. Discussion: Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.

KW - assessment

KW - cognition

KW - expert consensus

KW - high performance

KW - transdisciplinary

UR - https://www.scopus.com/pages/publications/85147454862

U2 - 10.3389/fpsyg.2022.1017675

DO - 10.3389/fpsyg.2022.1017675

M3 - Article

AN - SCOPUS:85147454862

SN - 1664-1078

VL - 13

JO - Frontiers in Psychology

JF - Frontiers in Psychology

M1 - 1017675

ER -

Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this