AI with humans in mind: The importance of human behavioural considerations in AI design and adoption
Abstract
It is essential to design technology not just with security in mind but with a recognition of the essential tenets of human behaviour. Humans are the core of every societal system and designing technology without understanding the biological and psychological realities of implementing that technology is a critical error. Artificial intelligence (AI) technology is designed to mimic human thinking and decision-making so designing it with the practicalities of human cognition and trust at the forefront is essential. Applying AI to cyber security can have massive benefits. However, solutions that do not consider the human element but rather just implement new AI for the art of it tend to have troublesome consequences and clash with user behaviour. In order to affect lasting change in security operations, especially via the implementation of AI to problem-solve and increase efficiency, it is critical that the AI techniques leveraged are designed around the realities of human behaviour and psychological realities. This paper explores psychological realities such as cognitive biases, reactions to stress and crisis and implicit trust in technology, how they can be made worse if technology, especially AI technology, is not designed with those realities at the forefront and how AI can instead be built to complement human behaviour. This article is also included in The Business & Management Collection which can be accessed at https://hstalks.com/business/.
The full article is available to subscribers to the journal.
Author's Biography
Hanah-Marie Darley is now Co-Founder and Chief AI Officer at Geordie AI, the enterprise AI Agent risk management platform. In this role, Hanah is responsible for customer success, artificial intelligence (AI) expertise, product vision and thought leadership. She is a subject matter expert using her background in psychology, cyber security and intelligence analysis to interpret the ever-changing threat landscape and works with organisations globally to strategically use AI to enhance their cyber resilience. Hanah has over a decade of experience as a threat intelligence specialist and a geopolitical analyst. During her time at Darktrace, Hanah served as a leader in the Analysis Team, Strategy team, a subject matter expert, research and development (R&D) product success team and as Director of Threat Research where she created the Threat Research programme. Her work and commentary have been cited by global cyber security publications and she has spoken at major industry conferences such as London Tech Week, European Women in Tech, ManuSec Europe, Economist’s Space Economy Summit and more. Prior to Darktrace, Hanah worked in intelligence analysis for the US Government for nearly a decade. Hanah holds a bachelor’s degree in international politics from Penn State University and a master’s degree in psychology from Regent University.
