Back to search

Virginia Tech

Toward Cybersecurity Evaluation-by-Design: Implications for Evaluation in Complex Sociotechnical Systems

Abstract

dc:description.abstract

Cybersecurity is a multifaceted, sociotechnical phenomenon shaped by the dynamic interaction of people, processes, and technologies within increasingly complex organizational environments. Evaluation plays a critical role in understanding how well organizations safeguard the confidentiality, integrity, and availability of critical assets, yet prevailing approaches continue to privilege technical performance while under-examining human and organizational dynamics. This study advances the evaluation of cybersecurity practice as a sociotechnical endeavor through an exploratory inquiry that connects extant literature with practitioner-informed framework development. A scoping review of 34 studies drawn from 1,944 records examined how people, process, and technology (PPT) are conceptualized and evaluated in contemporary cybersecurity literature. The synthesis identified three dominant interaction patterns (people-process-technology, people-technology, and people-process) and four cross-cutting themes: human-centric sociotechnical synergy; the need to re-conceptualize evaluation for cybersecurity; the opportunities and ethical tensions associated with artificial intelligence; and technology as a complement rather than a substitute for human judgment. The review revealed a paradox: while cybersecurity discourse increasingly adopts sociotechnical language, evaluation practice remains fragmented and disproportionately focused on technical performance metrics. Building on these insights, the study develops the Cybersecurity Evaluation-by-Design Framework (CEDF) and used concept mapping with practitioners from critical agriculture and life sciences organizations to operationalize it. Guided by a critical realist retroduction approach, findings reveal that practitioners view cybersecurity as a complex adaptive system requiring continuous learning, evaluative thinking, and anticipatory capacity. Practitioner-generated clusters and importance-feasibility ratings informed a dynamic baseline—akin to progress markers—for assessing evolving organizational capabilities and developmental maturity. These findings offer foundational guidance for integrated, context-sensitive cybersecurity evaluation in complex and rapidly evolving environments as well as potential applications beyond cybersecurity, such as health emergency preparedness, climate adaptation, and disaster risk management contexts.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Agricultural and Extension Education
Department dc:contributor.department
Agricultural, Leadership, and Community Education
Grantor dc:publisher
Virginia Tech
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Adeoye, Samson Olajide
Chair dc:contributor.committeechair
  • Archibald, Thomas Greig
Committee members dc:contributor.committeemember
  • Batarseh, Feras A.
  • Azab, Mohamed Mahmoud Mahmoud
  • Niewolny, Kimberly L.

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • In Copyright
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Other
vt_gsexam:45968

Chain of custody

source
Harvested from
Virginia Tech
Base URL
vtechworks.lib.vt.edu/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Adeoye, Samson Olajide. Toward Cybersecurity Evaluation-by-Design: Implications for Evaluation in Complex Sociotechnical Systems. doctoral thesis, Virginia Tech, 2026. https://hdl.handle.net/10919/143021