The dominant view in the information systems (IS) and software engineering literature is that the application of a rigorous pre-investment evaluation methodology is the key to ensuring the selection of the best IS projects ?? that is those with the highest expected value for the organisation and with the highest probability of success. While the literature is replete with methodologies that take a narrow view of IS evaluation, there is insufficient attention given to the evaluation process itself and to what constitutes successful IS evaluation. Whilst some within IS argue that the development of more elaborate evaluation methodologies, especially calculations of costs and benefits, is necessary for the advancement of the field, many report that it is not methodologies as such that need improvement. What is missing is an understanding of IS evaluation processes in practice and how organisations can adopt and apply evaluation methodologies so as to improve these processes. This thesis aims to provide in-depth knowledge of IS evaluation processes in practice and re-conceptualise the notion of the IS project proposal, the evaluation process and evaluation methodology that reflect the needs and critical issues in practice. These aims are achieved by conducting an in-depth case study of IS project evaluation processes in a company with a history of high success rates of its IS projects ($3 billion worth of successfully delivered IS projects in the past few years). By adopting Actor-Network Theory as a philosophy, approach and theoretical lens to the investigation of IS project evaluation processes in the case company the thesis demonstrates that: a) IS project proposals are dynamic, evolving and relational entities that become ??focal?? objects around which the actor-networks of aligned interest tend to emerge; b) that the evaluation process both creates an IS project proposal and its assessment within a core actor-network within which multiple business realities are enacted and continually negotiated; c) the evaluation methodology plays an important role of an actant (a non-human actor) by acting from a periphery of the core actor-network of an IS project proposal evaluation d) the evaluation methodology acts on behalf of management to regulate communication within actor-networks, ensure that company strategy is effectively implemented and that different IS Project Proposals are consistently presented in a mutually comparable manner; e) by defining a series of processes (steps), inscription aids (inscription forms, norms and rules) and mandated checkpoints the evaluation methodology engenders the evaluation process as ??science??; f) by allowing a degree of freedom in conducting the evaluation processes the methodology is also enabling the evaluation processes to emerge as ??art?? thus stimulating creativity and innovation, and finally, g) by balancing the science and the art of IS project proposal evaluation, the methodology is enabling, assisting and inspiring numerous actors in taking on ??journeys?? of IS project proposals and evaluation and thereby making a difference in their business environments. The thesis makes important contributions to knowledge in the IS discipline. Theoretically, the adoption and use of ANT revealed that the IS Project Proposal is not dormant but rather active, and key to the IS evaluation effort. The IS Project Proposal has thus been re-conceptualised as emerging, relational and dynamic. This thesis also makes a contribution to the re-conceptualisation of the evaluation methodology as being multi-purpose and active as it defines the ??science?? and enables the ??art?? in IS evaluation. The thesis also makes a number of contributions to practice, firstly by showing that documents in IS evaluation are not simply ??outputs?? that are archived away, but are active and are used to attract the right stakeholders. Secondly, it reveals that the ultimate success of the IS Proposal relies on finding a balance between the science and the art in IS evaluation and that the evaluation methodology can play a key role in promoting this balance.
| Identifer | oai:union.ndltd.org:ADTP/257826 |
| Date | January 2008 |
| Creators | Nagm, Fouad, Information Systems, Technology & Management, Australian School of Business, UNSW |
| Publisher | Publisher:University of New South Wales. Information Systems, Technology & Management |
| Source Sets | Australiasian Digital Theses Program |
| Language | English |
| Detected Language | English |
| Rights | http://unsworks.unsw.edu.au/copyright, http://unsworks.unsw.edu.au/copyright |
Page generated in 0.0021 seconds