Performance measurement is a topic that has received considerable attention during the last decades. There are many motives for using performance measures in a company but perhaps the most crucial one is that they will help to improve productivity when used properly. Productivity is of vital importance to a company’s ability to compete and make profits over time. A company that is not able to efficiently utilise its resources in creating value for its customers will not survive in the competitive business environment of today. However, the development of fully functional and suitable performance measurement systems (i.e. set of measures) has proven to be a very challenging task. This research has focused on the last phase of the development of performance measurement system, namely the continuous updating of the performance measures, which still have not been explored in a satisfactory manner. The objective is to investigate and clarify how to evaluate and revise performance measurement systems. In order to reach this objective, several obstacles that contribute to the complexity of the research area are treated. In the beginning, the thesis thoroughly investigates the confusing terminology within the field and frequently used terms like productivity, profitability, performance, efficiency and effectiveness are explained. Then, a categorisation of ways to measure performance is presented along with advantages and shortcomings of different productivity and other performance measures. Several key-factors found to affect the productivity of a manufacturing company are also discussed, such as: design of processes and equipment, disturbances and losses, management and control, product design, and job design and work organisation. Much attention is given to the different requirements that performance measurement systems must fulfil, both on the system level and the measure level. Finally a method called the performance measurement progression map is finally proposed, which has been developed in order to give measurement practitioners a comprehensive guide of how to evaluate and revise performance measurement systems. The thesis is concluded with the results from several empirical investigations in which the usefulness of the developed method is validated. Keywords: Performance measurement, Performance measurement systems, Productivity, Evaluation / <p>QC 20161026</p>

Qualquer que seja o seu setor de atuação, porte ou origem, as organizações têm enfrentado desafios cada vez mais sérios no propósito de dar continuidade a suas atividades, preferencialmente na busca de um desempenho cada vez melhor, de modo a atingir ou ir além do que é estipulado em seus processos de planejamento. Tais organizações têm a necessidade de identificar, mensurar e avaliar esse desempenho, tornando essa mensuração um importante subsídio para a tomada de decisões mais apropriadas e efetivas, particularmente no que se refere a aspectos outrora negligenciados, como aqueles mais diretamente ligados à questão da sustentabilidade, com destaque para o reconhecimento da importância das chamadas partes interessadas (ou stakeholders), i.e, os diversos públicos que exercem algum tipo de influência na organização ou que são influenciados por ela. Este é, portanto, um dos grandes desafios para as organizações neste momento: como realizar uma apropriada mensuração do desempenho organizacional, considerando-se a necessidade de inclusão dos aspectos relativos à sustentabilidade, como a inserção de resultados finais tríplices (Triple Bottom Line) e a contemplação dos stakeholders como públicos relevantes para que os objetivos estratégicos sejam alcançados. Nesse contexto, o propósito principal deste estudo é responder à seguinte pergunta de pesquisa: Quais são as relações entre as partes interessadas (stakeholders) e os Sistemas de Mensuração de Desempenho (SMDs) das organizações?. Para tanto, pretende-se neste trabalho: (1) entender os conceitos e processos envolvidos na criação e implementação de sistemas de mensuração de desempenho que tenham como foco a sustentabilidade manifestada pelas perspectivas econômica, social e ambiental; (2) considerar-se a participação das partes interessadas e sua influência na determinação do desempenho organizacional a partir do entendimento da importância destes para as organizações; e (3) contribuir, de forma efetiva, para o desenvolvimento teórico, conceitual e prático do assunto em estudo. O referencial teórico consiste em três grandes temas: (i) origem e histórico dos conceitos sobre sustentabilidade e a sua influência nas organizações; (ii) gestão das partes interessadas e sua importância estratégica para as organizações; (iii) mensuração do desempenho organizacional, com seus principais conceitos e metodologias, principalmente considerando-se a inclusão de uma ótica de sustentabilidade. A pesquisa de campo realizada, de natureza quantitativa, é do tipo survey e contou com a participação de 149 empresas pertencentes ao setor industrial e associadas ao CIESP (Centro das Indústrias do Estado de São Paulo). Seus principais resultados apontam para a confirmação das três hipóteses da pesquisa, com correlações positivas entre a influência dos stakeholders e: o Grau de Abordagem Triple Bottom Line; o Grau de Amplitude dos SMDs; e o Grau de Uso dos SMDs. Além disso, verificou-se a prevalência dos consumidores e clientes como a categoria de stakeholders mais influente, seguidos pelos acionistas; o predomínio das dimensões financeira e de clientes na constituição dos SMDs; a concentração do uso dos SMDs para Monitoramento e Foco de Atenção; e a existência de diferenças na percepção quanto à influência dos stakeholders, dependendo tanto do porte quanto da origem do capital das empresas, além de diferenças quanto ao emprego dos indicadores da dimensão ambiental, em função especificamente da origem do capital da empresa. / No matter their size, origin or field, organizations have had to face more and more challenges on their way towards a better performance. Besides trying to reach their goals as defined in their planning process, such organizations have been required to identify, measure and evaluate their performance, turning this into a critical and important element in their decision making processes. Another relevant issue is related to whether this performance measurement process refers to aspects otherwise neglected, such as those directly related to sustainability like the inclusion of social and environmental aspects or the several potential stakeholders influence in the organization, what may require improved performance measurement, beyond what has been done in a more traditional approach. This is a major challenge for organizations nowadays: how to measure their performance, taking into consideration a triple bottom line (economic, social and environmental) approach and the inclusion of a broader stakeholders perspective, according to what has been defined as relevant. From this viewpoint, the main objective of the present research is to answer to the following question: What are the relationships among the stakeholders and the Performance Measurement Systems (PMS) established in organizations?. By doing so, this study will provide: (1) understanding of the concepts and processes embedded in the creation and implementation of performance measurement systems in organizations that are sustainability-oriented; (2) identification of the influence of the stakeholders on the performance measurement systems implementation and use; and (3) an effective contribution to the conceptual and practical aspects related to the subject. The theoretical basis includes three big areas: (i) origin and history of sustainability concepts and their influence on organizations; (ii) stakeholder theory and its importance to organizations; (iii) organizational performance measurement and its concepts and practices, including the sustainability-oriented ones. The field research is quantitative, with a survey been performed among 149 industrial companies associated to CIESP (State of Sao Paulo Industries Centre). The main results point out to the confirmation of the research hypothesis, with positive correlations among Stakeholders Influence and: the degree of Triple Bottom Line approach; the degree of scope of PMSs; and the degree of use of PMSs. The survey was also able to identify the prevalence of Consumers and Clients as the most influential category of stakeholders, followed by Shareholders; the dominance of the Finance and Client perspectives in the design of the PMSs; the incidence of PMSs use regarding Monitoring and Attention Focus; and differences in perception of stakeholders influence, according to the size and the origin of the capital of the organization, and differences regarding the use of environmental indicators, according to the origin of the capital of the firm.

Qualquer que seja o seu setor de atuação, porte ou origem, as organizações têm enfrentado desafios cada vez mais sérios no propósito de dar continuidade a suas atividades, preferencialmente na busca de um desempenho cada vez melhor, de modo a atingir ou ir além do que é estipulado em seus processos de planejamento. Tais organizações têm a necessidade de identificar, mensurar e avaliar esse desempenho, tornando essa mensuração um importante subsídio para a tomada de decisões mais apropriadas e efetivas, particularmente no que se refere a aspectos outrora negligenciados, como aqueles mais diretamente ligados à questão da sustentabilidade, com destaque para o reconhecimento da importância das chamadas partes interessadas (ou stakeholders), i.e, os diversos públicos que exercem algum tipo de influência na organização ou que são influenciados por ela. Este é, portanto, um dos grandes desafios para as organizações neste momento: como realizar uma apropriada mensuração do desempenho organizacional, considerando-se a necessidade de inclusão dos aspectos relativos à sustentabilidade, como a inserção de resultados finais tríplices (Triple Bottom Line) e a contemplação dos stakeholders como públicos relevantes para que os objetivos estratégicos sejam alcançados. Nesse contexto, o propósito principal deste estudo é responder à seguinte pergunta de pesquisa: Quais são as relações entre as partes interessadas (stakeholders) e os Sistemas de Mensuração de Desempenho (SMDs) das organizações?. Para tanto, pretende-se neste trabalho: (1) entender os conceitos e processos envolvidos na criação e implementação de sistemas de mensuração de desempenho que tenham como foco a sustentabilidade manifestada pelas perspectivas econômica, social e ambiental; (2) considerar-se a participação das partes interessadas e sua influência na determinação do desempenho organizacional a partir do entendimento da importância destes para as organizações; e (3) contribuir, de forma efetiva, para o desenvolvimento teórico, conceitual e prático do assunto em estudo. O referencial teórico consiste em três grandes temas: (i) origem e histórico dos conceitos sobre sustentabilidade e a sua influência nas organizações; (ii) gestão das partes interessadas e sua importância estratégica para as organizações; (iii) mensuração do desempenho organizacional, com seus principais conceitos e metodologias, principalmente considerando-se a inclusão de uma ótica de sustentabilidade. A pesquisa de campo realizada, de natureza quantitativa, é do tipo survey e contou com a participação de 149 empresas pertencentes ao setor industrial e associadas ao CIESP (Centro das Indústrias do Estado de São Paulo). Seus principais resultados apontam para a confirmação das três hipóteses da pesquisa, com correlações positivas entre a influência dos stakeholders e: o Grau de Abordagem Triple Bottom Line; o Grau de Amplitude dos SMDs; e o Grau de Uso dos SMDs. Além disso, verificou-se a prevalência dos consumidores e clientes como a categoria de stakeholders mais influente, seguidos pelos acionistas; o predomínio das dimensões financeira e de clientes na constituição dos SMDs; a concentração do uso dos SMDs para Monitoramento e Foco de Atenção; e a existência de diferenças na percepção quanto à influência dos stakeholders, dependendo tanto do porte quanto da origem do capital das empresas, além de diferenças quanto ao emprego dos indicadores da dimensão ambiental, em função especificamente da origem do capital da empresa. / No matter their size, origin or field, organizations have had to face more and more challenges on their way towards a better performance. Besides trying to reach their goals as defined in their planning process, such organizations have been required to identify, measure and evaluate their performance, turning this into a critical and important element in their decision making processes. Another relevant issue is related to whether this performance measurement process refers to aspects otherwise neglected, such as those directly related to sustainability like the inclusion of social and environmental aspects or the several potential stakeholders influence in the organization, what may require improved performance measurement, beyond what has been done in a more traditional approach. This is a major challenge for organizations nowadays: how to measure their performance, taking into consideration a triple bottom line (economic, social and environmental) approach and the inclusion of a broader stakeholders perspective, according to what has been defined as relevant. From this viewpoint, the main objective of the present research is to answer to the following question: What are the relationships among the stakeholders and the Performance Measurement Systems (PMS) established in organizations?. By doing so, this study will provide: (1) understanding of the concepts and processes embedded in the creation and implementation of performance measurement systems in organizations that are sustainability-oriented; (2) identification of the influence of the stakeholders on the performance measurement systems implementation and use; and (3) an effective contribution to the conceptual and practical aspects related to the subject. The theoretical basis includes three big areas: (i) origin and history of sustainability concepts and their influence on organizations; (ii) stakeholder theory and its importance to organizations; (iii) organizational performance measurement and its concepts and practices, including the sustainability-oriented ones. The field research is quantitative, with a survey been performed among 149 industrial companies associated to CIESP (State of Sao Paulo Industries Centre). The main results point out to the confirmation of the research hypothesis, with positive correlations among Stakeholders Influence and: the degree of Triple Bottom Line approach; the degree of scope of PMSs; and the degree of use of PMSs. The survey was also able to identify the prevalence of Consumers and Clients as the most influential category of stakeholders, followed by Shareholders; the dominance of the Finance and Client perspectives in the design of the PMSs; the incidence of PMSs use regarding Monitoring and Attention Focus; and differences in perception of stakeholders influence, according to the size and the origin of the capital of the organization, and differences regarding the use of environmental indicators, according to the origin of the capital of the firm.

The overall aim of this study is to investigate the phenomenon of performance measurement in independently owned hotels in Ireland in order to understand the role of measurement in the management of the largest component of the hotel sector. The primary objectives of this study are to investigate the extent to which Irish hotel operators are utilising performance measurement techniques, to establish the rationale for the use of selected performance measures in independent hotels and to understand approaches to performance measurement in the management of independent hotels. A comprehensive investigation of existing performance management and measurement activity is provided in this study. A mixed methods approach to the research was undertaken to gather data on the phenomenon of performance measurement, allowing for a triangulation of data through multiple sources. A survey questionnaire was carried out within the hotels in Ireland followed by focus groups and indepth interviews carried out in a number of small and medium-sized hotels in Ireland. A number of key' performance measurement issues were investigated and include the rationale for performance measurement, the benefits of performance measurement, those responsible for carrying out the function, critical success factors impacting on the business and performance dimensions and measures utilised by hotel operators in the study. The findings of this research have implications for a number of stakeholders, however, the greatest impact will be on the small and medium-sized hotel operator. The research shows there is a need for these hotel operators to adopt a more structured formal approach to performance measurement. A number of models of performance measurement for small, medium-size and large hotels are proposed. These models will contribute to the management of performance in the hotel sector in Ireland, leading to increased effectiveness which is especially important in the current economic climate that the hotel and tourism sector is facing and will face into the future.

The growing attention of scientists and practitioners towards the issues of performance measurement encourage to analyze actualities of performance measurement as individual object of management. It becomes relevant to analyze what performance measurement system must be in order to ensure for the organizations operating in the changing environment the multidimensional performance measurement and usage of measurement results for the management of organization. In dissertation concepts of performance measurement, its relation to management, different approaches towards performance measurement are analyzed, review and comparative analysis of different performance measurement systems is done, directions of development of performance measurement systems are formulated, problems involved in selection among different performance measurement systems are analyzed. Findings of the empirical research assessing the need for multidimensional performance measurement in Lithuanian business organizations are presented. Depending on the need for formation of the multidimensional performance measurement system at both theoretical and practical level, the multidimensional performance measurement system is being designed defining its functions, measurement elements and processes. With the purpose of practical implementation of the multidimensional performance measurement system, stages of formation of the multidimensional performance measurement system and particular means for its implementation... [to full text] / Didėjantis mokslininkų ir praktikų dėmesys organizacijos veiklos vertinimo problematikai skatina nagrinėti organizacijos veiklos vertinimo, kaip vadybos tyrimų objekto, aktualijas. Aktualu tampa nagrinėti, kokia turi būti organizacijos veiklos vertinimo sistema, kuri, organizacijoms vykdant veiklą kintančioje aplinkoje, užtikrintų kompleksinį organizacijos veiklos vertinimą ir panaudotų vertinimo rezultatus organizacijos valdyme. Disertacijoje nagrinėjamos organizacijos veiklos vertinimo sampratos, vertinimo ryšys su organizacijos valdymu, požiūriai į organizacijos veiklos vertinimą, atliekama organizacijos veiklos vertinimo sistemų apžvalga ir palyginamoji analizė, formuluojamos organizacijos veiklos vertinimo sistemų vystymo kryptys, analizuojamos organizacijos veiklos vertinimo sistemos pasirinkimo problemos. Atlikus empirinį tyrimą, kuriuo siekiama nustatyti kompleksinio organizacijos veiklos vertinimo poreikį Lietuvos verslo organizacijose, pateikiami rezultatai. Atsižvelgiant į kompleksinio organizacijos veiklos vertinimo sistemos formavimo teorinį ir praktinį poreikį, kuriama kompleksinio organizacijos veiklos vertinimo sistema, apibrėžianti sistemos funkcijas, vertinimo elementus ir procesus. Kompleksinio organizacijos veiklos vertinimo sistemos praktinio įgyvendinimo tikslais nustatomi kompleksinio organizacijos veiklos vertinimo sistemos formavimo etapai ir kuriamos konkrečios priemonės kiekvieno etapo įgyvendinimui. Siekiant patvirtinti pateiktų pasiūlymų tinkamumą... [toliau žr. visą tekstą]

Title: Collaborative Supply Chain Performance Measurement Systems. A multiple case study on the OTD-process of manufacturing SMEs in the Swedish lighting industry. Authors: Arvid Svensson, Frida Gustafsson and Julien Guillaume. Background: Even though the multiple stated benefits of Supply Chain Performance Measurement Systems (SCPMS) to enhance the collaboration, there is a lack of research, especially regarding the presence among Small and Medium-sized Enterprises (SME). Closely associated with the presence of a SCPMS are the challenges. Research on SCPMS and the accompanied challenges have been made in multiple fields and contexts. Yet, SCPMS in the Order to Delivery (OTD)-process between a SME lighting manufacturer and their key customers is missing. Purpose: The purpose of this thesis is to investigate to what level collaboration regarding SCPMS is present in the OTD-process among the cases studied as well as explain this level of collaboration by studying the challenges of SCPMS. The aim is to contribute to existing literature with an explanatory model that highlights the challenges for a highly collaborative SCPMS with their key customers. This model should also give practical contributions to the case companies. Method: A multiple case study have been conducted. Qualitative data has been gathered through semi-structured interviews. Findings and Conclusion: The findings show that the level of collaboration in the SCPMS differs from no presence at all to an almost total high presence in the cases studied. The criteria that were found in previous literature for high collaboration in the SCPMS were overall similar to the practices found in the cases. Most of the challenges found in previous research were able to explain the difference in level of collaboration in the SCPMS. The two major challenges were lack of knowledge and lack of will. Lack of knowledge was present where the will to progress was clear, while also in one case, there was not even a will to progress. Overall, the company with low level and will to progress was most likely to perceive challenges, while the company with the highest level perceived the least challenges.

Made available in DSpace on 2016-06-02T19:51:39Z (GMT). No. of bitstreams: 1 2527.pdf: 2598997 bytes, checksum: 9f4e8a6113e894b9bf182eeaee49c181 (MD5) Previous issue date: 2009-02-26 / The purpose of this essay is to investigate ways to promote an increase at the participation of employees in the development and use of the performance measurement system in an industrial goods manufacturer. Along with economical globalization, several performance measurement models begin to appear and companies in general are brought to invest in the search for the model that better fits each one s purpose. The effort is focused in the development, implementation and use of performance measurement systems. Among a number of proposed models, the one that gained more recognition worldwide was BSC. This fact itself does not guarantee the full use of the performance measurement system. Employee s participation and commitment has been an issue that deserves attention from researchers because it is an unquestionable fact that its involvement increases the performance of the individual and improves the motivation of the group. For this research it was chosen the action-research method, due to the fact of it to allow researchers to play an active role in the very reality of observed facts. The research had the support of large bibliographic studies to identify and evaluate influent factors to development and evolution of SMD. During action-research work, questionnaires were applied, interviews were conducted and thoughts were made about the adopted actions and results achieved. As a final result of field research, a better understanding of process change, skill development in the use of SMD, system management and involvement of stakeholders were achieved. Recommendations resultant of this research included managers, quality management staff and executives of the company, the development of employees, the improvement of SMD use, ownership and continuous improvement of the business. / O objetivo precípuo desta dissertação é buscar formas para aumentar a participação dos funcionários no desenvolvimento e uso do sistema de medição de desempenho em uma empresa de bens de capital. Juntamente com a globalização da economia, a partir dos anos oitenta, começaram a surgir diversos modelos e propostas de sistemas de medição de desempenho, os quais têm levado as empresas a investir na busca do modelo que melhor sirva ao propósito de cada qual. O esforço se concentra no campo do desenvolvimento, implementação e uso de sistema de medição de desempenho. Dentre os vários modelos propostos o que mais se destacou em todo o mundo foi o BSC. Este fato, per se, não garante a plenitude de utilização do sistema de medição de desempenho. O envolvimento e a participação dos funcionários é assunto que tem merecido a atenção dos pesquisadores porque é fato incontestável que seu envolvimento aumenta o desempenho do indivíduo e auxilia a motivação do grupo. Para esta pesquisa optou-se pela pesquisa-ação pelo fato de ela permitir, ao pesquisador, desempenhar um papel ativo na própria realidade dos fatos observados. O desenvolvimento desta investigação foi alicerçado em ampla revisão bibliográfica para identificar e avaliar fatores que influenciam o desenvolvimento e evolução do SMD. Para levar a bom termo o desenvolvimento da pesquisa-ação, no decorrer do trabalho foram aplicados questionários, conduzidas entrevistas e feitas reflexões sobre as ações tomadas e os resultados obtidos. Como resultado final da pesquisa de campo, foi obtido um melhor entendimento do processo de mudança, do desenvolvimento de habilidade no uso do SMD, de gestão do sistema e envolvimento dos stakeholders. As sugestões resultantes deste trabalho de pesquisa abrangeu os gerentes, o pessoal da gestão da qualidade e a alta direção da empresa, o desenvolvimento dos funcionários, a melhorias da gestão do SMD, propriedade (ownership) e melhoria contínua do desempenho do negócio.

Published Article / This paper focuses on the implementation of a labour performance measuring system at a confectionery company. The computer vision based system is based on the work sampling methodology. It consists of four cameras linked to a central computer via USB extenders. The computer uses a random function in C++ in order to determine when measurements are to be taken. OpenCV is used to track the movement of a target worker's dominant hand at a given work station. Tracking is accomplished through the use of a bandwidth colour filter. The speed of the worker's hand is used to identify whether the worker is busy, idle or out of the frame over the course of the sampling period. Data collected by the system is written into a number of text files. The stored data is then exported to a Microsoft Excel 2007 spread sheet where it is analysed and a report on the labour utilisation is generated.

Submitted in fulfilment for the requirements of the Degree of Doctor of Technology: Public Management, Durban University of Technology, 2014. / World over, police officers are tasked with the responsibility of maintaining peace and order in the society. The Swaziland Government has given the Royal Swaziland Police Service (RSPS) performance targets of reducing crime in the country by twelve percent. Over the years, the RSPS has been struggling to meet its performance targets. The research aimed to investigate job satisfaction in the RSPS. The objectives of the study included to examine the factors that influence job satisfaction within the RSPS, to explore the perceived impact of job satisfaction on performance and to make recommendations to the police management on how job satisfaction in the RSPS can be enhanced. A case study involving two administrative regions (Manzini and Hhohho) using a quantitative and qualitative research was adopted. Questionnaires were handed to 345 police officers (respondents) using a personal approach as part of the quantitative research. This showed a 100 percent response rate. The qualitative research involved conducting recorded semi-structured interviews with 10 senior police officers, which included serving and retired officers. A focus group discussion was conducted with 9 junior police officers as a form of control in the qualitative research. Data was scientifically analyzed using the Scientific Package for Social Sciences (SPSS) version 12. It enabled the researcher to describe and compare variable numerically. The findings of the study showed that the respondents perform effectively when given necessary resources. Respondents are willing to put a great deal of effort beyond of what is normally expected of them in order to make the RSPS successful. On another note, most of the respondents are generally not satisfied with the salary increases and allowances as they are not adequate to meet the increasing cost of living. The respondents expressed that not everyone is treated fairly and that promotions are not based on ability. An improvement in police officers accommodation is needed. Recommendations to improving job satisfaction in the RSPS are presented in the study. Finally, the literature reviewed and findings show that there is a significant relationship between job satisfaction and performance.

This research investigates Destination Management Organisation (DMOs) in China, and looks at their functions and their adoption of Performance Measurement Systems (PMSs). A two-stage questionnaire survey has adopted to achieve the pre-determined aims of the research. Finally, ninety-three DMOs took part in the first stage survey and thirty-four DMOs were involved in the second stage survey. The key findings from the research are as follows. (1) Irrespective of their nature and level, Chinese DMOs attached most importance to the functions of “economic-driver”, “marketing” and “coordination & collaboration”. (2) DMOs attached a second level of importance to the functions of “operator”, “administrator”, “statistics” and “training”; however, particularly at municipality and city levels; also Chinese public DMOs paid more attention to these aspects. (3) Chinese public DMOs, particularly at provincial and city level, placed more emphasis on the functions of “regulator” and “legitimacy”. (4) Chinese higher-level public DMOs paid less attention to the function of “public awareness”, “funding” and “international relations”, however they did performed much better than non-public lower-level DMOs to these tasks. (5) Chinese governmental DMOs at higher-level, and private DMOs, were the best at adopting PMSs in their organisations. (6) The PMSs of Chinese DMOs paid greatest attention to measuring the aspects of “visitor”, “earning” and “marketing”, and medium levels of attention to the aspects of “stakeholder”, “operation” and “event”, and relatively low attention to evaluating their performance of the aspects of “employment” and “innovation” in their organisations. Finally, a refined PMS model that could be adopted by Chinese DMOs in the future was developed at the end. Based on the above findings, the refined model aimed to measure the performance of “stakeholders”, “employees” and “customers” by assessing the outcomes of the aspects of “management” and “marketing” for Chinese DMOs. The refined PMS model was developed and based on the top-down operation system that currently existed in China and was supposed to pursue every major aspect of the system for each stakeholder in the DMOs.