Previous studies have been made on various aspects of IT governance in public government organizations in developing countries and revealed several major issues. However, due to limited knowledge, it is unclear what IT Governance (ITG) practice is in place in public organizations. The purpose of this study is therefore to investigate the adopted IT management practices and their influence on the effectiveness of IT management in the Tanzanian public government organization. A qualitative study was done using the holistic multiple case study strategy. Data was collected using the semi-structured interview method with heads of IT in three Tanzanian public government organizations. The analysis of this study showed that senior managers involvement in IT projects, Office of CIO and the IT leadership are key ITG practices adopted in the three Tanzanian public government organizations. Senior management involvement in IT projects was found to influence knowledge sharing through collaboration between IT and business units. Furthermore, the CIO office was found to influence the organization's decision-making through direct representation to the decision-making body by a person who monitors and issues IT directives. Furthermore, IT management was found to have an influence on simplifying knowledge sharing between IT and business units, as well as monitoring IT issues and issuing IT directives in the organization. Given these findings, our study contributes knowledge into the literature on IT governance with special emphasis on governmental organizations in developing countries.