Monitoring & Evaluation

This paper describes strategies for improving the performance of health care workers. Many factors interact to affect the quality of health care. The structure of the health care system, educational opportunities for health practitioners, the administrative system, the pace of change, economic conditions and the technology available may influence the ability of the existing workforce to acquire new skills and implement them in practice. Thus, a comprehensive strategy is needed if the quality of the overall system is to improve, including the development of indicators to measure progress. [author’s description]

In a single electronic platform, the WHO’s Communicable Disease Global Atlas is bringing together for analysis and comparison standardized data and statistics for infectious diseases at country, regional, and global levels. The analysis and interpretation of data are further supported through information on demography, socioeconomic conditions, and environmental factors. The database includes a category for human resources for health information. Users can download information in reports, charts and maps as well as use the mapping interface to select geographic areas of interest and creat maps of diseases, the location of health facilities and the density of health personnel by category.

This study seeks to describe the existing systems for measuring and monitoring staff performance in the clinical setting and covered public and para-statal hospitals in Ghana. [author’s description]

The tools and guidelines collected in this book will assist health program managers, policymakers, and leaders to assess the impact of HIV/AIDS on the health workforce and its capacity to deliver and scale up HIV/AIDS services. The book provides materials to help decision-makers develop a strategy to mitigate the impact of HIV/AIDS, for both a short-term emergency response and a longer-term plan to strengthen HRM systems. This compilation also includes a tool developed by the World Health Organization to help HIV/AIDS programs to achieve a more sustainable workforce appropriately trained to provide ART.

Mystery clients are trained people (usually community members) who visit program facilities in the assumed role of clients, and then report (by completing a survey or through an interview) on their experience. They might be used in an effort to avoid the bias in the service delivery process that often results from having service transactions observed. Mystery clients can also serve to gather a sufficient number of observations of service transactions when the actual volume of service visits is low. [publisher’s description]

World Health Statistics 2006 presents the most recent statistics since 1997 of 50 health indicators for WHO’s 192 Member States. This second edition of World Health Statistics includes an expanded set of statistics, with a particular focus on equity between and within countries. It also introduces a section with 10 highlights in global health statistics for the past year. [publisher’s description]

The report includes a chapter on Health Systems which provides key HRH statistical data.

Human Resource Development (HRD)is a very important yet very difficult component for effective health care delivery, especially in the public sector. Bureaucratic barriers, discontinuity, ineffective leadership, and lack of systematic approaches are major reasons for failures. A package of HRD strategies were introduced into Yasothon Hospital. This paper describes the detail of the implementation and evaluation of the results. [from abstract]

This paper examines the use of human resource indicators to support management-led initiatives to improve health service efficiency and effectiveness. [from abstract]

This rapid-assessment guide is designed to help users arrive at a global overview of a country’s HRH situation. The guide is designed to help users assess current HRH constraints and challenges to “scaling up” health interventions. HRH main issues include: Policy, regulation and planning; Management and performance improvement; Labour market; Education, training and research; HRH and priority health programmes; and Monitoring and evaluation. [author’s description]

Measuring, managing and improving organisational performance are key considerations for individuals and teams charged with the responsibility for leading and managing NHS organisations. These are issues that are addressed by this resource, which has been developed specifically to support managers and leaders of NHS organisations to identify and act upon signs of performance decline and failure. [from executive summary]

A Village Development Committee Orientation organized to allow representatives of different organizations to discuss and identify causes of low coverage and high drop-out in their community. Special emphasis was placed on monitoring the immunization drop-out rate of each health facility. Indicators for VDCs have improved in 2003, and Parsa District is now regarded as one of the highest performing districts in the region.

This paper evaluates structural quality of hospital care in the context of an evaluation of contracting out district hospital services in South Africa. Three contractor hospitals, run by a private company and paid by public purchasers to provide district hospital care to a rural catchment population, were matched with three adjacent public hospitals and three private hospitals serving largely insured patients. A structured instrument was used to provide a quantitative measure of structural quality. Private hospitals scored highest overall, followed by public and then contractor hospitals.

This comparative study evaluates the implementation of decentralization of health systems in three Latin American countries: Chile, Bolivia, and Colombia. In terms of the relationship between decentralization and system performance in general, the findings support the conclusion that both the die-hard detractors and the fervent advocates for decentralization are wrong. Decentralization appears to be improving some indicators of equity, such as a tendency toward similar per capita expenditures for wealthier and poorer municipalities, and to be associated with increased and more equitable per capita spending on promotion and prevention.

The objective was to examine whether decentralization has improved health system performance in the State of Ceara, north-east Brazil. Decentralization was associated with improved performance, but only for 5 of our 22 performance indicators. Moreover, in the multiple regression, decentralization explained the variance in only one performance indicator; indicators for informal management and political culture appeared to be more important influences. However, some indicators for informal management were themselves associated with decentralization but not any of the political culture indicators.

For a health district to function, referral from health centres to district hospitals is critical. In many developing countries referral systems perform well below expectations. Niger is not an exception in this matter. Beyond obvious problems of cost and access this study shows to what extent the behaviour of the health worker in its interaction with the patient can be a barrier of its own. [from abstract]

This paper examines the issues relating to self-assessment, such as the different types of self-assessment, its uses, and its validity. It also reviews the literature (largely from developed countries) that informs our knowledge of self-assessment. The paper makes recommendations for future research and concludes that while much remains to be done to assure that self-assessment has the impact it promises, it may also be less costly and easier to implement than alternatives. [from author]

This issue introduces Training Impact Evaluation (TIE), a process designed to help managers identify and strengthen the links between training and staff performance. The issue describes the benefits of conducting a Training Impact Evaluation using a team approach and takes you step-by-step through the TIE process. The issue also offers practical suggestions for collecting, analyzing, and interpreting data on trainee performance in the workplace. It concludes with suggestions for ways that managers can use the information to make recommendations to decision makers, to improve training courses, or to seek management solutions to performance problems.

What makes one training experience better than another? Effective training can help providers of family planning/reproductive health (FP/RH) services to improve their performance. This handbook summarizes the tasks that should be completed at each stage of training to ensure an effective training course.

Over the last five years, international development organizations began to modify and adapt the conventional Performance Improvement Model for use in low-resource settings. This model outlines the five key factors believed to influence performance outcomes: job expectations, performance feedback, environment and tools, motivation and incentives, and knowledge and skills. This study presents a unique exploration of how the factors affect the performance of primary reproductive health providers (nurse-midwives) in two regions of Armenia. [from abstract]

When health care workers participating in training are able to transfer their newly acquired knowledge and skills to their jobs, higher levels of performance and sustained improvements in service delivery are likely to result. A joint publication of PRIME II and JHPIEGO, Transfer of Learning uses a dynamic matrix to outline specific steps for supervisors, trainers, learners and co-workers to follow before, during and after a learning intervention to promote the transfer of learning. PRIME II has also created an interactive website based on Transfer of Learning.

Human resources (HR) constraints have been reported as one of the main barriers to achieving the 2005 global tuberculosis (TB) control targets in 18 of the 22 TB high-burden countries (HBCs); consequently we try to assess the current HR available for TB control in HBCs. A standard questionnaire designed to collect information on staff numbers, skills, training activities and current staff shortages at different health service levels was sent to national TB control programme managers in all HBCs. [From abstract]

This article describes the validation of an instrument to measure work group climate in public health organizations in developing countries. The instrument, the Work Group Climate Assessment Tool, was applied in Brazil, Mozambique, and Guinea to assess the intermediate outcomes of a program to develop leadership for performance improvement. [from abstract]

This paper reviews several theoretical perspectives to increase understanding of the key determinants of health worker performance, including theories of behavior change, diffusion of innovation, health education, and social influence. The main types of interventions that have been used to encourage health workers to perform in accordance with standards are described, and evidence from empirical research for their effectiveness is summarized. [author’s description]

This toolkit includes a collection of HRM resources and links assembled for the Global Health 2005 conference. Most of the resources are in Microsoft Word format and provide guidance on how to develop a variety of HRM documents or processes. Topics covered include supervision, hiring and recruitment, HR policies, and HIV Workplace Programs and training. [publisher’s description]

This document intends to provide a policy and strategic framework for management of health information, use of information in planning and management of health services and monitoring health sector performance. [from preface]

With the recognition that public hospitals are often productively inefficient, reforms have taken place worldwide to increase their administrative autonomy and financial responsibility. Reforms in China have been some of the most radical: the government budget for public hospitals was fixed, and hospitals had to rely on charges to fill their financing gap. Accompanying these changes was the widespread introduction of performance-related pay for hospital doctors, termed the “bonus” system. While the policy objective was to improve productivity and cost recovery, it is likely that the incentive to increase the quantity of care provided would operate regardless of whether the care was medically necessary.

This issue outlines the connections between work climate, employee motivation, and performance. It describes how managers can assess the climate in their work group and shows how they can use the results to make changes in leadership and management practices that will motivate their group to do the best work possible and improve results. [editor’s description]

This paper provides a framework for understanding the key factors that affect provider competence. Different methods for measuring competence are discussed, as are criteria for selecting measurement methods. Also, evidence from various research studies on measuring the effectiveness of different assessment techniques is presented. [author’s description]

This paper provides an overview of evidence of the effects of incentives on the performance and motivation of independent health professionals and health workers.

Using preliminary research results from 15 case studies conducted the world over we examine the prerequisites for successful introduction of performance management systems which are appropriate for developing country situations. The key message and conclusion is that it is important to measure and value staff performance, but that this requires levels of organisational management and an external policy environment that are seldom in place in a developing context.