In order for the benefits of a behavior management skills training program to reach clients, caregivers must use the behavior management skills in the natural environment. The current study took place at a large residential facility for adults with disabilities, in which caregivers had received prior training in which they demonstrated behavior management skills and maintained those skills in contrived role plays. The current study represents a preliminary analysis of generalization of these skills in the natural environment; thus, a measurement system for when caregivers should demonstrate the tools was developed. The specific purpose of this study was to develop and evaluate a program to establish stimulus control over observers' measurement of appropriate behaviors. Researchers systematically developed and validated a measurement system of "good behaviors" that could be used across clients. The process of development and refinement of the measurement system is described. When the system was finalized, three observers' accuracy in using the system was assessed by comparing measured values to that of the code writer. Following feedback on individual instances of behavior, all observers scored the three target behaviors accurately. Ecological validity was assessed by surveying professionals at the facility and ecological validity results suggested a valid measurement system was developed.