Crowdsourcing has gained favor among many social scientists as a method for collecting data because this method is both time- and resource-efficient. The present study uses a within-subject test-retest design to evaluate the psychometric characteristics of crowdsource samples for developing and field testing measurement instruments. As evidenced by similar patterns of psychometric characteristics across time, strong test-retest reliability, and low failure rates of attention check items, the results of this study provide evidence that Amazon Mechanical Turk might represent a fruitful platform for field testing to support the development of a variety of measures. These findings, in turn, have significant implications for resource efficiency in the fields of educational and organizational measurement.

No description available.

Yes / Public and patient involvement (PPI) has been shown to have a positive impact on health and social care research. However, adequate examples describing how to operationalise effective PPI, especially in doctoral studies, are lacking. Hence, doctoral researchers new to research, or those with limited experience, can be discouraged from facilitating PPI in their research. This paper aims to describe and discuss in detail the approaches used by four doctoral researchers to incorporate PPI at different stages of their research studies from study design to disseminating findings. We aim to inform other doctoral researchers about the challenges and limitations relating to PPI that we faced. Through these, we share pragmatic recommendations for facilitating PPI during doctoral studies. The description of four case studies demonstrated that PPI could be incorporated at various stages during doctoral research. This has had a beneficial impact on our research study progression, researcher self-esteem and lastly, helped alleviate researcher isolation during doctoral studies. / Supported by Research Design Service Yorkshire and the Humber (RDSYH), the National Institute for Health Research (NIHR) Yorkshire and Humber Patient Safety Translational Research Centre (NIHR Yorkshire and Humber PSTRC). This paper presents independent research funded by NIHR under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number PB-PG-0317-20010). / Research Development Fund Publication Prize Award winner, July 2019.

Professional respondents in research panels: comparing trained and fresh members of an online panel The diploma thesis deals with the topic of changes in responding of research panel members, which are caused by their previous experience with research process. Various manifestations of this phenomenon, often labelled as the "panel conditioning effect", are described and supported by corresponding empirical evidence. The observations of panel conditioning effect come from longitudinal panel design as well as online access panels. The author proposes logically structured differentiation of the effect. Based on this categorization, several hypotheses about the differences between trained and fresh members of an Internet panel are raised and tested in dedicated online research. The results reveal significant differences between recently-registered and long-term members of the panel, both in their response strategies and in demographic structure of the groups. Yet the overall outcome do not indicate, that interviewing trained respondents would necessarily lead to lower-quality data.