No description available.

No description available.

No description available.

Careless responders have a large impact on a study by causing issues such as Type II errors (failing to reject a false null hypothesis), which then waste researchers’ time and money. Research on careless responding has focused primarily on detecting and removing careless responders rather than on reducing careless responding before data collection begins. The purpose of the present study was to test the use of honor codes with or without the presentation of a picture of watchful eyes to increase self-awareness thereby reducing careless responding. Participants (N = 305) were randomly assigned to one of five honor code conditions (control condition, read-only condition, type condition, read-and-eyes condition, or type-and-eyes condition) and then completed a number of personality measures. Participant’s responses were screened for careless responding. I found that when participant’s only read an honor code without a picture of watchful eyes on the screen, they were significantly more likely to engage in careless responding than were people in the control condition. There was no significant difference in careless responding in the control condition compared to the other three conditions (type condition, read-and-eyes condition, or type-and-eyes condition). This finding indicates that participants being presented only with an honor code, and no other cues of moral behavior, might lead to psychological reactance (i.e., participants perceiving their freedom or control was threatened). This psychological reactance was likely due to participants feeling coerced to respond honestly by the honor code rather than participants responding honestly on their own accord. Additionally, there were no differences on participant’s responses across conditions on a number of personality measures that may be sensitive to increased self-awareness. A number of exploratory analyses were also conducted to further examine psychological reactance. The present study provides answers and possible directions to a number of useful questions that could improve data quality and reduce potential negative effects of honor codes under certain circumstances.

Survey data quality is influenced by the care and attention that respondents take in answering questions. Careless and inattentive (CI) responding is a confound in survey data that can distort findings and lead to incorrect conclusions. This quantitative study explored CI responding in job analysis studies supporting occupational certification programs and its relationship to survey features, data quality measures, and test content validity. Satisficing theory served as the framework, and secondary analysis of 3 job analysis surveys was undertaken. Results indicated that 9-33% of respondents engaged in CI responding, with the rate differing by CI index used (Mahalanobis distance, long string analysis, or person-total correlation) and by occupation. Each index detected a distinct pattern of carelessness, supporting the use of multiple indices. The indices performed best detecting carelessness in frequency ratings and may not be useful for all job analysis rating scales. Partial support was found for relationships between carelessness and survey features. CI responding had a minimal impact on mean ratings, correlations, and interrater reliability, and had no impact on certification test content outlines. By providing guidance and caution on the use of CI response detection methods with job analysis survey data, this study produced two potential avenues for social change. For practitioners conducting occupational job analyses, the use of CI detection methods can enhance the validity of data used to make certification decisions. For researchers, follow-up studies can yield a more nuanced understanding of the most appropriate use of these methods in the job analysis context.

No description available.

No description available.

No description available.

Abstract A psychological test may be defined as an objective and standardized measure of a sample of behaviour. The interpretation of test results is usually based on comparing an individual’s performance to norms based on a representative sample of the population. The present study examined the norms of popular adult tests. The validity of the Wartegg drawing test (WZT) was studied using two rating scales, the Toronto Alexithymia Scale and the Beck Depression Inventory as criterion tests. Weak to moderate correlations were found. It is concluded that the WZT has some validity in the assessment of Alexithymia. Efforts to develop a psychometrically valid and reliable method of interpreting the WZT should be continued. Cross-national and historical analyses of the norms of Wechsler’s adult intelligence scale (WAIS) were performed. The results show that the Finnish WAIS III test norms are distorted in the younger age groups. Significant cross-national and cross-generational differences in relative subtest scores, test profiles were also observed. Differences in general intelligence cannot explain such variations, and educational and cultural factors probably underlie the observed differences. It is suggested that the concept of a national IQ profile is useful for cross-national test validation studies. The validity of a validity scale, the Chapman Infrequency Scale, was studied in the context of a survey study. Results showed that careless responding is significantly more frequent among psychiatric patients relative to healthy respondents. The common procedure of excluding careless responders from final samples may affect the results of survey studies targeting individuals with psychiatric symptoms. Cut-off scores for exclusion should be flexible and chosen according to the demographic and health characteristics of the sample. In conclusion, the results of this study underscore the need for up-to-date and representative test norms for valid test interpretation. / Tiivistelmä Psykologiset testit voidaan ymmärtää otoksiksi tutkittavan käyttäytymisestä. Mittauksen tulosta tulkitaan yleensä vertaamalla sitä tavalliseen tai keskimääräiseen tulokseen eli testinormeihin. Väitöskirjatutkimus tarkastelee suosittujen aikuistestien normien pätevyyttä. Warteggin piirrostestin validiteettia aleksitymian ja depression mittarina tutkittiin käyttämällä vertailukriteerinä kahta lomaketestiä, Toronton aleksitymia-asteikkoa ja Beckin depressioasteikkoa. Mitatut korrelaatiot olivat melko matalia. Tutkimuksen johtopäätöksenä oli, että Wartegg-testi saattaa olla hyödyllinen menetelmä aleksitymian toteamisessa ja että empiiriseen tutkimukseen perustuvaa tulkintamenetelmien kehittämistä pitäisi jatkaa. Tutkimuksessa selvitettiin myös Wechslerin aikuisten älykkyystestien (WAIS) eri versioiden osatestien kansallisten normien välisiä eroja ja eroja ikäkohorttien välillä. Tulokset osoittivat, että suomalaiset WAIS III testinormit ovat vinoutuneet nuorempien ikäryhmien osalta. Tutkimuksessa havaittiin merkitseviä eroja osatestien keskiarvojen suhteissa eli testiprofiileissa eri maiden ja ikäkohorttien välillä. Kyseisiä eroja ei voida selittää älykkyyden yleisellä faktorilla, vaan niiden taustalla on luultavasti koulutukseen ja kulttuuriin liittyviä tekijöitä. Osa eroista kansallisissa testiprofiileissa näyttää olevan luonteeltaan pysyviä, ja tätä tietoa voidaan käyttää hyväksi testinormien pätevyyttä arvioitaessa. Chapmanin vastaustapa-asteikon (CIS) validiteettia tutkittiin Pohjois-Suomen vuoden 1966 syntymäkohortin kyselytutkimusaineistolla. Psykiatrisista oireista kärsivät henkilöt saivat korkeampia pistemääriä kuin terveet vastaajat. Johtopäätöksenä oli, että vastaustapamittarit voivat karsia psykiatrisia potilaita liian herkästi ulos tutkimusjoukosta, mikä voi vääristää tutkimusten tuloksia. Kriteeripistemäärän pitäisi olla joustava ja sen määrityksessä pitäisi ottaa huomioon tutkimusjoukon ominaisuudet. Tutkimukset osoittavat, että testituloksen luotettava tulkinta vaatii ajanmukaiset ja edustavaan otokseen perustuvat testinormit.