The general topic of this Ph.D. thesis regards "Questionable Research Practices" (QRPs) and their effect on the replicability crisis in psychology and social sciences. QRPs are a set of bad research practices carried out to increase the likelihood of obtaining a significant result by providing some sort of manipulation of collected data. QRPs are related to the so-called replicability crisis, defined as the inability to replicate the results of an increasing number of studies. The proposed dissertation focuses on a specific form of QRPs named "Questionable Interim Analysis" (QIA). QIA implies that the data collection stopping rule depends on the previous interim analysis result. While the effect of this practice on the growth of false positive results is well known, its impact on the replicability of studies is still unclear. Furthermore, an objective tool to assess the incidence of this practice in a single study is, to our knowledge, still missing. In this project, we tried to overcome these limitations by evaluating the effects of QRPs on replication success and by proposing a formal tool to resize and control the QIA effects on statistical results. This document begins with a brief overview on the replicability crisis, QRPs, and the methods for identifying these practices in the literature (Chapter 1). Chapter 2 introduces a methodology to clarify the effect of some QRPs (cherry picking, questionable interim analyses, questionable inclusion of covariates, and questionable subgroup analyses) on replicability and determinates which replication success metric performs better in presence of these practices. The results show that the metric based on the golden sceptical p-value maintains low values of false positive replication success when QRPs are assumed. Chapter 3 presents a new probabilistic model to identify the incidence of QIA practice in the literature. It provides information about the larger or lower probability of this practice by estimating the ratio between the probability that a published result was obtained on the basis of a QIA practice or, alternatively, by a standard data collection approach. In Chapter 4, we show an application of the probabilistic models in the context of simulation studies. In particular, we illustrate how the new proposal improves some widely used simulation approaches to assess the false positive results in the context of QIA practices. Finally, in Chapter 5 the proposed models are discussed in terms of their utilities, limitations, and possible future extensions.

No description available.

This thesis provides an in-depth study of the possibilities of applying bibliometric methods to the research field of literary studies. The four articles that constitute the backbone of this thesis focus on different aspects of references and citations in literary studies: from the use of references in the text to citation patterns among 34 literature journals. The analysis covers both an Anglo-Saxon context as well as research in Swedish literary studies, and the materials used include Web of Science data, references in the Swedish literature journal TFL (Tidskrift för Litteraturvetenskap) and applications to the Swedish Research Council (Vetenskapsrådet). A study is also made of the influence of one single publication—Walter Benjamin’s Illuminations—and its impact in literary studies and in wider academia. The results from the four articles are elaborated upon using a theoretical framework that focuses on differences in the social and intellectual organization of research fields. According to these theories literary studies can be described as a fragmented, heterogenic, interdisciplinary and ‘rural’ field with a diverse audience. The fragmented and rural organization of the field is reflected in low citation frequencies as well as in the difficulties in discerning research specialities in co-citation mappings, while the analysis of the intellectual base (highly cited authors) is an example of the heterogenic and interdisciplinary character of the field, as it includes authors from many fields across the humanities and the social sciences. The thesis emphasizes that bibliometric studies of research fields in the humanities need to incorporate non-English and non-journal publications in order to produce valid and fair results. Moreover, bibliometric methods must be modified in accordance with the organization of research in a particular field, and differences in referencing practices and citation patterns ought to be considered. Consequently, it is advised that bibliometric measures for evaluating research in these fields should, if used at all, be applied with great caution. / <p>© Björn Hammarfelt 2012</p>

This thesis aims to investigate how, and under what circumstances, intimacy in grandparent-grandchild relationships is enabled, enacted and sustained in the early years of grandchildren. Previous work on emotional closeness of grandparent-grandchild relationships suggests that grandmothers and maternal grandparents are more likely to feel stronger bonds with their grandchildren, and that grandparents with a good quality of relationship with parents and living geographically close to grandchildren have greater opportunities to develop a strong emotional tie. The majority of previous research involves data on perceptions of closeness of grandparents focusing on one of their grandchildren or by young adult grandchildren reporting on closeness with a specific grandparent. In addition, qualitative research with grandparents indicates the diversity of ways they exercise agency, and involvement in the life of grandchildren, as well as gendered changes in grandfatherhood. However, there has been limited scholarly attention given to practices of intimacy, emotions and masculinities in grandparent-grandchild relationships, and the ways grandparents interpret and negotiate intimate relationships with their grandchildren amid changes in individual, familial and relational aspects over time. This study uses quantitative data to examines the extent to which individual, family and socio-structural factors influence the mothers' perception of emotional closeness of the relationship of an infant child with four types of grandparents. This is supplemented by qualitative data on grandparents' views of closeness with all their grandchildren. There is a limited scholarly literature on the relation of grandparents' lived experiences, and shared normative understandings, and a sense of being close and special to their grandchildren. The 'practices of intimacy' approach highlights the significance of practices of everyday life enacted by individuals in relation to others in building the quality of being close, and the processes through which individuals attach meaning to such practices. This approach is adopted to understand the diversity of ways grandparents interpret and do intimacy with their grandchildren. The thesis aims were achieved through a mixed methods research process combining secondary data analysis of the Growing Up in Scotland (GUS) study and in-depth interviews with 24 cases of grandparents (12 solo, either with a grandmother or grandfather, and 12 with couple). GUS maps the emotional closeness of grandchild-grandparent relationships through the grandchild's mother's perception. Analysis revealed that perceived emotional closeness was more likely if the grandparent had social contact with the mother, lived geographically close, and looked after and engaged in outings more regularly with the infant child. In general, social contact and propinquity impacted less on grandmothers, particularly maternal grandmothers, and more on paternal grandfathers. Also, looking after grandchildren on a regular basis was distinctly salient for grandmothers, whereas going more frequently on outings was more salient for grandfathers than grandmothers. As regards practices of intimacy, grandparents emphasised the importance of communication through verbal, bodily and relational forms enacted through a large variety of activities in the daily living related to forms of caring, playing and spending time together, which construct a sense of emotional closeness. The study suggests that intimate grandparent-grandchild relationships are intersected by moral understandings of 'good grandparenting', which are challenged or find contradictions in lived experiences of grandparenting that produce asymmetrical emotionalities among grandchildren, and ambivalences in relation to children and grandchildren. The study suggests that grandparents reflect on their emotionality, and enact embodied emotions, depending on relational and family circumstances, and throughout changes in the relationship with their grandchildren as they get older. The study shows that grandfathers engage in emotional forms of caring, which may challenge hegemonic masculinities, and that the relation between masculinities and practices of intimacy are troubled, particularly in the event of parental divorce.

This study addresses research reporting practices and protocols by bridging the gap from the theoretical and conceptual debates typically found in the literature with more realistic applications using data from published research. Specifically, the practice of using findings of statistical analysis as the primary, and often only, basis for results and conclusions of research is investigated through computing effect size and confidence intervals and considering how their use might impact the strength of inferences and conclusions reported. Using a sample of published manuscripts from three peer-rviewed journals, central quantitative findings were expressed as dichotomous hypothesis test results, point estimates of effect sizes and confidence intervals. Studies using three different types of statistical analyses were considered for inclusion: t-tests, regression, and Analysis of Variance (ANOVA). The differences in the substantive interpretations of results from these accomplished and published studies were then examined as a function of these different analytical approaches. Both quantitative and qualitative techniques were used to examine the findings. General descriptive statistical techniques were employed to capture the magnitude of studies and analyses that might have different interpretations if althernative methods of reporting findings were used in addition to traditional tests of statistical signficance. Qualitative methods were then used to gain a sense of the impact on the wording used in the research conclusions of these other forms of reporting findings. It was discovered that tests of non-signficant results were more prone to need evidence of effect size than those of significant results. Regardless of tests of significance, the addition of information from confidence intervals tended to heavily impact the findings resulting from signficance tests. The results were interpreted in terms of improving the reporting practices in applied research. Issues that were noted in this study relevant to the primary focus are discussed in general with implicaitons for future research. Recommendations are made regarding editorial and publishing practices, both for primary researchers and editors.

This thesis provides an in-depth study of the possibilities of applying bibliometric methods to the research field of literary studies. The four articles that constitute the backbone of this thesis focus on different aspects of references and citations in literary studies: from the use of references in the text to citation patterns among 34 literature journals. The analysis covers both an Anglo-Saxon context as well as research in Swedish literary studies, and the materials used include Web of Science data, references in the Swedish literature journal TFL (Tidskrift för Litteraturvetenskap) and applications to the Swedish Research Council (Vetenskapsrådet). A study is also made of the influence of one single publication—Walter Benjamin’s Illuminations—and its impact in literary studies and in wider academia. The results from the four articles are elaborated upon using a theoretical framework that focuses on differences in the social and intellectual organization of research fields. According to these theories literary studies can be described as a fragmented, heterogenic, interdisciplinary and ‘rural’ field with a diverse audience. The fragmented and rural organization of the field is reflected in low citation frequencies as well as in the difficulties in discerning research specialities in co-citation mappings, while the analysis of the intellectual base (highly cited authors) is an example of the heterogenic and interdisciplinary character of the field, as it includes authors from many fields across the humanities and the social sciences. The thesis emphasizes that bibliometric studies of research fields in the humanities need to incorporate non-English and non-journal publications in order to produce valid and fair results. Moreover, bibliometric methods must be modified in accordance with the organization of research in a particular field, and differences in referencing practices and citation patterns ought to be considered. Consequently, it is advised that bibliometric measures for evaluating research in these fields should, if used at all, be applied with great caution. / © Björn Hammarfelt 2012

Includes vita. / Title from PDF of title page. / Document formatted into pages; contains 223 pages. / Thesis (Ph.D.)--University of South Florida, 2003. / Includes bibliographical references. / Text (Electronic thesis) in PDF format. / ABSTRACT: This study addresses research reporting practices and protocols by bridging the gap from the theoretical and conceptual debates typically found in the literature with more realistic applications using data from published research. Specifically, the practice of using findings of statistical analysis as the primary, and often only, basis for results and conclusions of research is investigated through computing effect size and confidence intervals and considering how their use might impact the strength of inferences and conclusions reported. Using a sample of published manuscripts from three peer-rviewed journals, central quantitative findings were expressed as dichotomous hypothesis test results, point estimates of effect sizes and confidence intervals. Studies using three different types of statistical analyses were considered for inclusion: t-tests, regression, and Analysis of Variance (ANOVA). / ABSTRACT: The differences in the substantive interpretations of results from these accomplished and published studies were then examined as a function of these different analytical approaches. Both quantitative and qualitative techniques were used to examine the findings. General descriptive statistical techniques were employed to capture the magnitude of studies and analyses that might have different interpretations if althernative methods of reporting findings were used in addition to traditional tests of statistical signficance. Qualitative methods were then used to gain a sense of the impact on the wording used in the research conclusions of these other forms of reporting findings. It was discovered that tests of non-signficant results were more prone to need evidence of effect size than those of significant results. / ABSTRACT: Regardless of tests of signficance, the addition of information from confidence intervals tended to heavily impact the findings resulting from signficance tests. The results were interpreted in terms of improving the reporting practices in applied research. Issues that were noted in this study relevant to the primary focus are discussed in general with implicaitons for future research. Recommendations are made regarding editorial and publishing practices, both for primary researchers and editors. / System requirements: World Wide Web browser and PDF reader. / Mode of access: World Wide Web.

Hammarfelt, B. 2012. Following the Footnotes: A Bibliometric Analysis of Citation Patterns in Literary Studies. Department of ALM. Skrifter utgivna av Institutionen för ABM vid Uppsala universitet 5. 193 pp. Uppsala. ISBN 978-91-506-2279-9. This thesis provides an in-depth study of the possibilities of applying bibliometric methods to the research field of literary studies. The four articles that constitute the backbone of this thesis focus on different aspects of references and citations in literary studies: from the use of references in the text to citation patterns among 34 literature journals. The analysis covers both an Anglo-Saxon context as well as research in Swedish literary studies, and the materials used include Web of Science data, references in the Swedish literature journal TFL (Tidskrift för Litteraturvetenskap) and applications to the Swedish Research Council (Vetenskapsrådet). A study is also made of the influence of one single publication—Walter Benjamin’s Illuminations—and its impact in literary studies and in wider academia. The results from the four articles are elaborated upon using a theoretical framework that focuses on differences in the social and intellectual organization of research fields. According to these theories literary studies can be described as a fragmented, heterogenic, interdisciplinary and ‘rural’ field with a diverse audience. The fragmented and rural organization of the field is reflected in low citation frequencies as well as in the difficulties in discerning research specialities in co-citation mappings, while the analysis of the intellectual base (highly cited authors) is an example of the heterogenic and interdisciplinary character of the field, as it includes authors from many fields across the humanities and the social sciences. The thesis emphasizes that bibliometric studies of research fields in the humanities need to incorporate non-English and non-journal publications in order to produce valid and fair results. Moreover, bibliometric methods must be modified in accordance with the organization of research in a particular field, and differences in referencing practices and citation patterns ought to be considered. Consequently, it is advised that bibliometric measures for evaluating research in these fields should, if used at all, be applied with great caution. / <p>© Björn Hammarfelt 2012</p>

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Este trabalho visa descrever a experiência de uma pesquisa em psicologia social desde seus momentos iniciais onde o problema de pesquisa ainda se delineava, passando por todas as suas desconstruções a partir do encontro com o campo de pesquisa: a prática do parkour. As ferramentas metodológicas que foram utilizadas vão igualmente recebendo sua forma de acordo com as demandas dos encontros: seguir os atores, acompanhá-los em suas controvérsias, aprender com eles, levar a sério suas recalcitrâncias, compartilhar um campo de afetos, compartilhar uma experiência de cidade e explicitar os processos de tradução da pesquisa. Questões da materialidade, da alteridade, do corpo, da cidade emergem nesse processo, no entanto, busca-se efetivamente descrever um processo de pesquisa à medida que se coloca a questão de pesquisar como uma política ontológica capaz de inventar e re-inventar o pesquisador e as questões que levanta na própria relação com aquilo que o leva a pesquisa. / This paper aims to describe the experience of a research in social psychology since its early stages when the research problem was still emerging, through all its deconstructions by the time of the encounter with the research field: the practice of parkour. The methodological tools that were used would also be shaped according to the demands posed by this relation: to follow the actors, to follow them in their controversies , to learn from them, to take seriously their recalcitrances, to share a field of affections, to share an experience of the city and make explicit the translation processes of the research. Matters of materiality, of otherness, of body, of the city emerge in this process, and however, we seek to effectively describe a research process as it poses the question of researching as an ontological politic capable of inventing and re-inventing the researcher and the questions previously and continuosly raised in the relation to what leads to research.

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Este trabalho visa descrever a experiência de uma pesquisa em psicologia social desde seus momentos iniciais onde o problema de pesquisa ainda se delineava, passando por todas as suas desconstruções a partir do encontro com o campo de pesquisa: a prática do parkour. As ferramentas metodológicas que foram utilizadas vão igualmente recebendo sua forma de acordo com as demandas dos encontros: seguir os atores, acompanhá-los em suas controvérsias, aprender com eles, levar a sério suas recalcitrâncias, compartilhar um campo de afetos, compartilhar uma experiência de cidade e explicitar os processos de tradução da pesquisa. Questões da materialidade, da alteridade, do corpo, da cidade emergem nesse processo, no entanto, busca-se efetivamente descrever um processo de pesquisa à medida que se coloca a questão de pesquisar como uma política ontológica capaz de inventar e re-inventar o pesquisador e as questões que levanta na própria relação com aquilo que o leva a pesquisa. / This paper aims to describe the experience of a research in social psychology since its early stages when the research problem was still emerging, through all its deconstructions by the time of the encounter with the research field: the practice of parkour. The methodological tools that were used would also be shaped according to the demands posed by this relation: to follow the actors, to follow them in their controversies , to learn from them, to take seriously their recalcitrances, to share a field of affections, to share an experience of the city and make explicit the translation processes of the research. Matters of materiality, of otherness, of body, of the city emerge in this process, and however, we seek to effectively describe a research process as it poses the question of researching as an ontological politic capable of inventing and re-inventing the researcher and the questions previously and continuosly raised in the relation to what leads to research.