The purpose of this thesis is to contribute to the methodology at the intersection of relational and evaluative bibliometrics. Experimental investigations are presented that address the question of how we can most successfully produce estimates of the subject similarity between documents. The results from these investigations are then explored in the context of citation-based research evaluations in an effort to enhance existing citation normalization methods that are used to enable comparisons of subject-disparate documents with respect to their relative impact or perceived utility. This thesis also suggests and explores an approach for revealing the uncertainty and stability (or lack thereof) coupled with different kinds of citation indicators.This suggestion is motivated by the specific nature of the bibliographic data and the data collection process utilized in citation-based evaluation studies. The results of these investigations suggest that similarity-detection methods that take a global view of the problem of identifying similar documents are more successful in solving the problem than conventional methods that are more local in scope. These results are important for all applications that require subject similarity estimates between documents. Here these insights are specifically adopted in an effort to create a novel citation normalization approach that – compared to current best practice – is more in tune with the idea of controlling for subject matter when thematically different documents are assessed with respect to impact or perceived utility. The normalization approach is flexible with respect to the size of the normalization baseline and enables a fuzzy partition of the scientific literature. It is shown that this approach is more successful than currently applied normalization approaches in reducing the variability in the observed citation distribution that stems from the variability in the articles’ addressed subject matter. In addition, the suggested approach can enhance the interpretability of normalized citation counts. Finally, the proposed method for assessing the stability of citation indicators stresses that small alterations that could be artifacts from the data collection and preparation steps can have a significant influence on the picture that is painted by the citationindicator. Therefore, providing stability intervals around derived indicators prevents unfounded conclusions that otherwise could have unwanted policy implications. Together, the new normalization approach and the method for assessing the stability of citation indicators have the potential to enable fairer bibliometric evaluative exercises and more cautious interpretations of citation indicators.

From flickering films to microlearning in 4K, the field known as Instructional Design and Technology (IDT) today has a long history, marked by constant evolution since the 1920s. The field has been thrust into the spotlight by the COVID-19 pandemic. This bibliometric analysis examines research articles from the Educational Technology Research and Development (ETRandD) journal spanning 1957 to 2023. The study addresses the challenges posed by the influx of new IDT professionals from diverse backgrounds, as well as the opportunity presented by the occasion of the centennial celebration of the Association for Educational Communications and Technology (AECT), the key professional organization in the field. Data for this study was primarily obtained from the Web of Science, supplemented by SCOPUS and Dimensions. The analysis utilized Biblioshiny to evaluate the journal's performance and impact, identifying influential works and authors. Additionally, VOSviewer was employed to map the scientific landscape, tracing the evolution of research themes and the collaborative networks among authors, institutions, and countries. While the analysis navigates through the limitations inherent in focusing on a single journal, majorly employing a specific dataset, and adhering to an English-only corpus, it successfully illuminates the core tendencies and transformative shifts within IDT. The findings emphasize the field's enduring commitment to leveraging technological advancements within a theoretically grounded framework to enhance learning outcomes. As the field continues to evolve in response to new entrants from diverse backgrounds, emerging technologies and shifting learners' contexts, this study provides a useful reference point for future research. / Doctor of Philosophy / The field of Instructional Design and Technology (IDT) has evolved dramatically from its early days in the 1920s, using simple film-based instruction, to today's sophisticated 4K microlearning environments. The field has been thrust into the limelight by the unprecedented challenges of the COVID-19 pandemic. This study is a bibliometric analysis of articles published in the Educational Technology Research and Development journal from 1957 to 2023. The research addresses the challenge of the entry of professionals from varied backgrounds into the IDT field and celebrates a century of contributions by the Association for Educational Communications and Technology (AECT), a leading organization in this discipline. Using databases like the Web of Science, SCOPUS, and Dimensions, and tools such as Biblioshiny and VOSviewer, the study maps the development of IDT research themes, identifies key works, and authors, and explores the collaborative networks that span authors, institutions, and countries. Despite focusing on a single journal and an English-only dataset, the analysis reveals significant trends and shifts in IDT. It underscores the field's commitment to integrating new technologies within a solid theoretical framework to improve educational outcomes. This study not only reflects on the past but also sets the stage for future research as IDT continues to adapt to the needs of diverse learners and emerging technologies.

Objectives: The aim in this thesis has been to generate information relevant for strategic positioning and future evaluations within the scientific field of sport and exercise psychology. This has been done by request, and in collaboration with The Group of Sport and Exercise Psychology at the Institution of Psychology at the University of Umeå. Research questions:  (1) How does the cognitive structure within the field of sport and exercise psychology take shape with respect to research topics in current sport-psychological research, i.e. the research front? (2) How does the social structure within the field of sport and exercise psychology take shape with respect to formal scientific collaboration? Data: 879 articles published between 2008-2011 were used in this study. The population of articles were collected from a set of 5 core journals: International Journal of Sport Psychology, Journal of Applied Sport Psychology, Journal of Sport and Exercise Psychology, The Sport Psychologist, Psychology of Sport and Exercise. The original set was expanded by collecting relevant sport psychology articles from Scandinavian Journal of Medicine & Science in Sports and Journal of Sports Sciences. Methods: (1) The bibliometric indicator normalized bibliographic coupling combined with hierarchical agglomerative cluster analysis was used for mapping the research front. With this approach articles are basically clustered with respect to shared refererences, which in this context is understood as a measure of topical similarity. (2)  For the mapping of social structures a collaboration analysis was performed by extracting and visualizing social networks based on the bibliometric indicator coauthorship.     Results: (1) Identification and classification of 80 clusters based on topical similarity in collaboration with a subject expert. (2) Providing a map of formal scientific collaborations between countries based on coauthorship. (3) Providing a map of social networks based on coauthorships between individual researchers. (4) Identification and contextualization of central researchers based on production within the visualized coauthor network. The publications of each researcher were traced to corresponding clusters in the research front to gain information about in which subject areas and topics these central researchers publish. (5) Identification of research groups with high coauthor values, i.e. high intensity in their formal collaboration. Furthermore the publications from these groups were connected to corresponding clusters, i.e. giving information about in which subject areas and topics these groups publish.

[pt] A ascensão do desenvolvimento sustentável como um campo de pesquisa aplicada tem sido observada em várias disciplinas. No âmbito da Agenda 2030 das Nações Unidas, o cumprimento dos 17 Objetivos de Desenvolvimento Sustentável (ODS) exige a tomada de decisões considerando vários critérios geralmente complexos e conflitantes. Os métodos multicritério de apoio à decisão (MCDM) têm sido amplamente empregados em uma vasta gama de campos e disciplinas, incluindo a análise de decisão multicritério sobre questões de desenvolvimento sustentável. Mapear e analisar sistematicamente a evolução do campo de pesquisa cobrindo aplicações de métodos multicritério de apoio à decisão para o desenvolvimento sustentável nas últimas duas décadas pode ajudar governos e organizações nas transições sociotécnicas em direção à sustentabilidade. Assim, métodos MCDM para o desenvolvimento sustentável está emergindo como um domínio de estudo recente nos campos de gestão e políticas públicas. Esta dissertação tem como objetivo identificar e visualizar caminhos evolutivos e construir um roteiro científico com foco neste campo de pesquisa. Uma análise bibliométrica foi conduzida para avaliar todos os documentos revisados por pares recuperados do banco de dados Web of Science (WoS), cobrindo este campo no período de 2000-2020. A partir dos dados analisados dos artigos mais citados de um total de 3.473 documentos inicialmente recuperados, foi possível identificar e visualizar o mapa longitudinal da ciência de um campo de pesquisa em foco. As implicações para políticas contínuas e consistentes e pesquisas futuras são discutidas. / [en] The rise of sustainable development as a field of applied research has been observed across various disciplines. Within the UN 2030 Agenda scope, the achievement of 17 Sustainable Development Goals (SDGs) requires decision-making considering multiple decision criteria usually complex and in conflict. Multiple criteria decision-making methods (MCDM) have been widely employed in a wide range of fields and disciplines, including multicriteria decision analysis concerning sustainable development issues. Mapping and systemically analyzing the evolution of the research field covering applications of multicriteria decision-making methods for sustainable development in the last two decades can help governments and organizations in sociotechnical transitions towards sustainability. Thus, MCDM methods for sustainable development is emerging as a recent research domain within management and public policy fields. This dissertation aims to identify and visualize evolutionary pathways and build a scientific roadmap focusing on this research field. A bibliometric analysis was conducted to assess all peer-reviewed documents retrieved from the Web of Science (WoS) database, covering this field over the 2000-2020 timeframe. Based on the analyzed data of the most cited articles from a total of 3,473 initially retrieved documents, it was possible to identify and visualize a focused research field s longitudinal science map. The implications for ongoing, consistent policy and future research are discussed.

[pt] Em um mundo globalizado, onde pessoas de diversas culturas convivem, trocam experiências e compõem equipes de trabalho, o domínio de habilidades e competências de natureza intercultural figura como um fator relevante e atual. Neste contexto, surgiu, em 2003, o construto teórico da inteligência cultural. O objetivo geral deste trabalho foi compreender o estado da arte sobre inteligência cultural na área de Administração e identificar os principais grupos de temas que vêm sendo explorados na academia (sua evolução, foco de interesse e estágio atu-al), a fim de propor um framework teórico e uma agenda de pesquisa futura. Para tal, efetuou-se uma revisão bibliométrica dos artigos científicos publicados em inglês, na base de dados SCOPUS, de 2004 a 2018. A partir de uma amostra final de 262 artigos, realizou-se (i) com a utilização do software Microsoft Excel, uma análise estatística dos dados (descritiva), a fim de verificar o impacto da pesquisa de IC na área de Administração, bem como mapear a produção científica a partir de diferentes unidades de análise (autor, afiliação, país, etc); e (ii) com a utiliza-ção do software SciMAT, uma análise bibiliométrica (de citação e de coocorrên-cia de palavras) para identificar as principais temáticas exploradas até o momento (clusters) e sua evolução temporal. Os resultados apontaram alguns temas como oportunidade para pesquisas futuras, destacando-se estudos sobre inteligência cul-tural e: outros tipos de inteligência, negociação intercultural, treinamento e desen-volvimento intercultural, performance organizacional e estratégia, gestão do con-flito, inteligência cultural organizacional, antecedentes da inteligência cultural; dentre outros. / [en] Mastering intercultural skills in a globalized world where people from dif-ferent cultural backgrounds are trying to live together, exchange experiences and join multicultural work teams is becoming key to achieve best results. In 2003, cultural intelligence emerges as a relevant construct to address this issue. The main goal of the present work was to understand the state of art on cultural intelli-gence in the Management field as well as to identify the main themes explored so far (clusters), their evolution, focus of interest and current stage in order to pro-pose a theoretical framework and a future research agenda. A bibliometric review of the scientific papers (articles and reviews) published in English in SCOPUS database was carried out, comprising a period of fifteen years (from 2004 to 2018). In order to verify the impact of the CI research in the Management field, as well as to map scientific production considering different units of analysis (like author, affiliation, country, etc) a statistical descriptive analysis of the final sam-ple data (262 documents) was carried out using the Microsoft Excel software. A bibilometric analysis (citation and co-word) using SciMAT software was also a choice to identify clusters and their evolution through time. The results pointed to some themes as research avenues opportunity to be explored, such as cultural in-telligence and: other types of intelligence, intercultural negotiation, intercultural training and development, organizational performance and strategy, conflict man-agement, organizational cultural intelligence, antecedents of cultural intelligence; among others.

Notre travail de thèse vise à établir un diagnostic des potentialités scientifiques marocaines et à concevoir de nouveaux dispositifs pour la mesure, la cartographie et l’open access à la science locale.Pour bâtir des systèmes nationaux de recherche et garantir le développement socioéconomique du Maroc, les décideurs des universités ont besoin d’indicateurs d’analyse et d’évaluation de leur patrimoine scientifique. Les principales sources utilisées pour effectuer cette analyse sont les bases de données internationales « Scopus » et « Web of Science », en dépit de leurs biais d’indexation et de couverture de la science des pays du Sud. Cela induit un questionnement quant au manque hypothétique de la visibilité de la science marocaine. Ce manque de visibilité serait-il dû à la faible présence des revues nationales dans les bases de données internationales ? Ou relèverait-il de la faible qualité des publications marocaines ? La science marocaine est-elle une science à visée locale, abordant des thèmes qui ne figurent pas dans l’agenda de la science universelle ? Les apports de l’open access quant à l’augmentation de la visibilité et de l’impact de la recherche sont-ils méconnus des universitaires marocains ? La réponse à ces questions est accomplie à travers l’étude de cas de la Faculté de Médecine et de Pharmacie de Casablanca (FMPC). Elle s’articule autour de trois objectifs spécifiques : 1/ Recenser la production scientifique ; 2/ cartographier la production scientifique et explorer l’existence d’une relation entre l’indexation des publications dans les bases de données internationales et leur visibilité 3/ évaluer les comportements et les usages de l’open access par les chercheurs.Les principaux résultats de l’analyse et de la cartographie de la production scientifique de la FMPC, attestent que celle-ci jouit d’une grande visibilité à l’échelle internationale. La juxtaposition des publications nationales et internationales permet de confirmer que 70% des publications scientifiques de la FMPC sont intégrées dans les bases de données internationales et que 74.21 % de l’ensemble des articles sont publiés en anglais. Par ailleurs, on ne pourrait exclure 30% des publications nationales de l’évaluation bibliométrique au risque de biaiser les politiques scientifiques du pays.D’autres résultats de la thèse sont constitués par la mise en place du dépôt institutionnel de l’Université et du portail de revues médicales, créés afin d’assurer une large diffusion de la production des chercheurs de la FMPC et d’augmenter sa visibilité et son impact. Néanmoins, les résultats de l’enquête menée auprès des chercheurs ont montré que la principale barrière à l’adoption de l’open access est la méconnaissance des avantages des dispositifs de libre accès à l’IST quant à l’augmentation de leur impact et de leur visibilité. Les résultats de la cartographie de la FMPC et de l’étude des comportements des chercheurs à l’égard de l’open access, nous ont permis de proposer des fondements pour l’édification d’indicateurs adaptés au contexte marocain. / Our thesis aims to establish a diagnosis of Moroccan scientific potential in the medical area and to conceptualize new devices for measurement, mapping and open access to local science.To build national research systems and ensure Morocco’s socio-economic development, university decision-makers need analytic and evaluation indicators of their scientific heritage. The main sources used to perform this analysis are the international databases "Scopus" and "Web of Science", despite their biased indexing and coverage of southern countries.This impedes the accessibility and visibility of Moroccan science. A few questions then arise: is this lack of visibility due to the low presence of national journals in international databases? Is it due to the quality of Moroccan publications? Is Moroccan science locally focused, addressing themes which are not on the global agenda? Do Moroccan universities lack awareness of the contribution of open access to increasing research visibility and impact? Our case study of the Faculty of Medicine and Pharmacy of Casablanca (FMPC) is based on three specific objectives: 1/ Identifying scientific production; 2/ characterizing scientific production and exploring the existence of a relationship between the indexing of publications in international databases and their visibility and 3/ evaluating the behaviors and uses of open access by researchers.The main results of our thesis are the analysis and characterization of the scientific output of the FMPC, which is highly visible on an international scale: the juxtaposition of national and international publications confirms that 70% of the FMPC’s scientific publications are integrated into international databases and that 74.21% of all articles are published in English. Furthermore, 30% of national publications cannot be excluded from bibliometric evaluation, at the risk of biasing the country's science policies.The establishment of the University’s institutional repository and of the medical journal portal makes it possible to widely disseminate FMPC researcher production and to increase its visibility and impact. Nevertheless, the results of the survey of researchers showed that the main impediment to the adoption of open access is the lack of awareness of the benefits of STIs with regards to increasing their impact and visibility. The results of the FMPC’s science mapping and the study of researcher behavior with regard to open access have allowed us to propose bases for the definition of indicators adapted to the Moroccan context.