This study has researched how user click heatmaps and eye tracking can be utilized in usability testing. We have used the tools SessionCam and Tobii. We designed a website for a small clothing store and conducted usability tests, in order to evaluate the users clicks and eye movements in relation to design choices on the website. The aim of this study was to research how these tools can be integrated in usability testing and how results from the tests can be used to improve usability. We were able to use the recordings of clicks and eye movements and make design changes based on the findings. Some of the findings were that the users look more at the top of the page than at the bottom. They also look more at icons and images rather than longer text blocks. From the tracking of user clicks we found that the users primarily clicked on links in order to navigate the page but also that they sometimes clicked on texts when they were reading.

ABSTRACT A USABILITY EVALUATION FRAMEWORK AND A CASE STUDY ON A SUPPLIER PORTAL SYSTEM Babayigit, Elif Fatma M.Sc., Department of Industrial Engineering Supervisor: Assoc. Prof. Dr. Tayyar Sen December 2003, 229 pages The goal of this thesis is to provide a usability evaluation framework in the area of e-procurement technologies and a case study on this base. A survey of the concepts of human computer interaction, usability and usability evaluation techniques is carried out. Additionally current e-procurement technologies are explored and specifically a Company&rsquo / s Supplier Portal System which was employed in year 2003, as an e-procurement technology for the procurement of direct goods, is taken into consideration. Pointing from the findings of the survey, a usability evaluation methodology is developed based on user and task analysis of the Supplier Portal. Within this methodology, in terms of performance metrics of the Supplier Portal, usability attributes to be measured are determined and a checklist for a heuristic system evaluation is developed. iv While a laboratory testing structure is proposed for the case, a usability satisfaction survey and empirical usability tests are implemented with the actual users of the Company Supplier Portal. Descriptive and inferential formal analyses of the survey and field test results are studied, contributing to the Usability Evaluation of the Portal. Lastly further prospects are pointed, where usability, formal analysis, supply chain management and systems design intercept.

Das Ziel dieser Arbeit war es eine möglichst frei skalierbare Version der Lazarus-IDE zu entwickeln. Diese soll es dem versierten Lehrer ermöglichen, eine auf seine didaktischen Intentionen und die Leistungsfähigkeit seiner Schüler angepasste Lazarus-Version zu installieren und im Unterricht zu verwenden. Hierfür ist zunächst eine theoretische Analyse der Entwicklungsumgebung Eclipse vorgenommen worden. Weiterhin wurde untersucht, welche didaktischen Anforderungen prinzipiell an eine schulische Entwicklungsumgebung zu stellen sind. Auf Basis dieser Untersuchungen sowie durch gezielte Befragung von Fachlehrern sowie Experten sind die Anforderungen an eine solche IDE verifiziert und diese schließlich implementiert worden.

This study argues that including aspects of user experience relevant to the user's knowledge of a product's context-of-use in the early stages of product design can enhance the design of product usability. To explore these issues, research was undertaken to respond to three research questions: (i) What aspects of user experience influence people's understanding of product usability? (ii) What is the nature of the differences between users' and designers' understandings of product usability? (iii) How can context-of-use and human experience enhance the design of product usability? Findings from the study have shown that experience, context-of-use and knowledge about a product's usability are interrelated. Conceptual principles and design principles were established based on findings to explain (i) the relationships between aspects of experience and areas of product usability and (ii) differences between designers' and users' concepts of product usability. These principles responded to the first two research questions. Causal relationships found between experience and product usability suggested the need to implement them in an accessible manner for a product design process. A design tool -- named the Experience and Context Enquiry Design Tool (ECEDT) -- was devised to exemplify the implementation of findings. A trial run verified that the type of information that ECEDT brings to designers could assist them to address usability and experience issues during the early stages of the design process. This result responded to the third research question of the study. This study's conceptual principles and design principles contribute new knowledge to design theory and practice. This knowledge contributes to design theory in providing greater detail about the differences between designers and users than that addressed by existing theory; it contributes to design practice as it informs designers about the aspects of human experience that prompt users' understanding of a product's use. In doing so, it can potentially assist in the design of products that embed new technological applications, and support the design of product usability.

The electronic commerce is a phenomenon that has developed rapidly during recent years and has come to take larger part in the everyday life. The act of buying and selling products online is referred to as electronic commerce and today, this phenomenon is starting to take more space within the mobile devices which is called mobile commerce. The user no longer has to visit physical stores in order to make a purchase, it can now all be done from a device in the palm of the hand. The aim with this research was to describe what the driving factors of m-commerce are from a usability perspective and how important different usability factors are to the customer when performing mobile commerce. This particular thesis was conducted with a quantitative approach in order to gain information about the consumer behavior when shopping through mobile phone as well as finding the most critical usability factors from the users point of view. The result was a self-completion questionnaire with a total of 200 respondents. The results from the self-completion questionnaire points out that there are numerous critical factors that can have an impact on the users’ decision whether to perform mobile commerce or not. Furthermore, the results from the questionnaire pictures that most of the consumers still prefer to shop in physical stores followed by shopping online through the computer. The reason why other methods before using the smartphone to make a purchase was chosen, was mainly because of the limited screen size and input mechanisms on the mobile phones. The result also shows that the majority of the participants would cancel their purchase if usability factors, like errors and poor site performance, are not thoroughly considered in the application. This shows the importance of including usability in the developing of applications and mobile websites. This essay will provide companies and developers with important information that is needed for creating applications for mobile commerce with high user satisfaction. M-commerce is a rapid growing field of study which is important to research because of the impact it begins to have on business. For further research it would be interesting to continue the study of other factors that plays a big role when developing mobile applications for m-commerce. Security is one key issue in m-commerce and according to our empirical result it is of big importance for the users performing m-commerce and should be investigated deeper.

I takt med att streaming, eller "strömning" som det heter på svenska, av filmer, serier och musik ökar i popularitet runt om i världen så är användbarhet en aspekt som får allt större betydelse vid utformning och design av olika tjänster. Det räcker inte med att enbart erbjuda åtråvärda tjänster och funktioner, de måste också presenteras som lättförståeliga och vara lättanvända. Spotify och Netflix är två auditiva och visuella digitala underhållningstjänster som borde vara anpassade för alla människor, oberoende från tidigare erfarenheter och förutsättningar. Men är de verkligen det?  Denna studie syftar till att undersöka användbarhet hos digitala underhållningstjänster för synskadade. De nyckelmetoder som använts i studien består av intervjuer och testdrivna experiment. En serie intervjuer genomfördes med ett selektivt urval av synskadade personer i Sverige. Ett testdrivet experiment utformades och genomfördes sedan där ett selektivt urval av synskadade personer agerade som testare i ett användarbaserat test. Resultatet påvisar att ett antal faktorer påverkar användbarheten när synskadade interagerar med de utvalda tjänsternas gränssnitt. Viktiga faktorer inkluderar; typ av plattform tjänsten används på, grad av synnedsättning, uppdateringar för tjänsten, otillgänglig design och användarens erfarenhet av tjänsten. Studien har även identifierat att användbarheten hos de undersökta digitala underhållningstjänster för synskadade är olika för olika enheter, där gränssnitten på smartphones är mer användbara än gränssnitten på P.C. Dessa resultat leder till slutsatsen att synskadade användare inte kan nyttja de undersökta digitala underhållningstjänsterna på ett självständigt och tillfredställande sätt. / As streaming of movies, television series and music is gaining popularity around the world, usability is an aspect that is becoming increasingly important in the design of various services. It is not enough to offer only desirable services and features, they must also be presented as easily understood and easy to use. Spotify and Netflix are two auditory and visual digital entertainment services that should be adapted to all people, independent of earlier experiences and conditions. But are they really? This study aims at investigating usability of digital entertainment services for the visually impaired. The key methods employed in the study consists of interviews and test driven experiments. A series of interviews were conducted with a selected sample of visually impaired individuals in Sweden. A test-driven experiment was then designed and conducted where a selected sample of visually impaired acted the role of user-based testers. Results suggest that that a number of factors affect the usability when visually impaired persons interact with the selected services user-interfaces. Important factors includes; type of platform the services is used on, degree of visual impairment, service updates, inaccessible design and the users previous experience with said service. The study has also identified that the usability of the investigated digital entertainment services for visually impaired people differs on different devices, where the Smartphone interfaces are more usable than the user interface of P.C. These results lead us to conclude that visually impaired cannot use the entertainment services independently and satisfactorily.

O objetivo principal deste estudo é o de verificar se condições adequadas de usabilidade técnica e pedagógica interferem nos desempenhos das aprendizagens de alunos em e-learning. Para tanto, são propostos comparativos em duas condições distintas de experimentos. Em um experimento, os alunos interagem com um material de aprendizagem que não utiliza condições de usabilidade técnica e pedagógica; e em outro experimento, interagem com um material de aprendizagem que apresenta condições adequadas de usabilidade técnica e pedagógica implementadas. Na aplicação dos experimentos propostos pela metodologia, os alunos interagem com o material de aprendizagem, respondem ao teste de desempenho, e em seguida avaliam a usabilidade técnica e pedagógica através do questionário de avaliação da usabilidade. Este estudo proporciona uma base de questões de usabilidade técnica e pedagógica conforme categorias de usabilidade e critérios específicos para materiais em e-learning. Também são apresentados os pontos críticos e facilitadores de usabilidade conforme a avaliação dos alunos. No sentido de comprovar se a usabilidade técnica e pedagógica proporciona um desempenho significativo aos alunos em e-learning são analisadas as significâncias das diferenças entre as médias de desempenhos dos alunos entre os dois experimentos, entre as médias de desempenhos considerando-se somente as questões respondidas, a correlação entre a usabilidade e o desempenho, e as questões de usabilidade significativas ao desempenho. Através de tais análises pôde-se concluir por meio dos resultados obtidos que apesar de não ter sido comprovada a significância para todas as análises que abrangeram a avaliação do impacto da usabilidade técnica e pedagógica sobre o desempenho de aprendizes em e-learning, pôde-se comprovar que a usabilidade apresentou uma interferência significativa sobre o desempenho. Outras variáveis, tais como a idade, o gênero, o conhecimento prévio sobre o conteúdo proposto para o experimento e a opinião da importância do conteúdo para a aprendizagem também foram analisadas no sentido de verificar possíveis interferências quanto ao desempenho dos alunos. Verificou-se que as variáveis de gênero e experiência prévia do conteúdo proposto apresentaram interferência significativa sobre o desempenho para os alunos que utilizaram o material de aprendizagem sob condições adequadas de usabilidade técnica e pedagógica. / The main purpose of this study is to verify whether appropriate conditions of technical and pedagogical usability interfere with students' performance in e-learning. Thus, comparisons are made with two distinct types of experiments. In one experiment, the student interacts with a learning material that does not feature any conditions of technical and pedagogical usability; in the other, the student interacts with the learning material with implemented conditions of technical and pedagogical usability. In the process of the experiments suggested by the methodology, the student interacts with the learning material, takes the performance test, and right after assesses the technical and pedagogical usability through the usability evaluation questionnaire. This study provides a basis for technical and pedagogical usability issues regarding categories of usability and specific criteria for e-learning material. Critical points and usability facilitators are also presented based on the students' assessment. Aiming to prove that the technological and pedagogical usability provides a significant performance to e-learning students, we analyzed the significance of the differences among students' performance averages between the two experiments, among performance averages taking into account only answered questions, the correlation between usability and performance, and usability questions significant to the performance. Based on such analyses, one could conclude from the results obtained that, although the significance of all analyses involving the evaluation of the impact of technical and pedagogical usability on performance had not been proven, one could actually prove that usability showed a significant interference with the performance. Other variables, such as age, gender, previous knowledge of the content proposed for the experiment and the opinion on the importance of the content for learning were also analyzed so as to verify possible interferences regarding the students' performance. The variables of gender and previous experience of the proposed content presented a significant interference with the performance of students who utilized the learning material under adequate conditions of technical and pedagogical usability.

O objetivo principal deste estudo é o de verificar se condições adequadas de usabilidade técnica e pedagógica interferem nos desempenhos das aprendizagens de alunos em e-learning. Para tanto, são propostos comparativos em duas condições distintas de experimentos. Em um experimento, os alunos interagem com um material de aprendizagem que não utiliza condições de usabilidade técnica e pedagógica; e em outro experimento, interagem com um material de aprendizagem que apresenta condições adequadas de usabilidade técnica e pedagógica implementadas. Na aplicação dos experimentos propostos pela metodologia, os alunos interagem com o material de aprendizagem, respondem ao teste de desempenho, e em seguida avaliam a usabilidade técnica e pedagógica através do questionário de avaliação da usabilidade. Este estudo proporciona uma base de questões de usabilidade técnica e pedagógica conforme categorias de usabilidade e critérios específicos para materiais em e-learning. Também são apresentados os pontos críticos e facilitadores de usabilidade conforme a avaliação dos alunos. No sentido de comprovar se a usabilidade técnica e pedagógica proporciona um desempenho significativo aos alunos em e-learning são analisadas as significâncias das diferenças entre as médias de desempenhos dos alunos entre os dois experimentos, entre as médias de desempenhos considerando-se somente as questões respondidas, a correlação entre a usabilidade e o desempenho, e as questões de usabilidade significativas ao desempenho. Através de tais análises pôde-se concluir por meio dos resultados obtidos que apesar de não ter sido comprovada a significância para todas as análises que abrangeram a avaliação do impacto da usabilidade técnica e pedagógica sobre o desempenho de aprendizes em e-learning, pôde-se comprovar que a usabilidade apresentou uma interferência significativa sobre o desempenho. Outras variáveis, tais como a idade, o gênero, o conhecimento prévio sobre o conteúdo proposto para o experimento e a opinião da importância do conteúdo para a aprendizagem também foram analisadas no sentido de verificar possíveis interferências quanto ao desempenho dos alunos. Verificou-se que as variáveis de gênero e experiência prévia do conteúdo proposto apresentaram interferência significativa sobre o desempenho para os alunos que utilizaram o material de aprendizagem sob condições adequadas de usabilidade técnica e pedagógica. / The main purpose of this study is to verify whether appropriate conditions of technical and pedagogical usability interfere with students' performance in e-learning. Thus, comparisons are made with two distinct types of experiments. In one experiment, the student interacts with a learning material that does not feature any conditions of technical and pedagogical usability; in the other, the student interacts with the learning material with implemented conditions of technical and pedagogical usability. In the process of the experiments suggested by the methodology, the student interacts with the learning material, takes the performance test, and right after assesses the technical and pedagogical usability through the usability evaluation questionnaire. This study provides a basis for technical and pedagogical usability issues regarding categories of usability and specific criteria for e-learning material. Critical points and usability facilitators are also presented based on the students' assessment. Aiming to prove that the technological and pedagogical usability provides a significant performance to e-learning students, we analyzed the significance of the differences among students' performance averages between the two experiments, among performance averages taking into account only answered questions, the correlation between usability and performance, and usability questions significant to the performance. Based on such analyses, one could conclude from the results obtained that, although the significance of all analyses involving the evaluation of the impact of technical and pedagogical usability on performance had not been proven, one could actually prove that usability showed a significant interference with the performance. Other variables, such as age, gender, previous knowledge of the content proposed for the experiment and the opinion on the importance of the content for learning were also analyzed so as to verify possible interferences regarding the students' performance. The variables of gender and previous experience of the proposed content presented a significant interference with the performance of students who utilized the learning material under adequate conditions of technical and pedagogical usability.

Examensarbetet har varit en studie som skulle ta fram ett sätt att utvärdera användbarheten och göra en betygsättning av användbarhet i ett utvalt Content Management System.Det bakomliggande problemet till att examensarbetet utfördes är att betygsättningen av användbarhet är bristfällig i många utvärderingar av Content Management System.Studien har använt ett befintligt ramverk som var framtaget för utvärdering av användbarhet i mobiltelefoner. Detta ramverk modifierades så att det istället kunde implementeras på ett Content Management System.Användartesterna som användes för datainsamlingen utfördes av användare som valts ut genom ett selektivt urval beroende på erfarenhet inom användning av informationssystem.Användarna betygsatte olika användbarhetsindikatorer beroende på egen upplevelse under utförandet av uppgiften.Det data som samlades in från användartesterna sammanställdes i en Excelfil och för varje användares betyg på de olika användbarhetsindikatorerna sammanställdes ett pentagondiagram från dessa betyg.Studiens resultat presenterade en analys av utvärderingen som implementerade de olika delarna från ramverket. Analysen visade på olika resultat från testanvändarna och resultaten kunde enkelt utläsas från pentagondiagramen.Studiens slutsats är att det anpassade ramverket baserar sig på befintliga teorier och metoder kring utvärdering av användbarhet och betygsättningen baseras på befintliga tillvägagångsätt i ramverket.De identifierade komponenterna i ramverket är utvärderings delen, användartester och think-aloud, och betygsättningsdelen, poängskala och pentagondiagram. / The thesis has been a study that would provide a way to evaluate usability and make a rating of usability in a selected content management system. The underlying problem that the thesis was conducted is that the rating of usability is inadequate in many evaluations of Content Management Systems. The study has used an existing framework that was developed for evaluating usability in mobile phones. This framework was modified so that it could instead be implemented on a Content Management System. The user tests used for data collection were performed by users selected through a selective selection based on experience in the use of information systems. Users rated different usability indicators depending on their experience during the performance of the task. The data collected was compiled in an Excel-file and for each user's ratings of the various usability indicators, a pentagon chart was compiled from these grades.The study's results presented an analysis of the evaluation that implemented the various parts of the framework. The analysis showed different results from the test users and the results could easily be read from the pentagon charts.The study's conclusion is that the adapted framework is based on existing theories and methods of evaluating usability and the rating is based on existing approaches in the framework.The identified components of the framework are the evaluation section, user tests and think-aloud, and the grading scale, scorecard and pentagon chart.

This technical report publishes the proceedings of the 21th Prague Workshop, which was held from 25th to 26th December 2017. The workshop offers a possibility for young scientists to present their current research work in the fields of computer graphics, human-computer-interaction, robotics and usability. The works is meant as a platform to bring together researchers from both the Czech Technical University in Prague (CTU) and the University of Applied Sciences Dresden (HTW). The German Academic Exchange Service offers its financial support to allow student participants the bilateral exchange between Prague and Dresden.