Tobii EyeTracking's Library tagged testing →  View Popular, Search in Google

ABSTRACT
With heavy competition between iPhone games, proper
playtesting is vital in making an easy to use, fun game. Eye
tracking can give valuable insights in player behavior but
current handheld eye tracking set-ups suffer technologial
limitations, inhibiting normal play. This study aims to
identify the merits and shortcomings of a new handheld
eyetracking set-up for qualitative user research. It is part of
a series of ongoing tests to improve the set-up. In this
study, seven participants played an iPhone puzzle game
using the new set-up. Results indicated the set-up was
suited for simple tasks like browsing, but interfered with
normal gaming too much for most players. Factors
contributing to interference were: Lack of depth perception,
unnatural handling, uncomfortable posture and enlarged
display of hands. Solutions for improvement are discussed:
With longer practice for players and with tweaks to the setup,
interference can be reduced or partly removed.
Accurate depth perception remains a challenge, however.

Netherlands 2011 Game user testing playtest mobile gaming handheld device usability playability iPhone eye tracking Tobii T60XL HCI

in list: HCI & Usability

ABSTRACT
Design and implementation of usable human computer interface (HCI) systems involves expensive, primarily cognitive based, usability testing and evaluation techniques. This complicates the development process and may cause software companies and software engineers that are more familiar with objective testing methodologies to reduce or completely avoid the usability testing stage, reverting to best practice techniques, and producing HCI systems that lack usability. This research is based on the assumption that usability of HCI systems is directly related to the amount of mental and physical effort expended by the user throughout the interaction. It explores and exploits the utility of an objective, relatively easy to measure, and engineering oriented usability metric. A mathematical model of interaction effort is formulated. The model transforms data related to primitive interaction events such as keyboard keystrokes, mouse key clicks and Mickys traversed by the mouse along with eye tracking data into an effort metric. A carefully crafted set of user interaction goals employing scenario based test design techniques is implemented. Data is collected using logging programs that record goal completion time along with keyboard, mouse, and eyes interaction events. The recorded information is reduced to a statistically meaningful data-set that is used to evaluate the validity of the research assumptions. Experimental results support the hypothesize. Furthermore, they are prompting several interesting finding that merit further research and investigation. This is the first research that carries the intuitive idea of relation between effort and usability all the way to the “field” by recording and processing effort based metrics obtained from subjects while interacting with real complex systems.

USA 2008 Usability HCI testing effort measurement interaction eye tracking implement Tobii X120 Studio

in list: HCI & Usability

Abstract
The Economic Census Web site contains reference information to help users better find, understand, and use Economic Census data. In January and February 2009, the Statistical Research Division (SRD) evaluated the usability of the Economic Census Web site. The testing evaluated the success and satisfaction of nine participants with the site developed by the Economic Planning and Coordination Division (EPCD). Participants attempted to complete ten pre-determined tasks, developed specifically for this study, on the Web site. Usability testing revealed several usability problems, including prominent right navigation links that participants used often and which took them off site; an overwhelming amount of information on the main page; a non-inclusive list of definitions on the Definitions page; lack of guidance to help users find data specific to their county, and a top navigation tool that participants did not use and often overlooked. The pre-determined efficiency goal for medium level tasks was met, but the goals for the easy and hard tasks were not. This report summarizes the methods and findings of this usability evaluation. Recommendations are provided to improve the usability of the Economic Census Web site.

HCI Usability Census testing eye tracking web site evaluation 2009 USA Tobii ClearView

in list: HCI & Usability

ABSTRACT
All American Community Survey (ACS) estimates are currently released with their associated margin of error (MOE). However, many users do not think that the MOE provides enough information about an estimate's reliability. We conducted usability testing to examine whether the addition of reliability indicators to new prototypes of ACS data tables helped people use the tables with greater accuracy, efficiency, and satisfaction. All three prototypical reliability indicators were based on the coefficient of variation (CV), which is defined as the standard error divided by the mean of the estimate.
Each prototypical table with a reliability indicator tested in this study implemented a color-coded "Reliability" column and a legend explaining the meaning of the color codes to provide users with guidance as to whether the proportion of error to the estimate itself might be considered unacceptably high.
Each prototype table was defined by the number of "levels" that its Data Reliability Indicator used to label the estimates. Specifically, the two-level indicator had the levels "blank" (CV<=0.30) and "use caution" (yellow; CV>0.30); the three-level indicator included the levels "good" (green; CV<=0.30), "fair" (yellow; 0.30<CV<=0.61), and "poor" (red; CV>0.61); and the four-level indicator had the levels "excellent" (green; CV<=0.10), "good" (yellow; 0.10<CV<=0.30), "fair" (orange; 0.30<CV<=0.61), and "poor" (red; CV>0.61). Nine participants completed usability tasks using the prototypes, and three participants completed the tasks using baseline versions of the current ACS data tables without the indicators. Full versions of the prototype tables can be found in Appendix A.
The results showed that the four-level indicator was associated with the highest accuracy and satisfaction scores. In fact, eight of the twelve participants indicated that they preferred the four-level indicator overall. Users were able to complete the tasks more efficiently using the prototypes than the baseline tables, and they also express...

HCI Usability Census testing prototypes prototypical reliability indicator eye tracking 2009 USA Tobii

in list: HCI & Usability

Abstract
Participants in a usability evaluation are often asked whether they noticed certain elements after some level of interaction with a design. The purpose of this study was to evaluate the reliability of self-reported awareness measures using eye tracking data. Participants were shown 20 popular homepages for 7 seconds each and then asked afterwards if they saw 2 particular elements on each page. The results showed that self-reported awareness measures are reliable, but can vary depending on question structure and object type. These findings have implications for how usability practitioners ask questions about object awareness, and how that information is used in the design process.

Eye tracking self-reported awareness usability testing USA 2010 Tobii 1750

in list: HCI & Usability

Abstract:
Research applying eye-tracking to usability testing is increasing in popularity. A great deal of data can be obtained with eye-tracking, but there is little guidance as to how eye-movement data can be used in software usability testing. In the current study, users' eye-movements were recorded while they completed a series of tasks on one of three e-commerce websites specializing in educational toys. Four main research questions were addressed in this study: (1)?Are eye-tracking measures correlated with the more traditional measures of website usability (e.g., success, time on task, number of pages visited); (2)?Are eye-tracking measures sensitive to differences in task difficulty; (3)?Are eye-tracking measures sensitive to differences in site usability; and (4)?How does the design of a website drive user eye-movements? Traditional usability performance measures consisted of time on task, number of pages visited, and perceived task difficulty. Eye-tracking measures included the number of fixations, total dwell time, and average fixation duration. In general, all these measures were found to be highly correlated with one another, with the exception of average fixation duration. The two groups of measures generally agreed on differences in task difficulty; tasks showing high scores on one variable (e.g., time on task) showed high results on other measures (e.g., number of fixations). Similar agreement among measures was observed in comparisons of the sites on each task. The unique contributions of eye-tracking to usability testing were best realized in qualitative examinations of eye-tracking data in relation to specific areas of interest (AOIs) on site pages, which demonstrated this to be a useful tool in understanding how aspects of design may drive users' visual exploration of a web page.

metrics contributions eye tracking website usability testing USA 2005 Tobii 1750

in list: HCI & Usability , General Eye Tracking

Eye tracking as a tool in package and shelf testing using Tobii Eye Trackers.

Shelf testing Eye-Tracking Package Tobii eye tracker marketing Studio X tracking

in list: Tobii White Papers

ABSTRACT
An experimental validation is presented of a novel method for usability testing that entails playback of dynamic eye-tracking data to cue the elicitation of retrospective verbal reports. Participants produced: (1) think-aloud reports during an online search task, and (2) retrospective reports during another search task cued by the playback of either the screen capture of events or their own eye-movements. Task-completion times and response rates were recorded to assess reactivity. Fewer participants completed the search task whilst thinking aloud, indicating the reactivity of this technique. Verbal transcripts were coded for instances of usability problems. The eye-cued method identified more usability problems than the think-aloud or screen-cued methods. A significant interaction between search engine type and retrospective cue-type suggests that the value of the eye-cue method may be greatest with more complex browsing environments. Our results demonstrate that when cued appropriately, retrospective reports may be less reactive and more informative than other verbalisation techniques.

HCI Eye tracking verbal protocols online usability testing retrospective cue UK 2007 Tobii 1750

in list: HCI & Usability

Summary:
This article discusses how eye-tracking can be used to
supplement traditional usability test measures. User performance on two usability tasks with three e-commerce websites is described. Results show that eye-tracking data can be used to better understand how users initiate a search for a targeted link or web object. Frequency, duration and order of visual attention to Areas of Interest (AOIs) in particular are informative as supplemental information to standard usability testing in understanding user expectations and making design recommendations.

Hotspots Hyperlinks eye tracking usability testing USA 2005 Tobii 1750

in list: Cognitive & Behavioural Psychology

ABSTRACT
Eye-tracking research is increasingly used to supplement usability tests in both commercial and academic practice. However, while there has been research into links between eyetracking metrics and usability problems, this has so far fallen short of establishing a general correlation scheme between the two. Consequently, practitioners are left to make subjective judgements when interpreting eye-tracking data. We address the lack of general guidance by proposing an initial correlation scheme based on data from an exploratory study which aimed to find a wide range of possible correlations between usability
problems and eye-tracking patterns. User testing of two websites was conducted and a set of diverse usability problems was extracted from the data; these were then analysed and some were correlated with users’ eye-tracking patterns. In addition to this initial correlation scheme, a further finding from this study is that usability problems are connected to not just a single eyetracking pattern, but to a specific sequence of patterns. This sequence of patterns seems to arise from different coping strategies that users develop when a problem is experienced.

HCI Eye tracking user testing usability problems interfaces Web UK 2007 Tobii X50

in list: HCI & Usability

Abstract
The purpose of this usability study was to see if eye trackers collect valid data, regardless of the user’s method of corrected vision, eye color, or gender. The motivation to explore the idea that these human factors can distort eye trackers is based on marketing claims by several companies that say these factors should not affect results. This study found that the validity of data in usability studies that involved eye trackers in testing can produce biased results based on eyewear and eye color, and that adjustments should be made to control for these variables. The results showed no significant correlations based on gender. As a consideration into developing international signage for mass transportation systems that effectively accommodate global users, this study also explored how first language affects the way in which a user views and organizes a message and hence interprets procedural directions and related imagery. This is within the context of usability testing for a wide variety of users who may not share a first language or have the same method of vision correction.

Google Books Link:
http://books.google.com/books?hl=en&lr=&id=ogWf9HijDigC&oi=fnd&pg=PT314&ots=IvAihSfkG2&sig=T705KZ8I1ZUzyOLNlQHrKsyL1cw#v=onepage&q=&f=false

eye tracking usability testing methodologies internationalization color eyewear gender language USA 2009 Tobii

in list: Eye Tracking Technology

Abstract
The purpose of this usability study was to see if eye trackers collect valid data, regardless of the user’s method of corrected vision, eye color, or gender. The motivation to explore the idea that these human factors can distort eye trackers is based on marketing claims by several companies that say these factors should not affect results. This study found that the validity of data in usability studies that involved eye trackers in testing can produce biased results based on eyewear and eye color, and that adjustments should be made to control for these variables. The results showed no significant correlations based on gender. As a consideration into developing international signage for mass transportation systems that effectively accommodate global users, this study also explored how first language affects the way in which a user views and organizes a message and hence interprets procedural directions and related imagery. This is within the context of usability testing for a wide variety of users who may not share a first language or have the same method of vision correction.

eye tracking usability testing methodologies internationalization color eyewear gender language USA 2009 Tobii

in list: HCI & Usability