Free Essay

Usability Evaluation

In: Computers and Technology

Submitted By thwea8
Words 816
Pages 4
Usability Evaluation
Professor Cox
CIS 375

Online surveys are a great alternative to lavish mail or telephone surveys. There are a few requirements to online surveys however that you must be aware of. Using the Internet to conduct quantitative research presents challenges not found in conventional research. Some of our knowledge concerning the effective design and use of paper-based surveys does translate into electronic formats. However, electronic surveys have distinctive technological, demographic and response characteristics that affect how they should be designed, when they can be used and how they can be implemented. Survey design, subject privacy and confidentiality, sampling and subject solicitation, distribution methods and response rates and survey piloting are critical methodological components that must be addressed in order to conduct sound online research.

The easy and difficult aspects of creating and conducting an online questionnaire are a constraint, timeliness, important and the nature of the research requires it. While there are three types of questions have numerous versions. eSurveysPro, for example, offers a dozen different question types based on these three basic types. For example, you can have a multiple choice question that lets the customer choose from a dropdown list, a vertical (up/down) list of choices, or horizontal (left/right) choices. This may seem cosmetic but dropdown lists might delay participation because the customer may not see the question. And a horizontal list of choices might make your survey appear shorter than if the same choices are laid out vertically across the page and under the question.
In addition, the following are other ways to Ensure Valid Responses to an Online Survey are: * Avoid having a huge scrolling survey. Introduce page breaks as necessary. * Refrain from having one question per page, this increases the time to complete the survey as well as increases the chances for "drop outs". * Use attention filters which are trick questions that typically use a large block of text and in the center, it will ask the respondent to answer in a certain way or use skip logic to send anyone who answers incorrectly to the end of the survey. You can also track them and prevent “click throughs” from receiving any reward you offered for responding.
Then there one could use “Trap” Questions, Trap questions are designed to trap individuals who are speeding or cheating as they take the survey. The intent of the questions are obvious and if seen would be answered correctly. However, the questions are placed within a matrix question, thereby making them somewhat difficult for a speeder to spot. These questions are either answered correctly or not, and a speeder will rarely answer all of them correctly.
Examples of Trap questions are easy to design, as show below: * If you live in the U.S. select Strongly Agree (Strongly Disagree – Strongly Agree) * Please answer very unhappy (Very Unhappy – Very Happy) * How happy are you with receiving a very large bill from the IRS (Very Unhappy – Very Happy) timing.
Finally, there are timing questions which have two important uses: timing questions are very helpful in conducting experiments where it is important to track response times. It is also helpful in identifying respondents who speed through a survey, spending only a few second on each page. The timing question is valuable because you can see how long respondents were on a page. This is a powerful tool at your disposal to monitor the quality of your response data.

Assess the reliability of the collected data and include the survey report are very important validity refers to the essential truthfulness of a piece of data. By asserting validity, the researcher is asserting that the data actually measure or reflect the specific phenomenon claimed. Scientific history is full of examples of research findings that were discredited because they were shown to lack validity and reliability to me relates to researchers' claims regarding the accuracy of their data.

Assess the validity of the collected data and include the survey report.

Evaluating the usability of the online questionnaire Website and testing is critical because you should never change your survey once it is put up and advertised. Changing questions in mid-survey will distort your results, creating two surveys. Your goal is to ensure that the results you get the first time are adequate for your needs.

In Conclusion, the quality of your research boils down to the quality of your data. Use any of these 4 methods to ensure you get valid responses for your next online survey and online surveys are a great alternative to lavish mail or telephone surveys. Although there are a few requirements to online surveys you must be aware of using the internet to conduct quantitative research presents challenges not found in conventional research.


John Wiley & Son (2014) 3rd Edition, Interaction Design…...

Similar Documents

Premium Essay


...Usability When using a website, it is important that it is as simple to use as possible. Users are impatient and want to access the information on the website as quickly as possible without having to think of where to click to access this information. Users don’t read the whole content of the page, they scan it. It is therefore essential to design the web page with this in mind, therefore writing important information in bold and writing short, to the point headings. As illustrated in the figure below, this is what we have tried to convey on our website. We made sure we had the main point in bold and a bigger font. In regards to the five e’s efficient, effective, engaging, error tolerant and easy to learn, we believe we met these five characteristics. Especially in terms of it being efficient and engaging. Our website is efficient because the logo on the top left corner is linked to homepage on every page. This makes it easier for users to navigate back to where they started with the minimum amount of clicks possible. Our website is particularly engaging because we paid a lot of attention to the presentation of it to make it aesthetically pleasing to the user. The users immediate reaction to design and readability can change their relationship with the website and weather they would want to use it or not. One of the things we did to make our users of the website engage more was through the use of white space. In order for it to not come across as too cramped......

Words: 407 - Pages: 2

Premium Essay

Web Usability Analysis Project

...Web Usability Analysis Project Philip Mambo Capella University Introduction Usability is how easy an object is to use. The object can be almost anything, including a machine, tool, process, book, software application or website. Anything that a person can interact with should be usable. In the case of websites and software applications, usability has been defined as the ease at which an average person can use the software or website to achieve specific goals. Usability is comprised of learnability, memorability, efficiency, satisfaction and errors. Learnability is how easy it is for a new user to accomplish tasks the first time they visit your website. Memorability is how easy it is for someone to come back to using your website after they haven’t used it for a period of time. Efficiency is how quickly users can complete tasks on your site after they are familiar with its use. Satisfaction is whether users enjoy the design of your site and errors refers to the number of errors users make when they use your site, the severity of the errors and how easy they are to recover from. CBRE, Inc CBRE operates as a commercial real estate services and investment company website. The website is an informational and ecommerce website for visitors where they can find links to properties and can accessed the best deals. The main links are About Us, Services; Find a Property,......

Words: 3097 - Pages: 13

Free Essay

Usability Report

...Usability Report Design Human Computer Interaction Fauzi Akbar – u3097985 Table of Contents Table of Contents2 Introduction3 Evaluation4 Background4 User and User Task4 Currency5 Consistency6 Page Layout7 Security8 Instrument9 Background9 Design and Process Evaluation9 Optimizing User Experience9 Accessibility9 Currency9 Page Layout9 Navigation10 Consistency10 Security10 Conclusion10 Reference List11 Introduction Process of Evaluation This report is the evaluation of the Gumtree website at The usability report represents the process of developing an evaluation instrument specifically for the evaluation of the Gumtree at The evaluation was directed to determine the quality of the website using the instrument that was made base on HHS guidelines. The data was collected from the website using an evaluation instrument that was developed (see document 1). HHS guidelines and WCAG 2.0 guidelines were used to create a set of criteria for the evaluation instrument (see document 1). The instrument was used to determine and describe data about: * The users of the website * Who are they? * What tasks they need to do? * The Positive and Negative of the website * What can be improved? * What can be maintained? * Is the website trustworthy and safe? * Is the website easy to navigate? * The user......

Words: 2587 - Pages: 11

Free Essay


...weite-re, in der Praxis weit verbreitete Methode zur Erhebung und Dokumentation des Pro-bandenverhaltens beim Usability-Test. Beide Methoden können selbstverständlich auch kombiniert werden. Nach Mackay /18/ ist der Einsatz von Videoaufzeichnungen bei Be-nutzertests ein unverzichtbarer Bestandteil zur detaillierten, minutiösen Erforschung der Mensch-Maschine-Kommunikation auf dem Gebiet der Interaktionsforschung. Methoden der Usability Evaluation Allgemeines Unter der Erhebungsmethode der Videoanalyse versteht man die Dokumentation des Probandenverhaltens beim Usability-Test unter Einsatz einer oder mehrerer Kameras. In einer Studie /68/ zum Vergleich der Ausstattung von 13 industriell betriebenen Usabi-lity-Labs lag der Durchschnitt der eingesetzten Kameras pro Labor bei 2,2. Werden zwei oder mehr Kameras eingesetzt, dienen diese meist dazu, Detailaufnah-men des Gesichts oder der Hände des Probanden aufzunehmen. Die Protokollierung der Aufgabenbearbeitung der Probanden durch den Testleiter wird durch die Aufzeichnung auf Videoband erheblich erleichtert. < Allgemeines zur Anwendung Nielsen /23/ schätzt die Zeit für eine detaillierte Auswertung von Videoaufzeichnungen beim Usability-Test auf das Drei- bis Zehnfache der Zeit, die für die eigentliche Aufga-benbearbeitung durch den Probanden benötigt wird. Das Videofeedback findet anschließend an den eigentlichen Usability-Test statt. Testlei-ter und Proband sichten gemeinsam das Videomaterial nach kritischen und unklaren......

Words: 875 - Pages: 4

Free Essay

Paid Website Usability Testers

...Paid Website Usability Testers Kazi Ziaul Islam Strayer University Human Computer Interaction CIS375 Prof. Kourosh Samia December 8, 2014 Paid Website Usability Testers Two attributes determine if a website is useful and they are usability and utility. Utility is whether or not the website provides the required information or features. Whereas, “usability is a quality attribute that assesses how easy user interfaces are to use.” (Nielsen, 2012, para. 1) You cannot have one without the other. Suppose your site is brimming to the top with lots of information and has all the bells and whistles, but if the Interface design (ID) is poor and as a result the User Experience (UX) suffers then no one is ever going to spend the time and effort to discover those great features. This is the main reason why companies must perform usability evaluation. Although the heuristic evaluation method may take less time and is usually less expensive, the “heuristic evaluators could not play the role of real users and could not predict actual problems users might face while interacting with the sites” (Hasan, Morris, & Proberts, 2012, p. 726) User Testing is essential prior to going live in a production environment and can done on a budget. Katie Sherwin of the Nielsen Norman Group reiterates that “testing doesn’t have to be expensive and by testing with just 5 users, you can uncover 85% of the issues.” (Sherwin, 2014, para. 8) After all it is an iterative process and the law...

Words: 1754 - Pages: 8

Free Essay

Mobile Usability

... Mobile Usability Jakob Nielsen and Raluca Budiu New Riders 1249 Eighth Street Berkeley, CA 94710 Find us on the Web at To report errors, please send a note to New Riders is an imprint of Peachpit, a division of Pearson Education. Copyright © 2013 by The Nielsen Norman Group Senior Editor: Susan Rimerman Copy Editor: Anne Marie Walker Proofer: Emily K. Wolman Indexer: James Minkin Production Editor: Tracey Croom Composition: Danielle Foster Cover Design: Peachpit Press Notice of Rights All rights reserved. No part of this book may be reproduced or transmitted in any form by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission of the publisher. For information on getting permission for reprints and excerpts, contact Notice of Liability The information in this book is distributed on an “As Is” basis, without warranty. While every precaution has been taken in the preparation of the book, neither the authors nor Peachpit shall have any liability to any person or entity with respect to any loss or damage caused or alleged to be caused directly or indirectly by the instructions contained in this book or by the computer software and hardware products described in it. Trademarks Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and Peachpit was......

Words: 13847 - Pages: 56

Free Essay

Usability of Ipads and Websites

...Usability of iPads and Websites Name Professor Course Date The tablet market is growing at a high rate, the iPad being the best selling in this segment. The iPad has many uses such as; streaming videos, playing games and surfing the internet. However its usability has come under critics from several parties. The purpose of this research is to evaluate the usability of the iPad from a consumer stand point. In 2011, the Nielsen Norman conducted a research on the usability of the iPad, and published a report. A total of 26 apps and 6 websites were tested. Many apps which the participants had installed on their iPads were also tested. Sixteen users participated in the research who were evenly distributed in terms of gender. Their average age ranged between 21 years and 50 years. The tests included; the usage of gestures, implementation of the back buttons, and the organization of the app or website. The findings of the tests were; usage of splash screens in websites and apps, squeezing of information into very small areas, making it hard to recognize, usage of excessive navigation methods and over usage of the swipe gesture in the apps. Despite the efforts being made by the developers to make iPad apps and websites more usable, there is still a large room for improvement as indicated by the test findings. The use of gestures is an inconsistent interaction design as described by Nielsen. The user interface differing from app to app is the most frequent inconsistency......

Words: 933 - Pages: 4

Free Essay


...Design Process and Evaluation • Understand and meet user expectations- there is no process to understand what the user experience is. They may have collected random samples and had them use the website but it would be more efficient to prompt the user to take a random survey during or after they have used the website. They may have this but I was never prompted to take a survey. It would be nice to have an entire section or link to identify problems or make recommendations. • Use Parallel design- although the design of the website is efficient (doesn’t have any flash or glamour) it is a little bland. It has a very “government website” feel to it. If they took multiple website designers opinions and ended up with this product, they chose the wrong website designers. The site could appeal to more users by choosing a more modern layout and color scheme. This site feels like it was created on Windows 95. Optimizing the User Experience • Format the information for reading and printing- when attempting to print a page about one of the nursing homes in my area, I found that there was a lot of fluff in the page. The title bar was far too big, they had the “information” symbol in the printed copy (not needed), hyperlinks where still in the printed copy, and pages were split right in the middle of certain charts. A more universal printing layout would be more ideal for this site. • Provide Assistance to Users- when accessing the website for the first time, I was not prompted to......

Words: 1044 - Pages: 5

Free Essay

Applying Usability

...Applying Usability Concepts Project Report Executive Summary Following our contextual design project, for the purposes of recruitment, we have prototyped the interview screens in the iPad application. More importantly, the mobility gained by the use of AnyBot amplifies the benefits of the application as a whole as well. We have attempted to use technologies and apply Norman’s concepts on usability to produce an interview session as close as possible to the natural way of interviewing another person. Selected Focus Areas from project “Recruitment Tool – Intelliview” We have selected the following 2 focus areas from our contextual design project to prototype for usability purposes: Focus Area#1: Record Answers & Ratings (for a specific question) 1. (Interviewer) Select a question, and ask the candidate 2. (Candidate) Answer question using the AnyBot 3. (Interviewer) Enters a summary of the candidates answer in the iPad 4. (Interviewer) Enters a rating of the candidates answer in the iPad for the particular question 5. (Interviewer) Select next question from list, to ask the next question 6. (Interviewer) Select Add new question to record a colleague’s question Focus Area#2: Add questions from colleagues 1. (Interviewer) Adds a new question one of the colleagues asked the candidate, driving the AnyBot to the iPad application 2. (Interviewer) Add answers and rating to the new question in the iPad application 3. (Interviewer) Select next question from......

Words: 2205 - Pages: 9

Premium Essay

Assignment#03 Usability Evaluation

...15 Assignment 3: Usability Evaluation 15 Assignment 3: Usability Evaluation Questionnaire is one of the most popular techniques for gathering data, where questions in a questionnaire are designed to be answered asynchronously, i.e. without the presence of the investigator. A goal must be set, before developing the questionnaire, as developer would like to have relevant reasons before starting working on something. Targeting the participants is another important element of collecting data through online questionnaire. In many ways questionnaire is similar to interviews as questions could be open or closed. Since interviewer is not present or in a word nobody is available to interpret the questions for the participant, making the questions clear and data collection efficient -- questions need to be clearly worded. Skilled people are needed to design a questionnaire especially to gather valid and reliable data. Easy and difficult aspects of creating and conducting an online questionnaire: First, I would explain the easy aspects of creating and conducting an online questionnaire. Online questionnaire is very effective when targeting a large number of people in terms of gathering valuable information. There are two ways of doing online questionnaire: email questionnaire and web based questionnaire. Email questionnaire is not that effective and hard to reach a maximum number of participants. On the other hand web-based questionnaire can reach any region in the world...

Words: 1248 - Pages: 5

Free Essay


...April 3, 2016 C H A P T E R 3 Evaluation Methods Learning Objectives 1. Recognize differences between evaluation methods and how they support the human factors design cycle 2. Design formative and summative human factors studies 3. Understand representative sampling and the implications for study design and generalization 4. Design an experiment considering variables that are measured, manipulated, controlled, and cannot be controlled 5. Interpret results and recognize the limitations of a study 6. Identify the ethical issues associated with collecting data with human subjects 1 April 3, 2016 PURPOSE OF EVALUATION 3 TIMING AND TYPES OF EVALUATION 5 LITERATURE REVIEW, HEURISTIC EVALUATION, AND COGNITIVE WALKTHROUGHS USABILITY TESTING COMPREHENSIVE EVALUATION AND CONTROLLED EXPERIMENTS IN-SERVICE EVALUATION 5 7 8 9 STEPS IN CONDUCTING A STUDY 10 STUDY DESIGN 11 ONE FACTOR WITH TWO LEVELS ONE FACTOR WITH MORE THAN TWO LEVELS MULTIPLE FACTORS BETWEEN-SUBJECTS DESIGN WITHIN-SUBJECT DESIGNS MIXED DESIGNS SAMPLING PEOPLE, TASKS, AND SITUATIONS 13 13 13 14 14 14 15 MEASUREMENT 15 DATA ANALYSIS 16 ANALYSIS OF CONTROLLED EXPERIMENTS ANALYSIS OF DESCRIPTIVE STUDIES 16 17 DRAWING CONCLUSIONS AND COMMUNICATING RESULTS 18 STATISTICAL SIGNIFICANCE AND TYPE I AND TYPE II ERRORS STATISTICAL AND PRACTICAL SIGNIFICANCE GENERALIZING AND PREDICTING ...

Words: 11755 - Pages: 48

Premium Essay

Usability Evaluation of a Medium-Sized Erp System in Higher Education

...Usability Evaluation of a Medium-sized ERP System in Higher Education Brenda Scholtz, André Calitz and Charmain Cilliers Nelson Mandela Metropolitan University, Port Elizabeth, South Africa Abstract: The critical importance of Enterprise Resource Planning (ERP) systems in modern business has created a demand for ERP consultants with the appropriate competencies to implement, maintain and support these systems. Education and training programmes have been implemented in order to provide ERP specialists and graduates with the required industry relevant ERP competencies. The majority of these education and training programmes utilise large ERP systems for instructional purposes, however users of these systems encounter usability issues whilst learning to use the systems. The use of medium-sized ERP systems has been proposed for educational purposes as they are less complex and easier to learn than large ERP systems. Empirical studies on the usability of ERP systems, particularly for medium-sized ERP systems are limited. This paper reports on empirical research on the usability evaluation of a medium-sized ERP system. The study identified three categories of criteria and 10 criteria which can be used for usability evaluations of medium-sized ERP systems. The criteria were used in a case study to evaluate the usability of a medium-sized ERP system and to obtain qualitative feedback on the usability of......

Words: 8694 - Pages: 35

Free Essay

Usability and Security

...Running Head: USABLE SECURITY THE IMPLEMENTATION Usable Security the Implementation Name Institution Abstract This project was about usability security and its implementation. It involved the designing and development of a suitable human computer interface to provide a log on module for the Kuwait armed forces computer system. The development focused on relieving the user from the load of creating, remembering and maintaining their passwords for the login process. Based on the fact that the Kuwait information and communication technology literacy levels are still in their infancy stage, the conventional authentication system was proved unfriendly to the user. This system was developed with this in mind. This proposed system relies on the user logging in to the system after identifying five pictures they uploaded earlier from among a grid of twenty five pictures. By selecting the five correct pictures which they uploaded, the system was able to successfully authenticate the user. Using these pictures greatly reduced the mental load on a user who was required to remember strong passwords that ended up being compromised (Badre 2002). The use of pictures or graphical images for authentication or access control is a practice called biometrics that is gaining popularity in establishing system security today. Due to the need to deliver a solution in the shortest time possible the...

Words: 17373 - Pages: 70

Free Essay

Usability Testing

...Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. This can be seen as an irreplaceable usability practice, since it gives direct input on how real users use the system.[1] This is in contrast with usability inspection methods where experts use different methods to evaluate a user interface without involving users. Usability testing focuses on measuring a human-made product's capacity to meet its intended purpose. Examples of products that commonly benefit from usability testing are foods, consumer products, web sites or web applications, computer interfaces, documents, and devices. Usability testing measures the usability, or ease of use, of a specific object or set of objects, whereas general human-computer interaction studies attempt to formulate universal principles. History of usability testing Henry Dreyfuss in the late 1940s contracted to design the state rooms for the twin ocean liners "Independence" and "Constitution." He built eight prototype staterooms and installed them in a warehouse. He then brought in a series of travelers to "live" in the rooms for a short time, bringing with them all items they would normally take when cruising. His people were able to discover over time, for example, if there was space for large steamer trunks, if light switches needed to be added beside the beds to prevent injury, etc., before hundreds of state rooms had been built into the ship.[2] A Xerox......

Words: 1504 - Pages: 7

Free Essay

Web Usability

...engine able to respond to the everyday users’ terminology. 10 – Usability: Usability is how well your site is for the users to learn, lack of errors, how efficient your site is, how easy it is for the users to remember, and finally how satisfied your user is when they leave. The basics are just that the basics. When you are finished creating your site you need to make sure that all areas of your site are working properly. When making sure that the usability of your site, remember that this is important, because this is another thing that the users will rate your site on. Once your site is built, you need to constantly improve and maintain the usability, this is because the programs, and browsers are constantly changing. To do this you should have a team set up to constantly observe your site, take customers complaints to maintain the usability ease. Conclusion: Start building your site with a dream. Take your dream to reality, do this by taking care of your website, and maintaining it. Design, content, testing, layout, title, viewing experience, navigation, assistance, search and usability; these are some of the basics for creating a website, they all correspond together to help the everyday user to navigate your site. Once all things are implemented your site should be able to be navigated by everyday users. References Badre, A. (2002). Web Usability Strategy. In A. Badre, Shaping Web usability: interaction design in context (pp. 11-12). Indianapolis:......

Words: 1571 - Pages: 7