1 00:00:00,000 --> 00:00:04,002 Although traditional usability testing has been led by a moderator, 2 00:00:04,002 --> 00:00:08,214 there are now many alternatives online for running studies without one. 3 00:00:08,214 --> 00:00:12,778 Running an unmoderated study can cross into quantitative research if enough 4 00:00:12,778 --> 00:00:14,393 participants are included. 5 00:00:14,393 --> 00:00:19,658 When using these services, you provide a description of your desired audience, 6 00:00:19,658 --> 00:00:23,444 the link to the part being tested, and a simple task list for 7 00:00:23,444 --> 00:00:25,521 the participants to complete. 8 00:00:25,521 --> 00:00:29,581 The service then finds participants and provides them with 9 00:00:29,581 --> 00:00:33,892 the link to take your study on their own time in their own space. 10 00:00:33,892 --> 00:00:38,171 So why would you choose to run an online unmoderated study? 11 00:00:38,171 --> 00:00:40,270 They're fast and affordable. 12 00:00:40,270 --> 00:00:44,985 An unmoderated study takes many of the usual logistics off your hands. 13 00:00:44,985 --> 00:00:47,826 No need to recruit and schedule participants. 14 00:00:47,826 --> 00:00:49,266 No need for a lab. 15 00:00:49,266 --> 00:00:52,398 And of course, no need for a professional moderator. 16 00:00:52,398 --> 00:00:54,806 All of that is included with a single fee. 17 00:00:54,806 --> 00:00:56,425 They're also scalable. 18 00:00:56,425 --> 00:01:01,560 Since unmoderated studies contest with many participants at the same time, 19 00:01:01,560 --> 00:01:06,142 it is much easier to scale your study, whether it is to include a wider 20 00:01:06,142 --> 00:01:09,702 population or to test multiple different concepts. 21 00:01:09,702 --> 00:01:11,910 They alleviate the observer effect. 22 00:01:11,910 --> 00:01:15,854 In a moderated study, there can be a tendency by the participant, 23 00:01:15,854 --> 00:01:17,263 often unconsciously, 24 00:01:17,263 --> 00:01:21,640 to change their behavior simply because they know somebody is watching. 25 00:01:21,640 --> 00:01:26,012 They may also have a natural desire to tell the moderator what they 26 00:01:26,012 --> 00:01:28,405 think the moderator wants to hear. 27 00:01:28,405 --> 00:01:31,586 They keep participants in their natural space. 28 00:01:31,586 --> 00:01:36,188 Unmoderated studies allow people to take part from wherever is most 29 00:01:36,188 --> 00:01:37,810 comfortable for them. 30 00:01:37,810 --> 00:01:42,637 The enticing convenience of unmoderated testing comes at the expense of 31 00:01:42,637 --> 00:01:45,336 missing out on in-depth discussions. 32 00:01:45,336 --> 00:01:49,762 Consider this trade-off very carefully before choosing this route. 33 00:01:49,762 --> 00:01:55,178 Since usability testing is meant to gather insight about a person's behavior and 34 00:01:55,178 --> 00:01:59,965 the motivation behind it, watch out for unmoderated testing tools that 35 00:01:59,965 --> 00:02:04,613 only ask about people's experiences after they've used a product. 36 00:02:04,613 --> 00:02:10,371 You really want to learn what is happening during their time with your product. 37 00:02:10,371 --> 00:02:13,683 Now, let's go over the full list of requirements and 38 00:02:13,683 --> 00:02:16,710 nice-to-haves when choosing a testing tool. 39 00:02:16,710 --> 00:02:19,049 First, screen and audio recording. 40 00:02:19,049 --> 00:02:24,309 A screen recording will allow you to see how people used the mouse to explore 41 00:02:24,309 --> 00:02:29,320 each screen, where they clicked or tapped, how long they spent on each page. 42 00:02:29,320 --> 00:02:34,666 If you instruct them to think aloud and then also capture the audio recording, 43 00:02:34,666 --> 00:02:40,044 you'll get an even fuller picture of how your service is performing. 44 00:02:40,044 --> 00:02:44,032 If your budget allows for it, choose a webcam recording as well. 45 00:02:44,032 --> 00:02:47,360 Second, customizable recruiting criteria. 46 00:02:47,360 --> 00:02:52,205 Some providers will have an existing list of people to reach out to, 47 00:02:52,205 --> 00:02:55,782 which can be filtered by your audience criteria. 48 00:02:55,782 --> 00:03:01,282 However, using a pool runs the risk of working with expert usability testers. 49 00:03:01,282 --> 00:03:05,041 Find out what the service does to weed these experts out. 50 00:03:05,041 --> 00:03:09,924 Maybe they could exclude data from those who move through the test too quickly, or 51 00:03:09,924 --> 00:03:12,488 from those who entered invalid comments. 52 00:03:12,488 --> 00:03:17,264 Ideally, if you have access to your own list of users, see if you can upload it 53 00:03:17,264 --> 00:03:22,425 directly into the tool to make sure you're reaching your exact desired audience. 54 00:03:22,425 --> 00:03:24,759 Third, ability to test anything. 55 00:03:24,759 --> 00:03:31,170 Can participants use any device, computer, tablet, or phone? 56 00:03:31,170 --> 00:03:35,305 Are you limited to a live website, or can you upload images as well? 57 00:03:35,305 --> 00:03:41,865 Make sure that the tool you're choosing can accommodate the state of your project. 58 00:03:41,865 --> 00:03:44,340 Fourth, customizable tasks. 59 00:03:44,340 --> 00:03:49,234 Many services will provide their own sample tasks for you to choose from. 60 00:03:49,234 --> 00:03:52,930 Although this might be a good start, this is not enough. 61 00:03:52,930 --> 00:03:58,096 With no moderator present, participants will need very clearly worded, 62 00:03:58,096 --> 00:04:00,066 product-specific tasks. 63 00:04:00,066 --> 00:04:03,104 Poor tasks will equal poor data. 64 00:04:03,104 --> 00:04:06,368 Fifth, timing of questions. 65 00:04:06,368 --> 00:04:11,109 Most services will offer the ability to ask questions at the end of the study. 66 00:04:11,109 --> 00:04:16,991 However, you will also want the ability to ask questions after a specific action. 67 00:04:16,991 --> 00:04:22,158 For example, what were you looking for when you clicked here? 68 00:04:22,158 --> 00:04:23,753 6, speed. 69 00:04:23,753 --> 00:04:26,393 Is your project on a tight timeline? 70 00:04:26,393 --> 00:04:30,975 If so, you can pay more to get your results back sooner. 71 00:04:30,975 --> 00:04:34,809 7, quantitative analytics. 72 00:04:34,809 --> 00:04:38,653 Does the tool allow you to track quantitative metrics, 73 00:04:38,653 --> 00:04:42,350 such as task completion or general usability score? 74 00:04:42,350 --> 00:04:46,512 This is not required, but if they do have this ability, 75 00:04:46,512 --> 00:04:52,016 make sure you know how that general usability score is being calculated. 76 00:04:52,016 --> 00:04:54,307 8, longitudinal studies. 77 00:04:54,307 --> 00:05:00,217 You can choose to continuously run usability tests on your website and 78 00:05:00,217 --> 00:05:01,821 receive monthly or 79 00:05:01,821 --> 00:05:07,847 quarterly reports showing how performance may be changing over time. 80 00:05:07,847 --> 00:05:12,306 I can't recommend an exact tool for you, since the options are always changing and 81 00:05:12,306 --> 00:05:14,165 your needs will be unique as well. 82 00:05:14,165 --> 00:05:15,822 However, to get you started, 83 00:05:15,822 --> 00:05:18,834 I have provided a few examples in the teacher's notes. 84 00:05:18,834 --> 00:05:20,152 Good luck.