Bummer! This is just a preview. You need to be signed in with a Pro account to view the entire video.
Contextual Design: Creating the Anytime Everywhere Experience32:44 with Joe Johnston
Interaction with applications and websites can happen everywhere and anytime. Understanding who your user is is only half the battle – you need to know how they'll be using your site, where they are and what they want at that moment in time. Screen size isn’t the only thing that's different about mobile experience. Are they walking through the aisle of your store, comparing the price with an online retailer? Learn how contextual design can help enhance your experience and find out how other companies are beginning to explore these kinds of interactions.
[UNKNOWN] I'm Joe Johnston. 0:00 I work at a great place called the Universal Mind which 0:03 we create custom software applications for a lot of different clients. 0:08 But one of the other things is I'm also, like 0:13 he stated, Director of User Experience, and Director of R&D. 0:15 At Universal Mind so that gives me a chance to have 0:19 a lot of fun and play a lot of cool things 0:23 because I have both the R&D side and I have also 0:25 the great user experience side like many of you individuals here. 0:28 So it's a lot of fun to do a lot of that great stuff and by the way 0:32 I also love candy, so if you grab candy out there feel free to throw it on down. 0:34 I know it's almost lunchtime so I'll try to keep 0:39 this short cuz I know you guys are all hungry. 0:40 The other thing though, is. 0:42 You see that thing down there? 0:43 That's a playbook. 0:44 I don't know how many people remember those things, but I definitely played with 0:45 a lot of those things and unfortunately, it's not around a whole lot anymore. 0:48 But it was great to test on and actually a really cool device 0:52 so we get to play a lot of neat things at Universal Mind. 0:54 So today I want to talk a little bit about this thing 0:58 called contextual design and I, I know there's a lot of conversations 1:00 around it now, especially with a new book that recently came out 1:03 by Robert Scoble, and his partner, writing about the age of context. 1:07 So I don' t know if anybody's read it or not, or 1:12 have, have seen that, but he's been to a lot of conversations. 1:13 More on the technology side of where this context up. 1:16 But that ultimately rolls into the user 1:18 experience side and the design side of things. 1:20 And really what you kinda gotta be. 1:22 Prepared for, when getting into this, what he called the 1:23 age of context, or what I like to call contextual design. 1:26 But what really is contextual design? 1:30 Well, [LAUGH] by definition it's the, it's some of these, 1:32 these, these, related things happening together in some sort of context. 1:35 But really what does that mean in the sense of us as designers, 1:41 us as developers, us as people that want to take advantage of these technologies. 1:45 Well, it comes down to really three basic things, right? 1:50 So it's actually what the user is trying to 1:54 accomplish at that particular moment which is tremendously difficult 1:57 to do, and, and that's why we are all 2:00 trying to focus on user experience side of things. 2:02 But also where they tried to accomplish it, so obviously location's going 2:04 to be a part of this but that's much more than that. 2:08 And where, what they're trying to accomplish it on so 2:10 that actual device, the context, inside of the car, on 2:13 a, a refrigerator, whatever that might be those are all 2:16 pieces of context that we have to be prepared for. 2:19 So, I know we've talked a little bit. 2:22 I've seen some of the sessions of what 2:23 I'm talking about where all these things come from. 2:25 I know there's a lot of talk. 2:26 There will be a lot of other sessions tomorrow as well about, you 2:28 know, obviously mobile first the session 2:30 just before this talking about that obviously. 2:32 Luke W and all the great work he's 2:34 done there defining what mobile first is and actually. 2:36 We talk to a lot of clients about this, and 2:38 it's, it's quite a challenge for them to kind of go 2:40 from that desktop world, that era, into now a mobile first 2:42 methodology, starting there and understanding 2:45 that, that word a little bit. 2:47 And then how that jumps into responsive web design, so 2:49 actually taking mobile first and executing it from a level of. 2:51 Designing something across all these different devices, not only do we 2:54 have handheld devices, but now like I said earlier, now we 2:57 have to design things that are all over the place which 3:00 I'll showcase in a little bit talking about some other things. 3:02 So you take all those two kind of combinations 3:05 of mobile first kind of methodology and design of 3:07 practice, combine that will more of a responsive design 3:10 approach in certain technology or certain type of implementations. 3:12 And then actually, the third thing is actually coming 3:16 into the contextual design type of piece of it. 3:18 So, a little sidebar here on, on, I wanted to 3:21 talk a little bit about the the slow low mo 3:24 kind of abbreviation that we put on some of these 3:27 things, but I wanted to add a little bit to that. 3:29 And what this really means is actually 3:31 the social, the location, and the, the mobility. 3:34 So these three things. 3:38 And I added two more to this piece of the equation. 3:39 This comes from, comes from the Age of Context books 3:41 which brings up the fact of the sensors and the data. 3:44 These two other pieces take all five of these and that really starts 3:48 to conform into what a real, cohesive, 3:52 contextual design approach really boils down to. 3:55 And we think about sensors, and, and all the world around us today. 3:57 Everybody's phone is pretty much a sensor, and other types 4:00 of sensors inside of your home, inside of your car. 4:03 And take all those things, and you start combining that 4:05 into the realm of learning about that particular user at 4:07 that interaction point, and so we can, start figuring out 4:10 exactly what they're trying to accomplish at that given moment. 4:13 Now, understanding the data behind that. 4:16 Now, there are terabytes of data being sent every 4:19 single day in a matter of milliseconds, up to 4:22 the cloud, up to the different types of servers, 4:25 and being able to take advantage of that, it's not 4:27 really about sifting through that particular piece of data, 4:29 or having all this great, what they call obviously, 4:32 big data, the big word, that they're using To 4:34 be able to basically confine that to understanding a user. 4:37 That's really what it's, what it's really talking about in this big data sense. 4:41 It's not really the amount but it's the small, minutia points inside of that 4:44 data that you have to try to pull out for that very individual particular user. 4:49 That's where the actual power of that big 4:52 data comes from is actually defining that individual, 4:54 where they are, how they're interacting with that 4:57 particular device or that particular experience they're having. 4:58 Throughout the course, day, or their work, work week. 5:02 Now this is a very interesting, article. 5:07 This was done by Google, I, I, I think a year ago. 5:10 Some of you may have seen it. 5:12 But it's fairly large document that walks through the 5:13 different types of, multi-screen process that an individual has today. 5:16 So think about what you do on a daily 5:21 basis and how many times you interact with your laptop. 5:23 How many times you interact with the tablet. 5:25 How many times you interact with a phone. 5:27 You combine all those and what really it comes down to 5:29 is you're using that device based on the context that you're in. 5:31 So if you're driving in a car or if you're on a train. 5:35 If you're in a shopping mall. 5:38 Those types of context in to you using a particular device. 5:40 And it's also transversing through that in a particular experience. 5:44 So if your on your desktop looking for a piece of information and then you 5:47 move into the car and you want to continue that mode of looking for that information. 5:51 You go from one device to another device, 5:55 how do those experience connect to each other? 5:57 So those are the types of experiences form the multi device, multi. 6:00 Faceted type of approach that Google talked about in this document here. 6:03 But the interesting thing is way at the end 6:07 down there it talks about attitude, and it talks about 6:09 almost the, the motion you have or the emotional 6:12 state you have by which you start interacting with something. 6:15 That's another piece of this as well, is how your user 6:18 is going to be interacting with your experience based on emotional state? 6:20 So that's a really big part of it that we don't really get the. 6:24 Chance to talk about really in depth too much. 6:27 In the sense of, contextual design. 6:29 A piece of this, and I have some links. 6:32 I'll be posting this, this, deck up, up to, probably a server somewhere. 6:35 So I'll, I'll send out a link. 6:39 so, to boil this down, to really understand. 6:42 Taking this data. 6:44 Understanding how it actually revolves around contextual design. 6:46 So I grabbed this data from Luke W's site. 6:49 This is actually some data back in I think in 2011. 6:52 There's an app that you used to be called readitlater. 6:55 And obviously what it did was save a particular site, and 6:59 you can read it later at a different point and time. 7:02 It was renamed now since it's called pocket. 7:04 They have an iPad, and an iPhone application. 7:07 This data here is a collection of the usage over a course 7:10 of time and is broken up per day for the iPhone application. 7:14 So you can see the usage numbers spiking at these particular times of day. 7:19 So if we start to overlay kind of what 7:24 we are anticipating, what is happening from that contextual side. 7:27 You start to, start to see, that you know, 7:31 a high peak of percentage is in this mobile transit. 7:34 In the morning, while people are on the 7:37 bus, people on the train, people traveling to work. 7:39 They're trying to read that information or the usage is really high. 7:41 And then the or I'm sorry the morning, 7:44 and then the commute there, there again spiking. 7:46 During the, during the work day obviously they're doing some sorts of 7:48 work so they're not really focused on the particular usage of the application. 7:52 But come to the commute home and then obviously after dinner 7:55 they're in the evening there, they're actually re-engaged with the content. 7:59 So now, knowing this data on the iPhone you could 8:02 actually start to understand, just this limited form of data. 8:05 You can start to understand how the user's using it. 8:09 Now, couple this with actual observational and ethnographic 8:10 research and watching people interact with the application. 8:14 You start to combine those two things and then 8:17 you have a very powerful case to start building 8:18 some things in the application to cater towards these 8:21 maybe the commutes, maybe the evening type of interaction. 8:23 You take the same data for that same 8:27 application, and you transpose it onto the iPad. 8:29 So this is the data just for the iPad 8:32 application over the course of the same amount of time. 8:34 As you can see, the high peaks of interest, 8:37 or the high peaks of usage in this application. 8:41 Are the commute or I'm sorry the morning and then the evening. 8:44 We all know that the iPad has become this sit at 8:47 home on the couch and, and have this iImmersive experience with it. 8:49 So they're reading it, reading the information 8:53 they saved of course through the day. 8:55 They could have saved this information through the 8:56 iPhone earlier in the morning and then come 8:58 back home in the evening, now they're on 9:00 the iPad experience that same application, same content. 9:02 So it's a really interesting thing you can just 9:05 take a look at from even from a data side. 9:06 And like I said, coupling that with more observational infographic research, 9:09 that's where your research is gonna have this powerful interaction standpoint of 9:12 understanding really what your users are 9:16 trying to accomplish, using or experiencing 9:17 your platform or your application, whatever it might be in that sense. 9:20 So this is just some kind of, data here that I wanted to show really quickly to 9:23 represent how this could start to formulate using 9:27 your own data to kind of transpose and to. 9:29 Time and space but your users are using that. 9:31 There's a lot of other things involved. 9:33 I'm just showcasing one small piece of it. 9:35 Now I want to get into actually talking a little bit about what, what are 9:37 things that you can take and build 9:41 into or understand from a contextual design perspective? 9:43 And, and a lot of times we forget that these devices have audio. 9:46 Well not just to pump out audio, it's actually to input audio as well. 9:50 So, sometimes we tend to forget that when we're interacting with 9:55 an experience we can actually use the audio to our advantage. 9:58 Now there's some really cool applications which are 10:01 shown a little bit, that utilize audio to 10:02 us point to where it's actually using it 10:05 to create an experience, which is very fascinating. 10:07 And I'm not gonna say it's gonna be used 10:10 for everything that, that maybe you guys are using today. 10:11 But it's one thing to make sure you think about if you're a 10:14 particular, building an experience, how audio could, could pose a piece of that. 10:16 [SOUND] Another one is calendar. 10:21 So obviously we, we've seen the Facebook calendaring 10:25 starting to be integrated into different types of applications. 10:29 So the APIs now allow us to peer into your personal calendar. 10:34 Now, that may be scary, which I'll 10:39 get into the privacy concerns, which is another 10:40 big topic which I could probably spend an hour talking on and having debates, but. 10:42 The big thing with this is that now you can actually take in consideration 10:47 not only where that user is, what 10:50 they're doing on their, your particular application 10:52 or site, but now you can actually look at their personal calendar or work 10:54 calendar and actually serve up the experience 10:57 in, in form of context whether or not. 10:59 They are maybe on vacation verse at work. 11:01 So you can actually cater that person in 11:04 a contextual form and looking at their calendar. 11:06 Now, like I said, they would have to give 11:08 up the permission to allow you to see that. 11:10 But them giving up the permission to see that 11:12 is allowing you to create a better experience for them. 11:14 So the trade-up is there. 11:17 Now, this is going to be a very interesting 11:18 conversation once I get to the privacy side of things. 11:20 But you can understand how powerful this is, 11:22 but also on the other side, how scary this 11:25 could be in the sense of starting to collect 11:26 this personal information that they're willing to give away. 11:29 The other thing on, on location. 11:33 I'll take a drink of water real quick here. 11:35 [SOUND] Location is interesting. 11:37 And obviously we always think of it as like, oh 11:43 I'm in this particular spot, show me what's around me. 11:45 Well, I think we're gonna start to understand location's gonna be a really 11:49 interesting piece of the whole contextual design, age of context kind of realm. 11:52 This statement here I grabbed from Twitter a 11:57 little while ago, and I thought it was very 11:58 interesting cuz he's thinking of context, the context 12:00 of location a different way to optimize his experience. 12:03 So what he wants to do is actually type in a location, lets say he's at a foreign 12:06 city or he's at a different type of city, he wants to type in where his location is. 12:10 Or hey, meet me on the corner of whatever. 12:13 Now, obviously there's other ways you could show me where 12:16 he is or his friends, but what he wanted to 12:18 do is actually wanted the dictionary to say the location 12:20 of the street he was on and be location aware. 12:23 So that could be happening in the background, so just 12:25 something simple like that is gonna make a user experience. 12:27 A lot more comfortable maybe for a person to type in maybe a city that 12:29 they are in, in London or Paris or 12:33 whatever that might be and it would automatically 12:34 pull up that name based on location, the 12:36 dictionary could start looking at that and I 12:38 think that is where we are going with 12:40 a lot of these micro-interactions that are happening. 12:40 Location is another big thing to think 12:44 about and this gives another twist to that. 12:46 And in the living room, right, so I mean obviously we always talk about, 12:50 or, more and more now we're talking about the second screen and how that's gonna 12:53 be involved with the usage today, there's still a lot of things trying to figure 12:58 out what's the most optimal way to 13:01 showcase a second screen experience without taking away. 13:03 From the main screen experience. 13:06 And, it's gonna be a very delicate balance for quite some time. 13:07 But, I think they're starting to finally realize what people want to interact 13:10 with, what they don't want to interact with while they're watching a TV show. 13:13 And, are obviously, I think sporting events is really key. 13:16 But, this is just some numbers and you may or may 13:18 not be able to see them, from way in the back. 13:20 But just from some usages from a little while ago. 13:22 I think Nealson had this like a year ago. 13:24 Some data around usages and how inter, interact, people interact with a 13:26 mobile device in this case a tablet while they're watching a television show. 13:30 And you can see that obviously I need to break it down by male and female. 13:34 So you can actually start collecting some of this data and 13:37 understand what's happening while people are actually interacting with the TV. 13:39 So this is another space where they're actually gonna try to 13:42 take advantage of some interaction that will be happening and how that. 13:45 Once we have these smart TVs, how does 13:48 that hold context of watching, and, and exploring 13:50 a television show interact with a tablet or 13:53 phone that I may have sitting at my couch? 13:55 And 13:57 then obviously device. 14:00 So device the one thing that I don't have up here is 14:01 wearable devices which is I'm gonna talk about in a little bit. 14:04 Those are another thing that's gonna be a huge. 14:06 Influx of user experience customization for an individual. 14:09 This is huge in the sense that oh, these devices, but now 14:13 we're gonna have these wearable devices that we're going to be able 14:17 to take multiple, you know, data points, not only on the person, 14:19 but the lifespan of the wearable device and what they've interacted with. 14:22 It'll be very interesting to see, these wearable 14:26 devices and how they start to conform to 14:28 user experiences that you may have with other 14:31 devices that may be able to read that data. 14:34 And this is another piece too, on the onside of the responsive web design. 14:35 We'd always talk about progressively enhance the experience. 14:41 If you guys don't understand that degradation is 14:44 going in the reverse direction, starting with the. 14:46 A desktop or laptop experience and then trying 14:48 to cut down to a mobile type of experience. 14:50 Obviously we advocate starting mobile first, if that's appropriate 14:53 in your situation, and going and progressively enhancing that experience. 14:56 Well, that's the same thing you need to 15:00 do with, with doing these contextual design experiences. 15:01 Don't just eliminate information, just because you think they might 15:04 be experiencing something in a location, or a particular environment. 15:08 So, make sure you, what we like to 15:11 say is, don't remove information, just prioritize that information. 15:13 So that way you can start to have that user 15:16 interact in a certain manner, and you're not eliminating content. 15:19 They're not looking like they're missing out on something, 15:22 or that they have to go do another device. 15:23 Or another laptop, or another desktop, to try to experience 15:25 the rest of whatever it is you want them to experience. 15:28 So make sure you understand the situation that, that, that they're in. 15:30 And progressively enhance that experience as you, as 15:34 you go through the different types of screens. 15:36 Whether that's, you know, now we can start the 15:38 wearable device and move up to the mobile phone. 15:40 So it's gonna be very interesting to see what that, what that comes. 15:42 There is this agency that actually produced, it is a very, I think, 15:46 interesting ways to visualize multi-screen experiences 15:52 And these give some names to what 15:58 these all mean and you can kind of start to correlate, this app 16:00 does it in this way, and this app does it in that way. 16:03 You start to realize that. 16:05 There are multiple ways you can have multiple devices, 16:07 or multiple types of things interact with a experience. 16:10 So I mean we have, obviously now screen sharing capability. 16:14 We even have you know, syncing capability across Evernote, as a good example 16:17 of syncing all your content across 16:21 all your different devices using that application. 16:22 But there's also different types of interactions that you would have. 16:25 We talked about the TV, a sporting event, and how 16:29 you could actually have multiple people interact, with that live event. 16:31 And then you all are connected together. 16:34 How does that experience, interact with the users and the devices that you're in. 16:36 So, there's a lot of different ways to just interact with 16:40 multiple devices and a piece of an experience or a platform. 16:45 So I just wanted to showcase that a little bit to kind of start 16:49 to make you guys think a little bit about multiple ways to do that. 16:52 Here's a few things to remember. 16:55 There's obviously mobile, on a mobile device and this is 16:56 probably a little bit talked about too in other sessions. 17:00 Just because you're on a mobile device doesn't 17:02 automatically mean you're on a slow bandwidth connection. 17:04 Now there may be the case more then you would at a 17:08 laptop, but I bet I have a slower connection on my laptop too. 17:10 So there's a lot of cases where you just 17:13 can't design an experience just because they're on mobile. 17:15 Make sure you try to figure out what kind 17:17 of connection they have and serve the correct experience. 17:19 So there's a lot of things you don't want to just assume that they're doing. 17:21 And that rolls into context doesn't always need a tent. 17:24 So this is where those little micro 17:27 interactions of data and that big data set. 17:29 Understanding what the user's trying to do the best you 17:31 can, it's gonna be able to serve up the better experience. 17:34 Not just assuming, oh I'm in a retail store, I must wanna buy something. 17:37 Maybe they're not there for that occasion. 17:41 So there's some things you can do there. 17:42 To understand. 17:45 And that goes back to, obviously, 17:46 understanding the user experience in general. 17:47 And then, here's where the privacy stuff starts to talk about. 17:50 I can't take credit for this particular 17:53 verbage, it is actually came from Forester. 17:56 What they like to call it is it's big mother, not big brother. 17:58 So, it's going to be a cultural and a. 18:01 Interesting time for people to start to transition from 18:04 that privacy, holding on to their privacy cuz they're 18:07 scared that someone's gonna do something with it, to 18:10 letting it go for them to create a better experience. 18:12 The trade-off needs to be there, and I think and it was 18:15 interesting noted in the book of Age of Context, they actually talk about. 18:18 We're not gonna be totally comfortable with 18:23 this whole new on site of contextual design. 18:25 Until we understand as much about 18:27 technology, as technology understands about us. 18:29 So we think about that for a second, if 18:32 you could actually, imagine all the data guys went to. 18:33 Website's, applications, location. 18:36 Imagine all that data. 18:39 Obviously we understand it a little bit. 18:40 But, if imagining that people could 18:42 actually understand how that's actually being used. 18:43 They'll be okay with actually giving up the privacy 18:45 knowing that they're gonna get a better experience in return. 18:48 So until that kind of clicks in a 18:50 lot of mainstream users heads and, and, and consumers. 18:51 That's when that you know tipping ship is gonna happen. 18:55 But privacy is gonna be a very difficult thing. 18:57 And obviously with wearable devices that even 18:59 becomes another huge standpoint of, of, of concern. 19:02 So how do you create these experiences and I 19:07 wanted to point the everyone familiar with the Goldilocks Principle? 19:09 It's kind of why we're here on earth, it's the 19:12 perfect right spot, right time all that kind of fun stuff. 19:14 Well, that, that's exactly what you're trying 19:17 to do is create the just right experience. 19:19 And that is extremely difficult to do. 19:21 There's so many things that you need to do to lead up to that experience. 19:23 You have to understand users. 19:27 You have to do all the different types of research. 19:28 You have to test. 19:29 You have to iterate again. 19:30 And test again. 19:31 And get all that feedback. 19:32 And start creating the just right experience. 19:33 So we wanna try to target that and that's where that pendulum there is, is, is. 19:35 This bell curve sits. 19:38 Is that's what you're trying to create, and it's trying to take 19:40 that mental model of that user, trying to interact with your experience. 19:43 That's what you want to try to uncover, and there's a lot of, I 19:48 could go another whole session on talking about the different techniques to do that. 19:50 But this is what we're trying to do is accomplish this just right experience. 19:55 Yeah, so then I wanted to touch a point on this too from 20:01 the standpoint of understanding the devices 20:05 and how you interact with them and. 20:07 Obviously, some of you may have known the whole dog 20:09 fooding experience that Facebook had trying to create Facebook Home. 20:11 They created a android application and unfortunately they had a lot of IOS 20:15 developers create that, and they didn't 20:19 have enough testing in the android platform. 20:20 So when the consumers used the Android application, they were a little 20:22 frustrated with it, because they didn't really do their own dog food. 20:25 They didn't eat their own dog food from the sense 20:27 of having Android designers, Android 20:29 developers actually build that whole experience. 20:31 With this is becomes very difficult even at, at Universe of Mind, 20:34 we have a lot of Different individuals that, they live and breath Android. 20:37 And that's what they do, and it's not to the point where 20:42 they use it for work, they use it for their own personal use. 20:44 And that's very important, because when we 20:47 start designing experiences that span across different platforms. 20:48 You need to have that understanding from a user interacting with an Android device. 20:52 It's slightly different than that of an IOS device. 20:56 So when you start designing this 20:58 contextual design platform across multiple devices, make 21:00 sure you have at least an understanding and are experienced with that platform. 21:05 So if you're designing it for a car you're gonna have to make 21:09 sure that you have that type of car and that type of experience. 21:11 Same thing with other de, devices. 21:15 And again wearables are gonna be a big part of this. 21:16 So I just wanted to drop this in here and make sure that we kind 21:19 of are aware with this whole dog food and eat your own dog food scenario. 21:21 Now I'm gonna go through a couple of examples 21:24 of how it's used today and some of these are 21:27 older and some of these are newer and some 21:28 of these are ones that I really enjoy showing so. 21:30 Here's what I talked about earlier about the audio. 21:32 So this one's really cool. 21:34 It's, I don't think it's in the US app store. 21:35 I'm not sure which one it's in. 21:38 But, [LAUGH] the fellow built an app, and 21:39 this was actually for the brand Baby Carrots. 21:41 So, little carrots you get in that little package and you eat those. 21:44 So, the big thing was with carrots is the freshness, right? 21:47 Is biting into that carrot and getting that freshness. 21:50 Well, they actually built an app around that whole concept. 21:52 So they actually took, and when, so the whole idea of the game is you're this 21:56 guy in this shopping cart, and he's going through the city and they way to give 21:59 him bigger boosts or make him go faster is actually you take a bite of a 22:03 real carrot, and you bite it in then the sound actually give you a faster boost. 22:07 So it's a very interesting twist on the game. 22:12 But they actually talked about how they actually got the 22:14 audio to match up exactly to the crunch of the carrot. 22:17 And they did a lot of algorithms and audio recordings and got the snippet just right. 22:20 And you actually could just determine between biting 22:24 on a pretzel versus biting on a carrot stick. 22:27 It was very interesting, and what if the whole thing. 22:30 It was a really cool game, I don't, 22:31 actually haven't played it myself, I've seen it played. 22:33 But unfortunately I don't, I can't download that but we definitely 22:36 a very very cool game and that's not a part of audio 22:40 so nobody would really think tying, biting into baby carrots would be 22:42 a fascinating game but it is turned out to be really cool. 22:46 Obviously pay with square I mean this is the kind of the first foray into. 22:51 Personal identification in that digital wallet 22:56 scenario where we're all gonna be going. 22:58 And another jump to this will be wearable devices which I'll talk 23:00 to in a second about having a personal content and your personal identity. 23:03 So if you're not familiar with Pay With Square which I'm 23:07 sure probably most of you are, it's based on a visual. 23:09 Authorization so, you have the phone. 23:13 You could pay for your drinks. 23:15 You leave your phone in your pocket, you walk into a Starbucks. 23:16 The person on the other end, if they 23:19 have the Pay with Square application on their iPad. 23:20 All you have to do is walk up and, and tell them 23:23 what you want, they visualize, or they could see who you are. 23:25 They validate who you are and they charge it to your card. 23:28 So the whole process is very seamless and the best, authentication is the visual 23:30 nature of having a picture on the screen match up to a picture of yourself. 23:35 So we're gonna start seeing this onslaught of, mobile devices. 23:39 They're gonna stay in your pocket. 23:43 And that's when you're gonna start 23:44 utilizing these wearable devices, more and more. 23:45 So this is the type of experiences the. 23:48 As you say are some of the articles that are written about the invisible 23:51 UI, so it's these experiences that you 23:53 can't see, and how that interaction model goes. 23:55 This ones a, a pretty cool interesting, this is actually a store I can't 24:00 remember, in Europe here, that actually what 24:04 they did was, they actually had digital hangars. 24:07 Any digital hangers, the little LED numbers which 24:11 are actually Facebook likes coming from their Facebook page. 24:13 So now, people could actually go online, 24:17 and like certain pieces of articles of clothing. 24:19 And then actually digitally display them in physical nature at the physical store. 24:22 Now, I don't know how much this varies based on 24:27 what their percentage of people buying particular piece of clothing, but 24:29 I thought it was a very interesting verge from the 24:32 digital and physical world of social, into the physical retail world. 24:35 So I don't know, either people are gonna be start buying all the same 24:39 stuff, or they're, they're gonna be finding 24:42 out which things are better than others. 24:45 So it's a very interesting, how they tap those 24:46 into those, and you'll start seeing more of these. 24:48 Show, show rooming type of scenarios again with devices and experiences. 24:50 And some of you probably use this now, Google Now, so it's actually, that's 24:56 kind of a digital personal assistant, serves 25:00 up content based on context and time. 25:02 And the more you give it privacy wise the more it's gonna give back to you. 25:04 So there's that trade off. 25:09 So it gives you from weather to sports scores to all your calenders from work. 25:10 To airports all that ticketing information, all that stuff rolled into 25:14 one actually serves it up in real time and they have 25:18 a whole card, card design theme which they kind of play 25:20 with and it actually worked really well across all the different devices. 25:23 I recommend playing with it if you get 25:27 a chance, it is really, really interesting how they 25:28 are starting to serve out that content and 25:30 it just grows and it gets smarter over time. 25:32 Obviously, Google having tons of all that data available is, is key. 25:33 Now this last one here, from the standpoint of ideas 25:39 that are currently out there, this thing is called, All Recipes. 25:41 I don't know if anybody has used it or not, but what it does, and this is 25:43 probably the best example, from contextual design, from 25:47 usage to actually devices and, and passing across those. 25:50 So, what you do is actually go on your laptop. 25:54 Find a recipe you're looking for. 25:55 So, you start on your laptop looking for that information. 25:57 You move that information over to a mobile phone app which is your shopping list. 25:59 So, you take your shopping list, put it on your mobile phone. 26:04 You go into the store, which I'll get into in a 26:06 second on our next few slides, and actually find all that ingredients. 26:08 And then you can check that off. 26:11 You go back home and now you pull out your iPad 26:13 and now you put your stand up and that's your cookbook. 26:15 What they did though was the cook book has 26:17 a lot of very interesting things in it, but 26:19 they also designed the cook book knowing that you're 26:21 using your hands, your hands are gonna get dirty. 26:23 They designed it for the touch points being big enough where 26:25 you can use your knuckle to actually navigate through the experience. 26:27 So, but thinking about all those micro interactions of 26:29 people interacting with the experience at a certain time. 26:32 So those types of things that are, that 26:35 are really gonna set apart the experience and of 26:36 course from a customer standpoint they're really gonna 26:39 enjoy that, and come back and use it again. 26:41 Some of those experiences, I love. 26:44 This is my favorite from the, [UNKNOWN]. 26:45 So there's a lot of other examples, obviously. 26:47 The next few slides here are kind of what's coming in the 26:51 sense of, what are the next things, that you're gonna be seeing? 26:54 And this is where I'll get into some of the, wearable devices and such. 26:58 But I'll jump through some of these. 27:01 I don't know if you're familiar with Chameleon or not. 27:03 But it's. 27:04 It's an Android tablet platform that actually conforms to 27:05 time of day, basically pulls in all the information and 27:08 change your, changes your entire platform in your screen 27:11 to serve up a content versus what you are doing. 27:14 So, this is actually at home entertainment style screen that you are seeing here. 27:17 It actually have a five, I think four other screens, one for work. 27:21 One for movies and play. 27:24 And then walking through those experiences. 27:26 So as you go from one wireless network to another, it starts to remember, oh, 27:29 this is a work network, or this is a home network, or time of day. 27:32 It's actually smart enough to start to add up all that information and actually 27:35 serve up content for what they anticipate you might be doing in that context. 27:38 Although. 27:42 Understanding there may be ways to jump out of 27:43 that to get into another context, but it's really cool. 27:44 They're changing the entire OS of the, of the platform. 27:46 Estimote [INAUDIBLE] beacon, [INAUDIBLE] beacons. 27:50 I'm sure, I, I think, Tammy showed this video in a session over 27:54 at the rising stars side, but this is a very cool thing from. 27:57 Not only low Bluetooth technology, but also [INAUDIBLE] beacons in 27:59 general, how it's gonna you know, revolutionize what we do today. 28:04 This little device over here actually beams out 28:07 sensor information and then you can have, take 28:09 a device whether that's any particular device that 28:11 listens for this particular sensor and actually can 28:13 textually change the information based on what that 28:16 sensor is sending So, they actually have a 28:18 video here and I'm gonna show it really 28:20 quickly cuz I know I'm running short on time. 28:21 But that thing lasts for two years. 28:23 So, that's just a low power Bluetooth emission. 28:24 So, you can imagine now we're getting 28:27 into the realm of these things being disposable. 28:28 That you can just leave on this podium or on 28:30 that particular desk and, and watch people interact with it. 28:32 So, they actually have a retail experience [CROSSTALK] 28:35 >> The phones we carry around are pretty smart. 28:37 [MUSIC] 28:39 But they could be a lot smarter. 28:39 For example, they can connect to a server 28:41 in another part of the world, but they have 28:43 no idea that you're in a kitchen, in a 28:45 conference room or shopping at your favorite retail store. 28:47 They lack micro-location context, but now that's changed with estimote beacons. 28:50 They use new Bluetooth smart technology supported by all major 28:55 mobile platforms including the recently announced iOS 7 with iBeacons. 28:59 Put anywhere in the physical world they broadcast contacts and 29:04 location to all compatible phones and smart devices in range. 29:07 Phones can now automatically pick up the signal, 29:10 and trigger contextual actions designed by business owners. 29:13 Customers can enjoy a seamless experience with 29:16 more information about the products that interest them. 29:18 Photos, videos, reviews, personalized pricing, and even social updates. 29:20 As they browse through the store, their phones will transition from 29:26 one item to the next based on their proximity to the display. 29:29 Enhancing the shopping experience, every step of the way. 29:33 Also business owners can now benefit from 29:36 quanitative location data, on visits, and customer feedback. 29:38 Better for business, and a better experience for shoppers. 29:42 Smart retail solutions by Estimote. 29:45 Preorder now on estimote.com 29:48 >> So you can kind of start to see how that little device 29:50 can actually transform contextual design, all 29:55 in general with all of retail experience. 29:57 So, they're actually talking about putting these things for home automation as well. 29:58 So now you can actually detect when a person enters the room. 30:01 Now that room can conform to them, from 30:04 lighting, to sound, all that kind of fun stuff. 30:06 So it's really cool to see those. 30:08 I only got a few more minutes, obviously magic bands. 30:10 You've guys seen the new Disney stuff this is actually a 30:13 wearable device that Disney will be releasing, it's in beta right now. 30:15 So if you go visit Disney parks you can actually register 30:18 to get these bands, all your individuals that are going would wear 30:21 these bands, all the information is stored on that from room 30:24 keys to photos to buying and purchasing all the snacks and food. 30:26 So it's going to be really quite obviously tracking. 30:30 All the tracking information. 30:32 If you happen to lose your child, you 30:33 can find your child using this particular band. 30:35 So there's a lot of great wearable devices in general, I just showed this one. 30:37 Obviously there's several from Google glass to fit bits to 30:41 Nike fuel bands as well as many more coming out so. 30:44 But that's also one that's very, very cool. 30:47 Keep an eye on that one if you ever get the 30:49 chance to go to Disney, make sure to check it out. 30:50 It's a really cool experience itself. 30:53 I'm gonna jump to the end here because I know I'm running short of time. 30:55 [NOISE] I'm gonna jump through a couple of slides to show MYO as well. 30:57 I don't know if you guys have seen this device before 31:02 it actually is a arm band that instead of actually doing 31:04 anything with gesture with your arm it actually senses all electr The 31:07 sensitivity of all the jeez, all the censors in your arm. 31:12 Basically if you move your hand open and close, this actually captures 31:17 all of those electrical impulses and actually you can interact with them. 31:20 So they have a couple demos they do with hydro 31:23 copter that are going up and down and controlling it. 31:25 But, this is where the the wearable devices are really gonna 31:28 take off is actually capturing personal data on your body as well. 31:31 So, obviously, that's a whole another privacy concern that 31:35 we're going to have to deal with as well. 31:38 But you can start to see these devices are getting very, 31:39 very intelligent on the sense of starting to interact with ourselves and 31:41 releasing out that personal information, so we can actually build custom, you 31:45 know, contextual designs for the individuals rather than a set of people. 31:48 So I have a couple other slides here but I'm gonna jump 31:53 to the end cuz I know I think I'm short on time here. 31:56 So I know you guys are all hungry. 31:58 So am I. 32:00 So I'm gonna jump through. 32:00 Obviously we create these contextual design experiences for this individual 32:02 here is to be able to make a happy customer. 32:06 You know the one person you want to be happy 32:09 most is the person that's buying the product or experiencing it. 32:11 And that could be an internal employee that's working on the 32:14 application or a customer that actually buys a product from you. 32:17 So just remember the one person we're trying to accommodate for is the end user 32:19 and that's one of this guy here with the big big smiling grin on his face. 32:24 And then that's my contact information. 32:29 Any questions I'd love to chat with you guys. 32:32 So I'll be around until tomorrow evening so I'll look forward to chat with you 32:34 guys tonight and the rest of the conference 32:37 so I appreciate you guys sticking around [SOUND]. 32:39
You need to sign up for Treehouse in order to download course files.Sign up