Why Advertising & Social Enterprise are like Peanut Butter & Jelly

A unique new School for Communication Arts prompts culinary thoughts about the relationship between advertising and social enterprise.

5 Features of Intelligent Mobile User Experience Design

It is clear that it is not voice as a user interface, but voice in the user interface that offers the best opportunities in mobile. In order to exploit those opportunities, we can learn much from VUI design and development that applies to the mobile user experience design now. The way in which users interact with VUI gives us tools and techniques of practical use in designing and developing better mobile apps and devices, a blue-print for Intelligent Mobile User Experience Design.

To talk or not to talk, that is the question…

When analysing user needs, they all lie within our social space. Our lives are socially regulated within social norms in any given context. It got me to thinking, surely this aspect of human behaviour is the most powerful in UI design. I suspect it can be the most powerful if the object of design has a role in regulating our social space.

In my research I have found, when you talk to a machine, if that machine understands you and reacts to your speech input it becomes a social actor in your life. You apply the same social rules and expectations and treat the machine as you would a human (Reeves, 1996).

I have been thinking of how this theory can help us further understand why VUI just isn’t being taken up by users on a mass scale. The theory suggests that simply talking to a machine or device will automatically enter it into our social world. Humans are made up of many social factors of which speech is part but can speech alone make us human? Probably not. We are much more inclined to be drawn to a voice that has some extra information to back up the voice and aid our understanding. One of the most obvious things that pops into my mind is a face, even when we talk to a person on the phone, for whom we have never met, we are inclined to picture how we expect this person to look from the sound of their voice. Or at least it is a natural expectation that the voice actually has a face.

So, in terms of voice technology and in particular voice synthesis, this brings me to thinking, can we psychologically deal with a voice that has no face? Furthermore, can we humanise a device that speaks to us that we know doesn’t have a face. Let’s here take it back to the mobile phone, there is nothing physically human about a mobile phone, compared to say a car which can be seen to have headlights for eyes, a hood line for a mouth, and turn signals for facial expressions (McCloud, 1993; Norman, 1992). Perhaps that’s why we feel comfortable naming our car. I know I have never named my mobile phone.

The point is, talking to a machine comes with social aspects, unless these social aspects are backed up with more social information, I doubt simply interacting through voice makes a machine human. So what does this mean for our research? Well perhaps the user issue with VUI is rooted in the fact we don’t want to talk to a device and create a social actor unless that device has some sort of extra human information to begin with. It’s not so much ‘I talk to my mobile therefore it is now human’ but more ‘I need to see the human in my phone in order to feel comfortable talking to it’. So is the key to VUI success personification? Perhaps. If we are to accept using a voice interface in our mobile phones we need first to have some personalisaion of that object. If that can be achieved then maybe users will be more willing to talk to their mobiles and enter them into the social space through the use of voice. Or put simply, perhaps that voice needs a face.

What kind of relationship do you have with your mobile?

Using Voice as a User Interface requires a relationship between user and mobile more akin to that with another being. Does this mean that in the future there will be relationship brokering services such as speed dating, or man-mobile counselling services?

Collaborative, open research

Sound Barriers is a research project that we’ve had under way for a month or so.  We hope to answer questions about voice as a user interface.  Has this most natural of UI’s finally come of age?  If not the when and why not.  What does this mean for users, and user experience design.  How will this impact product design and development management.  Focusing on mobile apps and devices, we’re looking at applications you can control using any voice (so not voice tagging).

The project is not for a client, it’s just born out of interest and a belief that increasingly we will be working with voice as an option or as part of richer application interfaces from devices.  So I am carrying out the research using as many ‘free’ means at my disposal.  I also know this is a vast and complex field, so interviewing experts from the voice ‘eco-system’ as well as those in mobile, is only part of the process.  I’d also like to engage in debate online here through the blog.  Working in this way, I intend to share the results of the research freely with all those who participate.   We intend to publish an initial analysis for research partners in September 2009.  You can join the research by commenting here, or email me