¿Gestos universales para controlar equipos electrónicos? Un estudio en 18 países.
Diseñamos servicios, productos y estrategias centrados en la persona. Design Thinking | Human-‐Centered InnovaHon User Experience (UX) | Customer Experience (CX)
§ Pioneros en UX e innovación en ArgenHna y LaHnoamérica. § +10 años de acHvidad. § Diseño | InvesHgación | Consultoría | Capacitación
● Worldwide user experience research ● 27 partner companies ● Joint quality levels and processes ● UX experHse + local culture experHse ● UX Research in 35+ countries
What is a gesture? What kind of gestures are we interesHng in?
Let’s play a game…
Please say: Hello…
Please say: Hello… Goodbye…
Please say: Hello… Goodbye… That door…
Please say: Hello… Goodbye… That door… This chair
Please say: Hello… Goodbye… That door… This chair… Put this chair near the door…
Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later…
Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later… Take a picture to this guy
Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later… Take a picture to this guy Share this image in Facebook…
Gesture technology is entering our lives
Touch gestures
PoinHng gestures
SemanHc gestures
● Gestures with an associated meaning ● No need for an addiHonal GUI ● PotenHally more efficient
Challenges ● Presumably influenced by local cultures ● Some cultures might be more predisposed to the use of
gestures than others SemanHc gesture for mission control on a Mac
The UX Fellows Gesture Study
Which seman8c gestures would people from various cultures spontaneously use to control consumer electronic devices?
● Country differences? ● Country clusters? ● Underlying metaphors? ● Acceptance?
We compared spontaneous gesture behavior in 18 countries.
RU
CN
IN
AU AR
CA
US
MX
ES FR
UK
IT
FI
DE NL BE
KR TR
The UX Fellows Gesture Study (video)
Seing 15 min Warm-‐up: everyday gestures
Examined Commands
Switch on device Volume up Channel up Context info for current program Channel down Share current program Volume down Mute volume Pause current program Homepage EPG
backward navigaHon in menus Confirm on-‐screen dialog (OK) Deny on-‐screen dialog (cancel) Pause video-‐on-‐demand (VOD) Restart VOD Fast forward VOD Rewind VOD Skip chapter VOD Previous chapter VOD Stop VOD Switch off device
P+
P-‐
Sample
Persons who are able to imagine a gesture-‐control scenario for a TV. ● Regular usage of a recent HD flat TV (max. 5-‐6 years of age) and
other CE devices and services ● High interest in consumer electronics ● Regular usage of a touch device ● No Xbox Kinect and gesture-‐enabled TV users ● PotenHal buyers of interna8onal "premium" CE brands
(no naHonal, retailer or "no name" brands)
Sample
sample
socio-‐econ
omic
backgrou
nd
country
Sample
51% 49%
16
65 years
32
18 countries x 20 subjects = 360 par8cipants
min
max
mean
The Results
ElaboraHon
Difficulty of TV-‐related gestures
1,0
1,5
2,0
2,5
3,0
3,5
Self-‐reported difficulty, 5 = very difficult, 1 = very easy, n = 360 tech-‐savvy CE consumers in 18 countries
difficulty
Commonality of gestures
0 2 4 6 8 10 12 14 16 18
no. of countries with the same main gesture
no. of cou
ntrie
s
high medium low
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 18 of 18
Difficulty (1-‐5) 1.8
Q: How do you turn down the volume?
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 18 of 18
Difficulty (1-‐5) 1.5
Q: How do you turn up the volume?
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 17 of 18
Difficulty (1-‐5) 1.5
NL
Q: How do you pause viewing a film?
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 17 of 18
Difficulty (1-‐5) 2.0
NL
Q: How would you pause the current TV program?
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 15 of 18
Difficulty (1-‐5) 1.7
AU, UK
NL
Q: How do you rewind? (with an image being shown)
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
AU, UK
NL
Q: You are watching a boring scene, how do you fast-‐forward (with an image being shown)?
Commonality 15 of 18
Difficulty (1-‐5) 1.9
Commands with high commonality
Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)
Commonality 15 of 18
Difficulty (1-‐5) 1.9
CN, IT, KR
Q: You have chosen a film from an online video library. The TV asks you "do you really want to buy the film?" How do you answer "yes"?
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
P+
AU, ES, KR, US
CA
Q: You are zapping through the TV programs: How do you change from channel 15 to channel 16 for example?
Commonality 13 of 18
Difficulty (1-‐5) 1.8
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
AU, ES, KR, UK, US
CA
P-‐
Q: You are zapping through the TV programs: How do you change from channel 16 to channel 15 for example?
Commonality 12 of 18
Difficulty (1-‐5) 1.6
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
CN, KR
FI, RU
NL Q: How would you stop watching the film altogether (because you want to do something different)?
Commonality 13 of 18
Difficulty (1-‐5) 2.1
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
AU, CN, MX
BE
UK
FI, RU
Q: How do you set the volume to "mute"?
Commonality 11 of 18
Difficulty (1-‐5) 2.0
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume Backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
AU, BE, CA
AR, RU
ES, MX, US
Q: Imagine that you were looking for a film in an online video library. You have gone to the comedies secHon and have chosen the descripHon of a single movie. Now you want to return to the previous set of opHons (all of the comedies). Which gesture would you use for that?
Commonality 10 of 18
Difficulty (1-‐5) 2.3
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
AU, CN, RU, TR
KR
AR, BE, IT, MX
Q: How do you express that you don’t want to buy it?
Commonality 9 of 18
Difficulty (1-‐5) 1.8
Commands with medium commonality
Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD
BE, CN, ES, FI, FR, IN, MX, UK
NL
Q: How would you skip to the next chapter of the film?
Commonality 9 of 18
Difficulty (1-‐5) 2.2
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
BE, FR, US
KR
DE, IT
TR
CN CA
FI
Q: How would you switch on the TV?
Commonality 8 of 18
Difficulty (1-‐5) 2.0
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
ES, MX, NL
CA
IN, KR
RU
AR TR Q: How would you switch off the TV? Note: No common gesture in Italy
Commonality 7 of 18
Difficulty (1-‐5) 2.9
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
BE, CN, ES, FI, FR, MX, NL
UK
IN, US Q: How would you return to the previous chapter of the film?
Commonality 8 of 18
Difficulty (1-‐5) 2.0
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
AU, ES, KR, MX AR, DE
BE
NL RU
US Q: How do you start it (film) again? Note: No common gesture in UK
Commonality 7 of 18
Difficulty (1-‐5) 2.0
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
CN, FR, IN
FI
AR, TR
MX
NL
KR
RU
US Q: How would you share with your friends what you are currently watching or listening to? Note: No common gesture in UK
Commonality 6 of 18
Difficulty (1-‐5) 3.2
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
AU, US CN, FI, IN, KR, RU
BE, UK TR NL
MX
Q: You'd like to see an overview of tonight's TV programs of the main channels (EPG). How do you acHvate this funcHon with a hand gesture? Note: No common gesture in Italy
Commonality 5 of 18
Difficulty (1-‐5) 2.8
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
FR, KR, RU
AU, FI
CN, IN, TR
AR
DE
BE
ES US
UK
Q: How would you get more informaHon for the running TV program?
Commonality 4 of 18
Difficulty (1-‐5) 2.8
Commands with low commonality
Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage
AR, AU, MX
DE NL, UK
FI
BE, IN
US
CA, ES, TR
Q: Now you want to go to the iniHal set of opHons -‐ that means the first opHons you see when you switch on the device. Note: No common gesture in Italy
Commonality 4 of 18
Difficulty (1-‐5) 2.9
Direct vs. abstract gestures
We observed two kinds of gestures. ● "Direct" gestures
o strongly influenced by touch devices
● Abstract gestures o basis in language, iconography and metaphors o associated with more complex tasks o lower intercultural commonality
Some general insights
Average gesture difficulty by country
1,0
1,5
2,0
2,5
3,0
TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK
Everyday gestures CE gestures
difficulty
min
max 5,0 …
Average gesture difficulty by country
1,0
1,5
2,0
2,5
3,0
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR
CE gestures
difficulty
min
max 5,0 …
Gesture difficulty by countries
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Volume down
Pause VOD Channel down Rewind VOD Volume up
Deny on-‐screen dialog (cancel) Channel up
Confirm on-‐screen dialog (OK) Switch off device Fast forward VOD Switch on device
Restart VOD Mute volume
Previous chapter VOD Pause current program
Stop VOD Skip chapter VOD
backward navigaHon in menus
Context info for current program EPG
Homepage Share current program
Gesture difficulty by countries
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Mean
Volume down 1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2 1.5
Pause VOD 1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9 1.5
Channel down 1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1 1.6
Rewind VOD 1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5 1.7
Volume up 1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3 1.8
Deny on-‐screen dialog (cancel) 1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5 1.8
Channel up 1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2 1.8
Confirm on-‐screen dialog (OK) 1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3 1.9
Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9
Fast forward VOD 1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5 1.9
Switch on device 2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6 2.0
Restart VOD 1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0 2.0
Mute volume 1.4 1.7 1.3 1.5 1.7 1.8 2.3 1.8 1.7 2.1 1.9 2.2 2.4 2.5 2.4 2.4 2.0 2.7 2.0
Previous chapter VOD 1.0 1.7 1.7 1.7 2.2 1.8 1.4 2.0 2.1 1.7 1.8 2.0 2.0 2.3 1.3 3.0 2.7 3.3 2.0
Pause current program 2.1 1.6 1.5 1.7 1.4 1.7 2.5 1.6 1.9 2.2 2.0 2.2 2.1 2.2 2.6 2.4 2.2 3.1 2.0
Stop VOD 2.3 1.9 2.3 1.7 2.0 1.7 1.3 1.4 2.0 1.9 1.9 2.1 2.0 2.1 2.8 2.2 2.4 3.3 2.1
Skip chapter VOD 1.7 1.7 1.7 2.1 2.3 2.1 1.4 2.1 2.3 2.0 2.2 2.1 2.6 2.8 1.6 2.9 3.1 3.4 2.2
backward navigaHon in menus 1.4 2.1 2.1 1.9 2.5 2.0 1.3 2.3 2.5 2.1 2.7 2.3 2.2 2.2 3.6 2.9 2.2 3.4 2.3
Context info for current program 2.7 2.3 2.5 2.2 2.5 2.4 2.6 3.1 2.4 2.8 2.7 2.5 3.2 2.9 3.2 3.4 3.8 3.2 2.8
EPG 2.4 2.2 2.6 2.4 2.8 3.5 3.7 2.4 2.4 2.6 2.7 2.9 2.9 2.7 3.2 3.2 3.0 3.9 2.8
Homepage 3.7 2.2 2.3 2.2 2.7 2.4 3.8 3.1 2.0 2.9 2.7 3.0 3.0 3.3 3.7 3.4 3.3 3.7 2.9
Share current program 2.4 2.1 1.9 2.4 3.3 2.4 3.9 2.9 3.4 3.5 3.8 3.7 4.2 2.6 4.2 3.8 4.5 3.2 3.2
Mean 1.7 1.7 1.7 1.8 1.9 1.9 1.9 1.9 1.9 2.0 2.1 2.1 2.2 2.3 2.3 2.4 2.6 2.8
General acceptance
● Our 360 tech-‐savvy parHcipants responded very posi8vely to the idea of semanHc gesture input for TVs.
"fun to use", "convenient", "coolness factor" ● ParHcipants would like to use gestures to control other
devices as well (e.g. audio).
OperaHon
Many parHcipants felt that voice and sound could be a good support for gesture input.
waking up the device with a sound
Can the TV hear me?
Gesture type preference
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR
Seman8c
Poin8ng Many users would prefer switching between gesture types.
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ
Seman8c l l l l l l l l l l l l l l l 15
Poin8ng
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ
Seman8c l l l l l l l l l l l l l l l 15
Poin8ng l l l l l l l l l 9
associated with more advanced commands
Typical concerns of users
● Learning and reten8on of gestures (but: would be easy if based on implicit behavior repertory)
● Sensi8vity and accuracy of devices ● Interference by other gestures in the room ● Compa8bility with lean-‐back disposi8on
Conclusions
Conclusions
1. For basic CE commands a common language for semanHc gestures already exists across cultures.
2. More complex commands could be realized by either
a. customizing these gestures for each individual market
b. customizing individually
c. proposing a set of semanHc gestures that need to be learned (the study provides some suggesHons)
d. switching to poin8ng gestures in combinaHon with a GUI
3. It is necessary to consider cultural differences at a country level when it comes to designing advanced gesture control for globally marketed devices.
Download complete reports: www.uxfellows.com
Find us at: gonzalo.auza@inter-‐cultura.com inter-‐cultura.com
Thumbs up to the audience!
Thumbs up to the audience!