p5271 Miller
p5271 Miller
net/publication/316709058
CITATIONS READS
54 1,820
5 authors, including:
Max Birk
Eindhoven University of Technology
70 PUBLICATIONS 1,925 CITATIONS
SEE PROFILE
All content following this page was uploaded by Max Birk on 26 January 2018.
5271
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
participants’ perceived relational communication and 41]. In addition to being used to build and maintain
transcribed the audio to perform semantic analysis on the personal relationships, video chat is increasingly being used
conversations themselves. in a range of professional contexts, such as in distributed
work teams [23], to conduct job interviews [52], to support
Our results show that video feedback increased self-
online test-taking [60], and even in remote psychotherapy
awareness and perceived relational affection and depth.
[11].
However, it also increased the use of anxiety-related words
and decreased the use of words expressing certainty. In Feedback in Video Chat
addition, mixed-gender dyads rated themselves as having People who use modern video chat systems such
more social orientation with feedback than without. This Microsoft’s Skype, Google’s Hangouts, and Apple’s
was reflected in their conversations as an increase in Facetime are accustomed to seeing a small preview of their
inclusive pronouns and words expressing affiliation, and a own camera feed as part of the chat interface. In addition to
decrease in words expressing discrepancy. The same- this layout being the default interface design, none of these
gender dyads rated themselves as being more task oriented video chat programs offer users an option to disable video
than the mixed-gender dyads when feedback was provided. feedback (we tested the most recent version of these
This task focus of the same-gender dyads was reflected in applications on all the available mobile and desktop
an increased use of interrogative terms (e.g., ‘what’, ‘how’) platforms). This is consistent with some findings that a
and ‘you’-centric words with feedback than without – their majority of users prefer to see a preview of themselves
task was to engage in an information exchange, thus the during video chat [1311]. It has also been suggested that
increased use of these words suggests greater task focus video feedback could help increase eye contact, important
(i.e., asking the other participant questions about for establishing interpersonal trust [4].
themselves). However, other research has cast doubt on the necessity of
We make several contributions. First, we show that visual constant visual feedback during video chat. Microsoft
feedback in video chat interfaces increases self-awareness researchers working on NetMeeting technology found that
and affects a person’s perceived ability to relationally users only wanted video feedback to adjust their positioning
communicate. Second, we show that visual feedback at the start of a call [40]. Research conducted by Hewlett
increases social accommodation in conversation – Packard similarly showed that most users prefer to see
particularly for mixed-gender dyads. Reduced expressions feedback only if their face leaves the frame, rather than all
of conviction and discrepancy and increased expressions of the time [37]. This was reflected in Hewlett Packard’s Halo
social affiliation suggest that participants were more video conferencing system, which used a large installation
concerned with how others perceived them when they could that fixed the cameras, seating, and environment in each
see their own video feed. Third, we discuss how the Halo room, meaning that users were always within the
increased conversational accommodation when feedback camera frame. The system provided no video feedback to
was provided – particularly for mixed-gender dyads – has users during the chat [41].
implications for the design of video chat interfaces in Outside of the context of video chat, feedback has been
contexts from remote therapy to online dating. manipulated for a variety of reasons. For example, in
A simple choice in interface design – whether or not to exploring suitable VMC interfaces for online test-tasking,
show visual feedback – influences how we view ourselves Wegge [60] found that increasing the size of video
in a social interaction and how we engage in a social feedback caused people high in test anxiety to perform
conversation. Video-based communication is becoming a worse on an oral exam taken over video conference. And
common way for people separated by distance to several studies have removed the video feedback
communicate in both personal and professional contexts; affordance; for example, to hide an experimental
our interface design choices have the power to influence manipulation [56], to avoid negative effects during
how online relationships are formed and fostered. behavioral tele-health interventions involving inmates with
mental illness [31], to ease anxiety about appearing on
RELATED WORK
camera in the context of learning over a distance [28], and
We present research on feedback in video chat and on how
to avoid negative effects for patients with body image
feedback may affect self-awareness for different people.
disorders in remote psychotherapy [34].
Video Chat
Video-mediated communication (VMC, which we Although almost all modern systems afford video feedback,
sometimes refer to as video chat) has become a popular its use was less consistent in early video chat solutions.
mode of technology-mediated communication between Some had it turned off by default [40], while others
geographically-distributed people – for example, it connects provided it as an option that obscured the remote video
grandparents to their grandchildren who live in different entirely, as it was meant as a temporary preview [55].
cities [20], supports intimacy between romantic partners
[39], and lets distributed friends chat with each other [7,
5272
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
5273
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
Self-awareness in Social Interactions data. We used node.js to host the webpages and other
Self-awareness also affects our interactions with others. In content for the video chat website. Both Kurento Media
1959, Goffman [16] argued that when an individual is Server and node.js ran on an Ubuntu 14.04 server.
interacting with another and attending fully to that Participants were asked to complete the task using Chrome
interaction, then things progress smoothly; however, if that or Firefox browsers, which support the WebRTC standard.
individual instead becomes focused on themselves, then
Video Chat Task
their attention and concern could be shifted away from the
The video chat client page featured a large preview of the
interaction itself toward how that interaction will be
remote partner’s video, and a smaller preview of the local
perceived by others. This increased concern with how one
user’s video, which is configurable in our system. Beside
is being perceived could greatly affect the interaction
the video was a small text block, which was synced
between two individuals. Fenigstein [18] tested this idea
between both participants. This allowed us to present
and showed that increasing self-awareness (using a mirror
discussion questions to participants as they chatted. During
manipulation) of two female participants increased
the video chat, participants were presented with common
responsiveness to the evaluations of others – specifically, it
icebreaker questions. The questions used were: What do
heightened negative response to negative evaluation and
you like to eat on your pizza?; What is your favorite
increased positive feedback to positive evaluations. In the
animal?; What do you like best about your favorite animal?;
context of CMC, Joinson [27] manipulated self-awareness
Would you rather go on a beach holiday or a mountain
by presenting a video feed of a participant on their own
holiday?; If you could go visit any place in the world,
display – this video was not transmitted anywhere – and
where would you go?; If you could live in any period of
showed that increased private self-awareness, combined
history, when would it be?; If you could have dinner with
with lower public self-awareness increased spontaneous
one person – dead or alive – who would it be?; Do you
self-disclosure during a text chat. In our research, we
think it is better to see the future or change the past?;
manipulate self-awareness by presenting feedback of the
Would you rather be invisible or be able to read minds?; If
participant in the video chat interface and measure the
you could learn any skill, what would it be?; If you could
impact on communication.
have one superpower, what would it be?; Would you rather
EXPERIMENTAL SYSTEM AND SETUP always feel too cold or always too hot?; If your house was
We created a custom browser-based video chat system and burning down, what object would you try to save?; If you
connected pairs on strangers in an online experiment either were at a restaurant and found a fly in your soup, what
with feedback of themselves or without. Our work was would you do?; What’s the weirdest thing you have ever
guided by our five main research questions: eaten?; What is the best present you ever received?; If you
RQ1. Does seeing themselves increase self-awareness? won $10000, what would you spend it on?; Would you
rather eat a banana or an apple?; and Would you rather
RQ2. Does seeing themselves affect their perceived ability
wrestle a lion or fight a shark?. We created the list from a
to relationally communicate?
variety of online sources of social icebreaker questions as
RQ3. Does seeing themselves affect the conversation
itself? well as including our own questions. The questions were
RQ4. Do subjective differences resulting from visual designed to facilitate conversation; however, we did not
feedback depend on the type of dyadic pairing? include questions that were very personal in nature or
RQ5 Does seeing themselves differentially affect the inward-facing (e.g., What do you really like about yourself?
conversations of same- or mixed-gender pairings? What is your earliest memory?). We did not want to induce
self-awareness through the questions themselves, as
System participants were likely to progress through the discussion
To study how people react to seeing their own video topics at different paces.
feedback, we needed a system that allowed us to manipulate
the feedback interface and present the participants with
discussion topics. Further, we needed a system that worked
within a web browser to give us flexibility in testing with
online participants who have different systems and setups.
Modern browsers support the WebRTC standard, which
facilitates interoperable, standards-based peer-to-peer data
transfer. This allows for the creation of native video chat
software on the web. However, a peer-to-peer architecture
does not lend itself to recording the video data, which we
needed for subsequent analyses. To enable recording the
videos, we used Kurento Media Server [19]. Kurento Media
Server can establish WebRTC connections to multiple
Figure 1. The video chat system with the optional local
clients and act as a go-between, which also records all the preview turned on.
5274
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
5275
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
5276
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
RQ1. Does seeing themselves increase self-awareness? increased with feedback, e.g., “mate”, “talk” (F1,79=4.3;
We expected that seeing themselves would affect p=.042, η2=.05). These results suggest that seeing feedback
participants’ self-awareness similar to the mirror of themselves increased their social accommodation – their
manipulations that were used in [21]. The MANOVA conversation became more social in content, and they
showed a main effect of feedback on situational self- decreased their use of terms expressing certainty. It also
awareness (F1,83=11.4; p=.001, η2=.12) and a marginal effect suggests that seeing themselves resulted in increased
on private self-awareness (F1,83=3.9; p=.052, η2=.05). No expression of anxiety; it is unclear whether they were feeling
effect was found on public self-awareness (F1,83=.01; more anxious or simply expressing their anxiety more. All
p=.921). The effect showed that self-awareness was higher other semantic categories were not significantly different
when feedback was visible, confirming our expectations that between feedback conditions (see Table 1).
being able to see themselves would increase the self- 0.4 2 * 12 *
5277
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
Figure 7. Mean (±SE) of the significant interactions of gender pairing (mixed vs same) and feedback on word counts, p<.05.
5278
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
‘you’ in mixed-gender dyads in the video feedback self-directed attention adds to the cognitive load and makes
condition suggests that participants in mixed-gender dyads them less likely to spot – and thus even more exposed to –
have been talking more about themselves. impression management strategies.
It may seem counterintuitive that seeing oneself ultimately Customer Service
increases social accommodation; however, research in self- Customer service and technical support services are
awareness theory helps to explain how self-directed beginning to transition from audio–only communication to
attention translates into being concerned about how others video chat. Our results suggest that the person providing the
perceive us. By facilitating self-presentation concerns, self- service or support would benefit from seeing their video
directed attention is ultimately expressed as social feedback, as it would facilitate social accommodation. In
accommodation – people form expectations about how they the context of providing services to a frustrated client,
are perceived by others and start to unconsciously greater social accommodation by the service provider may
accommodate to these implicit expectations [18]. ensure that clients feel heard and assisted.
Implications for Design Online Dating
Providing video feedback in video chat interfaces increases Online dating is a rapidly-growing platform that connects
self-awareness and increases self-directed attention. This strangers seeking new relationships with each other through
has implications for the design of video chat interfaces – computer-mediated communication [51]. Communication
manipulating self-awareness and performance concerns as a patterns in online dating, however, expose some very
result of self-directed attention can be leveraged for benefit troubling trends regarding harassment and inappropriate
in some interaction contexts, but may be harmful in others. approaches of men towards women. In the United States,
42% of female users have been contacted by someone in a
Video-Mediated Communication
way that made them feel harassed or uncomfortable [51].
There are several ways in which increased self-directed
These behavioral patterns can be linked to the differential
attention affects video-mediated communication (VMC).
social norms stemming from anonymity in the online
Previous work has not examined how seeing oneself affects
environment [45]. Online dating platforms predominantly
conversation in a video chat context. Our work shows
use text chat, which lacks any self-awareness-inducing
interesting effects on both the conversation itself and on
feedback. In this domain, design that induces self-
how people perceive their relational communication.
awareness might encourage users to adhere to the social
However, the effects of our results depend on the
norms they would follow in face-to-face interactions and
interaction’s context.
exhibit more pro-social behaviours, which would ultimately
Distributed Teams facilitate conversation and potentially improve online
Distributed teams allow companies to connect knowledge interactions.
workers from all over the world. Over the course of a
Remote Psychotherapy
project, team members have different communicational
Maladaptive forms of heightened presentation concern as a
needs, which would differently benefit from including
result of increased self-awareness have been tied to mental
visual feedback of the participants. In the beginning, it is
disorders, e.g. social-anxiety, eating disorder, and drug
important to create social bonds and facilitate trust and
abuse [26, 6, 36]. A common approach for people suffering
group cohesion between teammates [58]. Self-awareness
from anxiety is attentional retraining [24], which trains
induced through video feedback might create a more
people to shift attention away from negative to neutral
sociable atmosphere that facilitates group cohesion. In later
cognitions and actually helps to reduce self-directed
phases of the group work, planning and implementations of
attention [12]. Supporting these systems to vary self-
strategies take priority; thus, no feedback might be the more
awareness would allow participants to contrast experienced
suitable design as increased self-awareness might detract
anxiety as a result of self-directed attention under feedback
from the participant’s problem solving abilities [58].
and no-feedback, providing them with valuable tools for
Job Interviews managing anxiety. Moreover, in the context of remote
The increase in remote and distributed work has also therapy, conducted with an online psychotherapist over
increased the demand for remote job interviews using video video chat [11], our findings support the idea that the
communication [5, 52]. Interviewing over video-mediated presence of visual feedback for both the patient and the
communication technology is less expensive than bringing therapist must be carefully considered to avoid
candidates in for an in-person interview, and allows an unintentional self-directed attention.
organization to evaluate a greater range of candidates. One
Limitations and Future Work
concern of organizations is the ability of interviewers to
Our study reveals several interesting findings, but also
spot impression management strategies (e.g., flattery) used
opens the opportunities for future work.
by the applicants; interviewers with high trust and low
cognitive ability are less likely to spot deceptive strategies Our study used a personal information exchange task
[46]. Our results suggest that increased self-awareness between strangers over Amazon’s Mechanical Turk.
might be harmful for interviewers, because the increased Participants were prompted to have a conversation by
5279
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
asking each other questions. This is a specific use context eyetracker would have compromised the ecological validity
and we expect that results may depend on both the context of people engaging in VMC in the familiar environment of
and task. their own homes. Furthermore, extending our results by
showing how video chat interface design affects subsequent
First, our same-gender dyads were comprised of two
task performance, trust facilitation, or feelings of intimacy
females or two males interacting. Previous work on
would provide a translation of our results, and aid in our
communication in dyads suggests that patterns are different
understanding of how technology-mediated communication
when the pair is comprised of two men or two women [54].
patterns affect our collaborative work and relationships.
We could not investigate the breakdown of the same-gender
dyads at the level of male dyads or female dyads, due to our CONCLUSION
sample size; however, this is an important avenue for future Video-based communication is becoming a common way
work. for people separated by distance to communicate in both
personal and professional contexts; however, the status quo
Second, we collected data on the traits of participants, such of providing participants with a video preview of
as their personality, self-consciousness and degree of self- themselves is in direct contrast to how our face-to-face
monitoring. Again, our sample of participants is not large interactions are structured. Including video feedback in our
enough to consider the between-subjects effects of feedback study tended to increase the attention that participants
and gender pairing, while also integrating individual directed towards themselves, increasing their awareness of
differences into our analyses. Future work should consider themselves as social beings, and increasing their concern
the differential effects of video feedback on people with for how they were being perceived by their partner. The
different personalities, and levels of self-efficacy, self- looking glass self refers to our self-view that is shaped by
monitoring, and life satisfaction. our understanding of how others perceive us [33]. In video-
Third, the increased social accommodation from video mediated communication, who we see when we peer into
feedback was likely useful in the context of a personal the looking glass can be affected by interface design
information exchange; however, the reduced use of choices as a simple as whether or not to provide video
expressions of certainty and discrepancy are likely not feedback. As video chat increasingly governs our
helpful in the context of problem-solving, brainstorming, interactions with others over a distance in domains from
negotiating, or other task-focused exchanges. We would online dating to customer service and remote psychotherapy
like to explore how feedback affects communication in to job interviews, we must acknowledge the influence that
other tasks – particularly those that benefit from interface designers have over how our online social
participants feeling permitted to disagree with each other interactions unfold, how we see ourselves as a result of
and express confidence in their opinions. these interactions, and ultimately how we build and
maintain relationships online.
Fourth, our manipulation connected two strangers. It is
possible that results would differ for interactions between ACKNOWLEDGMENTS
people with various pre-existing relationships. We would We thank members of the interaction lab for support, our
like to explore how the design of video chat interfaces MTurk participants for their devotion to focused
affects communication between friends, romantic partners, participation in online experiments, the anonymous
family members, or co-workers. reviewers for valuable comments, and NSERC (SWaGUR,
USRA, and CGS-M) for funding.
Fifth, our manipulation used dyads. There are complex
interactions that occur in group conversations, and it is REFERENCES
unclear how our results extend into remote communication 1. Morgan G. Ames, Janet Go, Joseph ‘Jofish’ Kaye, and
involving more than two parties. Mirjana Spasojevic. 2010. Making love in the network
closet: the benefits and work of family videochat. In
Sixth, our experiment was conducted with a particular user Proceedings of the 2010 ACM conference on Computer
group – workers on Mechanical Turk. We found that our supported cooperative work. 145-154.
participants used this shared connection in their http://dx.doi.org/10.1145/1718918.1718946
conversation and often talked about their work on 2. Roy F. Baumeister. 1984. Choking under pressure: self-
Mechanical Turk. However, we were paying people to be consciousness and paradoxical effects of incentives on
part of our experiment and extending our findings into skillful performance. Journal of personality and social
volitional participation in the context of personal or psychology. 46, 3, 610-620.
professional communication is of interest to us. http://dx.doi.org/10.1037/0022-3514.46.3.610
Finally, we demonstrate results in terms of participants’ 3. Roy F. Baumeister, Debra G. Hutton, Kenneth J. Cairns
subjective ability to communicate and in conversation 1990. Negative effects of praise on skilled performance.
behavior. Although we would have liked to record the gaze Basic and applied social psychology. 11, 2, 131-148.
of participants to determine how much they looked at their http://dx.doi.org/10.1207/s15324834basp1102_2
own video feed, conducting the study in a lab with an
5280
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
4. E Bekkering and J.P Shim. 2006. Trust in communication. Communications Monographs, 66, 1,
videoconferencing. Communications of the ACM. 49, 7, 49-65.
103-107. http://dx.doi.org/10.1145/1139922.1139925 http://dx.doi.org/10.1080/03637759909376462
5. Nikki Blacksmith, Jon C. Willford, and Tara S. Behrend. 16. Goffman Erving. 1959. The presentation of self in
2016. Technology in the Employment Interview: A everyday life. Garden City, NY: Anchor. 1-17.
Meta-Analysis and Future Research Agenda. Personnel 17. Allan Fenigstein, Michael F. Scheier, Arnold H. Buss.
Assessment and Decisions. 2, 1, 2. 1975. Public and private self-consciousness: Assessment
6. Susan M. Bögels, Wendy Rijsemus, and Peter J. De and theory. Journal of consulting and clinical
Jong. 2002. Self-focused attention and social anxiety: psychology. 43, 4, 522-527.
The effects of experimentally heightened self-awareness http://dx.doi.org/10.1037/h0076760
on fear, blushing, cognitions, and social skills. Cognitive 18. Allen Fenigstein. 1979. Self-consciousness, self-
Therapy and Research. 26, 4, 461-472. attention, and social interaction. Journal of Personality
http://dx.doi.org/10.1023/A:1016275700203 and Social Psychology. 37, 1, 75-86.
7. Jed R. Brubaker, Gina Venolia, and John C. Tang. 2012. http://dx.doi.org/10.1037/0022-3514.37.1.75
Focusing on shared experiences: moving beyond the 19. Luis López Fernández, Miguel París Díaz, Raúl Benítez
camera in video communication. In Proceedings of the Mejías, Francisco Javier López, José Antonio Santos.
Designing Interactive Systems Conference. 96-105. 2013. Kurento: a media server technology for
http://dx.doi.org/10.1145/2317956.2317973 convergent WWW/mobile real-time multimedia
8. Arnold H. Buss. 1980. Self-consciousness and social communications supporting WebRTC. In World of
anxiety. Freeman. Wireless, Mobile and Multimedia Networks
9. Charles S. Carver. 1975. Physical aggression as a (WoWMoM). 1-6.
function of objective self-awareness and attitudes toward http://dx.doi.org/10.1109/WoWMoM.2013.6583507
punishment. Journal of Experimental Social Psychology. 20. Ryoko Furukawa, and Martha Driessnack. 2012. Video-
11, 6, 510-519. mediated communication to support distant family
http://dx.doi.org/10.1037/0022-3514.37.9.1576 connectedness. Clinical nursing research. 22, 1, 82-94.
10. Charles S. Carver and Michael F. Scheier. 1978. Self- http://dx/doi.org/10.1177/1054773812446150
focusing effects of dispositional self-consciousness, 21. John M. Govern and Lisa A. Marsch. 2001.
mirror presence, and audience presence. Journal of Development and validation of the situational self-
Personality and Social Psychology. 36, 3, 324-332. awareness scale. Consciousness and cognition. 10, 3,
http://dx.doi.org/10.1037/0022-3514.36.3.324 366-378.
11. Helen Christensen, Kathleen M. Griffiths, Andrew J. http://dx.doi.org/10.1006/ccog.2001.0506
Mackinnon, Kanupriya Kalia, Philip J. Batterham, Justin 22. Samuel D. Gosling, Peter J. Rentfrow, William B.
Kenardy, Claire Eagleson, and Kylie Bennett. 2010. Swann. 2003. A very brief measure of the Big-Five
Protocol for a randomised controlled trial investigating personality domains. Journal of Research in personality.
the effectiveness of an online e health application for the 37, 6, 504-528.
prevention of Generalised Anxiety Disorder. BMC http://dx.doi.org/10.1016/S0092-6566(03)00046-1
psychiatry. 10, 25. 23. Zixiu Guo, John D’ambra, Tim Turner, and Huiying
http://dx.doi.org/10.1186/1471-244X-10-25 Zhang. 2009. Improving the effectiveness of virtual
12. Josh M. Cisler and Ernst HW Koster. 2010. Mechanisms teams: A comparison of video-conferencing and face-to-
of attentional biases towards threat in anxiety disorders: face communication in China. IEEE Transactions on
An integrative review. Clinical psychology review. 30, 2, Professional Communication. 52, 1, 1-16.
203-216. http://dx.doi.org/10.1109/TPC.2008.2012284
http://dx.doi.org/10.1016/j.cpr.2009.11.003 24. Yuko Hakamata, Shmuel Lissek, Yair Bar-Haim,
13. Jose Eurico de Vasconcelos Filho, Kori M. Inkpen, Jennifer C. Britton, Nathan A. Fox, Ellen Leibenluft,
Mary Czerwinski. 2009. Image, appearance and vanity Monique Ernst, Daniel S. Pine. 2010. Attention bias
in the use of media spaces and video conference modification treatment: a meta-analysis toward the
systems. In Proceedings of the ACM 2009 international establishment of novel treatment for anxiety. Biological
conference on Supporting group work. 253-262. psychiatry. 68, 11, 982-990.
http://dx.doi.org/10.1145/1531674.1531712 http://dx.doi.org/10.1016/j.biopsych.2010.07.021
14. Edward L. Deci and Richard M. Ryan. 2000. The 25. William John Ickes, Robert A. Wicklund, C. Brian
“what” and “why” of goal pursuits: Human needs and Ferris. 1973. Objective self awareness and self esteem.
the self-determination of behavior. Psychological Journal of Experimental Social Psychology. 9, 3, 202-
inquiry. 11, 4, 227-268. 219.
http://dx.doi.org/10.1207/S15327965PLI1104_01 http://dx.doi.org/10.1016/0022-1031(73)90010-3
15. James Price Dillard, Denise Haunani Solomon, Mark T. 26. Rick E. Ingram. 1990. Self-focused attention in clinical
Palmer. 1999. Structuring the concept of relational disorders: review and a conceptual model. Psychological
bulletin. 107, 2, 156-176.
5281
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
5282
Improving Video Communication CHI 2017, May 6–11, 2017, Denver, CO, USA
5283