How online video chat works

Read the words “That went well.” Now imagine hearing them with a laugh, then with a long sigh. The words are identical. In a one-on-one video chat, the sound of someone’s voice can change what you understand before you have even looked at their face.

What travels between two screens?

Your microphone picks up speech while your camera captures a sequence of images. Call software encodes the sound and pictures, sends them across the internet and decodes the incoming media for playback. Your partner’s device does the same. WebRTC is a set of standards that browsers can use to carry this two-way exchange. [1]

That journey takes time. From your side, a question ends the instant you stop speaking. On the other screen, the final word may still be arriving. This matters in ordinary conversation because we often use the end of a sentence to decide when to speak.

What does hearing a voice add to text?

Psychologists Amit Kumar and Nicholas Epley asked pairs of strangers to get acquainted using the same set of questions. Some pairs typed, others spoke over audio, and others used video. When the researchers compared the two spoken formats with text chat, the people who spoke reported feeling closer to their partners. Adding a picture to the audio produced no statistically significant extra gain on that measure. Participants rated how they felt after that one conversation. [2]

Think of a small exchange about music. A typed “I love that song” gives you an opinion. Hearing which word the other person stretches, or hearing them laugh halfway through it, gives you a clue about what to ask next. “What does it remind you of?” leaves room for the story behind the answer.

Why do people sometimes talk over each other?

In a University of Michigan experiment, Julie Boland and colleagues compared the same pairs talking face to face and over Zoom. The average gap between one speaker finishing and the other starting was 135 milliseconds in person and 487 milliseconds on Zoom. Those numbers describe the handoff between speakers in that experiment, including the time it took to respond. [3]

That extra fraction of a second can feel like an invitation to fill the silence. Give the other person a moment. If you both start at once, “Go ahead, I wanted to hear the rest” hands the turn back. If the sound breaks up, tell your partner where you lost the thread. Try “I caught the part about the train. What happened next?” Then your partner only has to repeat the missing piece.

Why can someone seem to look away while listening?

On a laptop, the face you are watching usually sits below the camera. You can be looking straight at the other person’s eyes on your screen while the camera shows you looking slightly down. In a simulated video-conference display, Gernot Horstmann and Linda Linke found that the position of a face on the screen affected which gaze directions viewers judged as eye contact. [4]

If you wonder whether your partner heard you, ask. If you want to show that you listened, pick up on a word or idea they just mentioned. Either gives the two of you more to work with than guessing what a glance meant.

Try it in your next one-on-one call

Pick a question you would enjoy answering yourself, give the other person a full turn, then follow up on one detail they mentioned. Our video chat conversation starters give you examples. You can have a personal conversation while keeping your phone number, address and social accounts private. The online chat safety guide explains where to draw that line.

References

  1. Alvestrand, H. (2021). Overview: Real-Time Protocols for Browser-Based Applications. RFC 8825, Internet Engineering Task Force.
  2. Kumar, A., & Epley, N. (2021). It’s surprisingly nice to hear you: Misunderstanding the impact of communication media can lead to suboptimal choices of how to connect with others. Journal of Experimental Psychology: General, 150(3), 595–607. DOI 10.1037/xge0000962.
  3. Boland, J. E., Fonseca, P., Mermelstein, I., & Williamson, M. (2022). Zoom disrupts the rhythm of conversation. Journal of Experimental Psychology: General, 151(6), 1272–1282. DOI 10.1037/xge0001150.
  4. Horstmann, G., & Linke, L. (2022). Perception of direct gaze in a video-conference setting: the effects of position and size. Cognitive Research: Principles and Implications, 7, article 67. DOI 10.1186/s41235-022-00418-1.