
Summary
A smile can coexist with a clenched hand or a shaking voice. Looking beyond the face reveals additional emotional cues, while a reported image study highlights the information carried by hands.
At a glance
Body movements, hand positions, and vocal intonation can provide emotional information beyond facial expressions, especially when someone deliberately conceals their feelings. A reported study of 100 adults found that whole-body images supported more accurate emotion recognition than isolated body regions. Among the isolated regions tested, hands yielded significantly higher accuracy than arms, the head, or the torso.
It may be possible to understand how someone feels without looking at their face. Understanding how begins with what an emotion involves. One theorist of emotion describes it as a composite psychological phenomenon with three principal components: subjective experience, outward expression, and physiological arousal.
Subjective experience is the feeling as experienced by the individual. Outward expression includes facial expressions, posture and bodily expression, and vocal intonation. Physiological arousal refers to the bodily changes that accompany an emotion. Anger, for example, can involve a faster heartbeat, increased adrenaline secretion, and heavier breathing.
These different aspects provide several routes to emotion recognition—the process of judging another person’s emotional state. Nonphysiological cues include facial expressions, voice, and behavior. Physiological cues arise from changes within the body. Some are readily visible, such as heavier breathing or facial flushing caused by the dilation of capillaries in the face. Others can be detected with instruments that measure changes in heart rate or skin impedance. In everyday life, people more often rely on nonphysiological cues.
Facial expressions have a particularly prominent role. A child impatient to buy an intriguing little gadget might wait until their parents are smiling and seem cheerful before asking for it. Someone who notices sadness on a friend’s or classmate’s face might give them space while offering appropriate care and comfort. An interview candidate may struggle to formulate an answer while closely watching the interviewer’s face, afraid that missing a subtle change in expression could lead them to say the wrong thing.
Each situation calls for a different response: choosing when to make a request, sensing how to support someone, or monitoring an interaction under pressure. Together, they illustrate the social importance of recognizing emotion. Faces tend to be the cues people turn to most readily, and the ones they are more skilled at reading than other emotional signals.
Reading faces is convenient and often effective, but a face can tell only part of the story. Consider a scene from a wish-fulfillment cultivation fantasy: a minor antagonist mocks the protagonist’s low cultivation level and poor talent. The protagonist keeps smiling, yet a hand hidden beneath their clothing is already clenched. The gesture suggests that the taunts are hardly pleasing them.
A television melodrama offers a different contrast. As the plot piles on exaggerated, distressing events, the protagonist remains expressionless while their body trembles uncontrollably. They seem less calm than their face suggests.
Similar discrepancies can arise at group meals or team-building gatherings. Some people smile and chat while nervousness makes their voices shake markedly. Their smiles suggest enjoyment, but the strain in their voices suggests that some are not truly enjoying the interaction.
People sometimes deliberately conceal their emotions and control their facial expressions. Under those circumstances, the face can give a misleading impression, making other information necessary. A concealed hand, a trembling body, or an unsteady voice can help us interpret what a face alone does not convey.
Hands, arms, the head, and the torso are among the body regions commonly used to judge emotion. Research has found that these regions can provide emotional information independently of facial expressions, and hands may be particularly revealing. That raises a question: how accurate are these judgments compared with reading a face? A study cited as Blythe (2023) explored differences among views of the body.
Reportedly conducted in the United Kingdom in 2023, the study involved 100 adults. Participants viewed photographs in five conditions: the whole body, arms, hands, head, or torso. The isolated-region images were created by cropping photographs to show only the relevant body part. Participants had to classify the emotion expressed in each image as fear, anger, disgust, happiness, sadness, or surprise.
The researchers found that participants identified emotions more accurately from whole-body images than from images of any single region. Among the isolated regions, hands yielded significantly higher recognition accuracy than arms, the head, or the torso.
Stereotypical gestures reportedly did not explain this advantage. A clenched fist, for example, is commonly associated with anger, but the greater accuracy with hand images was not simply a matter of recognizing that familiar gesture.
The article’s author offers two possible explanations for the hand advantage. The brain might process information about hands in finer detail, allowing observers to extract more information from hand images and use it to judge emotion. Separately, greater sensitivity to hand position might make spatial differences between images easier to distinguish, helping observers infer that the people pictured are expressing different emotions.
The author draws a broader conclusion: there are better ways to recognize emotion than reading faces. Perhaps someday, instruments and artificial intelligence will help us judge more accurately how other people feel.
Frequently asked questions
Why can facial expressions give a misleading impression?
People sometimes deliberately conceal their emotions and control their facial expressions. Under those circumstances, the face can give a misleading impression, making other information necessary.
Which body images supported the most accurate emotion recognition in the reported study?
Whole-body images supported more accurate recognition than images of any single region. Among the isolated regions tested, hands yielded significantly higher recognition accuracy than arms, the head, or the torso.


