Skip to Content
You are currently on the new version of our website. Access the old version .
SensorsSensors
  • Communication
  • Open Access

16 June 2021

15 Pages

The Effectiveness of Multi-Label Classification and Multi-Output Regression in Social Trait Recognition

,
,
,
and
1
Agricultural & Biological Engineering, Purdue University, West Lafayette, IN 47907, USA
2
Computer Science, Ithaca College, Ithaca, NY 14850, USA
3
Computer Science and Engineering, University of Nevada, Reno, NV 89557, USA
*
Author to whom correspondence should be addressed.
This article belongs to the Section Sensing and Imaging

Abstract

First impressions make up an integral part of our interactions with other humans by providing an instantaneous judgment of the trustworthiness, dominance and attractiveness of an individual prior to engaging in any other form of interaction. Unfortunately, this can lead to unintentional bias in situations that have serious consequences, whether it be in judicial proceedings, career advancement, or politics. The ability to automatically recognize social traits presents a number of highly useful applications: from minimizing bias in social interactions to providing insight into how our own facial attributes are interpreted by others. However, while first impressions are well-studied in the field of psychology, automated methods for predicting social traits are largely non-existent. In this work, we demonstrate the feasibility of two automated approaches—multi-label classification (MLC) and multi-output regression (MOR)—for first impression recognition from faces. We demonstrate that both approaches are able to predict social traits with better than chance accuracy, but there is still significant room for improvement. We evaluate ethical concerns and detail application areas for future work in this direction.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.