TY - JOUR
T1 - A Video Based Screening System For Automated Risk Assessment Using Nuance Facial Features
AU - Pentland, Steven J.
AU - Twyman, Nathan W.
AU - Burgoon, Judee K.
AU - Nunamaker, Jay F.
AU - Diller, Christopher B.R.
N1 - This study investigates the development of an automated interviewing system that uses facial behavior as an indicator of the risk of given illicit behavior. Traditional facial emotion indicators of risk in semistructured dialogue may have limitations in an automated approach.
PY - 2017
Y1 - 2017
N2 - This study investigates the development of an automated interviewing system that uses facial behavior as an indicator of the risk of given illicit behavior. Traditional facial emotion indicators of risk in semistructured dialogue may have limitations in an automated approach. However, an initial analysis of mock crime interviews suggests that the face may exhibit some form of rigidity during highly structured interviews. An interviewing system design using facial rigidity analysis was implemented and experimentally evaluated, the results of which further reveal that the rigidity is fairly generalized across the face. Whereas existing theory traditionally focuses on leakage of facial expressions, this study provides evidence that neutralization of facial expression may be a valuable alternative for automated interviewing systems. The proof-of-concept system in this study may help human risk assessment move beyond traditional boundaries, into fields such as auditing, emergency room management, and security screening.
AB - This study investigates the development of an automated interviewing system that uses facial behavior as an indicator of the risk of given illicit behavior. Traditional facial emotion indicators of risk in semistructured dialogue may have limitations in an automated approach. However, an initial analysis of mock crime interviews suggests that the face may exhibit some form of rigidity during highly structured interviews. An interviewing system design using facial rigidity analysis was implemented and experimentally evaluated, the results of which further reveal that the rigidity is fairly generalized across the face. Whereas existing theory traditionally focuses on leakage of facial expressions, this study provides evidence that neutralization of facial expression may be a valuable alternative for automated interviewing systems. The proof-of-concept system in this study may help human risk assessment move beyond traditional boundaries, into fields such as auditing, emergency room management, and security screening.
KW - automated interviewing
KW - credibility assessment
KW - deception detection
KW - facial expression recognition
KW - facial rigidity analysis
KW - risk assessment
UR - http://dx.doi.org/10.1080/07421222.2017.1393304
U2 - 10.1080/07421222.2017.1393304
DO - 10.1080/07421222.2017.1393304
M3 - Article
VL - 34
JO - Journal of Management Information Systems
JF - Journal of Management Information Systems
IS - 4
ER -