Human-Computer Interaction in Face Matching

Overview

Journal Cogn Sci

Specialty Psychology

Date 2018 Jun 29

PMID 29954047

Citations 7

Authors

Matthew C Fysh

Markus Bindemann

Affiliations

Soon will be listed here.

Abstract

Automatic facial recognition is becoming increasingly ubiquitous in security contexts such as passport control. Currently, Automated Border Crossing (ABC) systems in the United Kingdom (UK) and the European Union (EU) require supervision from a human operator who validates correct identity judgments and overrules incorrect decisions. As the accuracy of this human-computer interaction remains unknown, this research investigated how human validation is impacted by a priori face-matching decisions such as those made by automated face recognition software. Observers matched pairs of faces that were already labeled onscreen as depicting the same identity or two different identities. The majority of these labels provided information that was consistent with the stimuli presented, but some were also inconsistent or provided "unresolved" information. Across three experiments, accuracy consistently deteriorated on trials that were inconsistently labeled, indicating that observers' face-matching decisions are biased by external information such as that provided by ABCs.

Citing Articles

Trust in automation and the accuracy of human-algorithm teams performing one-to-one face matching tasks.

Carragher D, Sturman D, Hancock P Cogn Res Princ Implic. 2024; 9(1):41.

PMID: 38902539 PMC: 11190114. DOI: 10.1186/s41235-024-00564-8.

Verifying unfamiliar identities: Effects of processing name and face information in the same identity-matching task.

Trinh A, Dunn J, White D Cogn Res Princ Implic. 2022; 7(1):92.

PMID: 36224440 PMC: 9556678. DOI: 10.1186/s41235-022-00441-2.

Characteristic fixation biases in Super-Recognizers.

Linka M, Broda M, Alsheimer T, de Haas B, Ramon M J Vis. 2022; 22(8):17.

PMID: 35900724 PMC: 9344214. DOI: 10.1167/jov.22.8.17.

Public attitudes towards the use of automatic facial recognition technology in criminal justice systems around the world.

Ritchie K, Cartledge C, Growns B, Yan A, Wang Y, Guo K PLoS One. 2021; 16(10):e0258241.

PMID: 34644306 PMC: 8513835. DOI: 10.1371/journal.pone.0258241.

The effect of contextual information on decision-making in forensic toxicology.

Hamnett H, Dror I Forensic Sci Int Synerg. 2021; 2:339-348.

PMID: 33385132 PMC: 7770460. DOI: 10.1016/j.fsisyn.2020.06.003.

References

Wirth B, Carbon C . An easy game for frauds? Effects of professional experience and time pressure on passport-matching performance. J Exp Psychol Appl. 2017; 23(2):138-157. DOI: 10.1037/xap0000114. View

Bindemann M, Jenkins R, Burton A . A bottleneck in face identification: repetition priming from flanker images. Exp Psychol. 2007; 54(3):192-201. DOI: 10.1027/1618-3169.54.3.192. View

White D, Dunn J, Schmid A, Kemp R . Error Rates in Users of Automatic Face Recognition Software. PLoS One. 2015; 10(10):e0139827. PMC: 4605725. DOI: 10.1371/journal.pone.0139827. View

Bindemann M, Burton A, Langton S, Schweinberger S, Doherty M . The control of attention to faces. J Vis. 2007; 7(10):15.1-8. DOI: 10.1167/7.10.15. View

Bindemann M, Sandford A . Me, myself, and I: different recognition rates for three photo-IDs of the same person. Perception. 2011; 40(5):625-7. DOI: 10.1068/p7008. View

Alenezi H, Bindemann M, Fysh M, Johnston R . Face matching in a long task: enforced rest and desk-switching cannot maintain identification accuracy. PeerJ. 2015; 3:e1184. PMC: 4548491. DOI: 10.7717/peerj.1184. View

Papesh M, Goldinger S . Infrequent identity mismatches are frequently undetected. Atten Percept Psychophys. 2014; 76(5):1335-49. PMC: 4241395. DOI: 10.3758/s13414-014-0630-6. View

Bindemann M, Burton A, Hooge I, Jenkins R, de Haan E . Faces retain attention. Psychon Bull Rev. 2006; 12(6):1048-53. DOI: 10.3758/bf03206442. View

OToole A, Abdi H, Jiang F, Phillips P . Fusing face-verification algorithms and humans. IEEE Trans Syst Man Cybern B Cybern. 2007; 37(5):1149-55. DOI: 10.1109/tsmcb.2007.907034. View

10.

White D, Phillips P, Hahn C, Hill M, OToole A . Perceptual expertise in forensic facial image comparison. Proc Biol Sci. 2015; 282(1814). PMC: 4571699. DOI: 10.1098/rspb.2015.1292. View

11.

Jenkins R, Burton A . 100% accuracy in automatic face recognition. Science. 2008; 319(5862):435. DOI: 10.1126/science.1149656. View

12.

Johansson P, Hall L, Sikstrom S, Olsson A . Failure to detect mismatches between intention and outcome in a simple decision task. Science. 2005; 310(5745):116-9. DOI: 10.1126/science.1111709. View

13.

Fysh M, Bindemann M . Effects of time pressure and time passage on face-matching accuracy. R Soc Open Sci. 2017; 4(6):170249. PMC: 5493919. DOI: 10.1098/rsos.170249. View

14.

White D, Kemp R, Jenkins R, Matheson M, Burton A . Passport officers' errors in face matching. PLoS One. 2014; 9(8):e103510. PMC: 4136722. DOI: 10.1371/journal.pone.0103510. View

15.

Menon N, White D, Kemp R . Identity-level representations affect unfamiliar face matching performance in sequential but not simultaneous tasks. Q J Exp Psychol (Hove). 2015; 68(9):1777-93. DOI: 10.1080/17470218.2014.990468. View

16.

Bindemann M, Sandford A, Gillatt K, Avetisyan M, Megreya A . Recognising faces seen alone or with others: why are two heads worse than one?. Perception. 2012; 41(4):415-35. DOI: 10.1068/p6922. View

17.

Weger U, Loughnan S, Sharma D, Gonidis L . Virtually compliant: Immersive video gaming increases conformity to false computer judgments. Psychon Bull Rev. 2015; 22(4):1111-6. DOI: 10.3758/s13423-014-0778-z. View

18.

Peirce J . PsychoPy--Psychophysics software in Python. J Neurosci Methods. 2007; 162(1-2):8-13. PMC: 2018741. DOI: 10.1016/j.jneumeth.2006.11.017. View

19.

Rice A, Phillips P, Natu V, An X, OToole A . Unaware person recognition from the body when face identification fails. Psychol Sci. 2013; 24(11):2235-43. DOI: 10.1177/0956797613492986. View

20.

Phillips P, Scruggs W, OToole A, Flynn P, Bowyer K, Schott C . FRVT 2006 and ICE 2006 large-scale experimental results. IEEE Trans Pattern Anal Mach Intell. 2010; 32(5):831-46. DOI: 10.1109/TPAMI.2009.59. View