Statement analysis
Statement analysis, also called scientific content analysis (SCAN), is a pseudoscientific technique for analyzing the words people use to try to determine if what they said is accurate. Proponents claim this technique can be used to detect concealed information, missing information, embedded confessions and whether the information that person has provided is true or false.[1][2][3]
Multiple empirical studies have found SCAN techniques to be unreliable at correctly separating true and false statements. SCAN is generally not accepted by courts and has been described as a form of pseudoscience.[2][1]
About[edit]
Related to statement analysis is a different technique for analyzing the words people use called "statement validity assessment" (SVA). The SVA is a tool that was originally designed to determine the credibility of child witnesses testimonies in trials for sexual offences. The "criteria-based content analysis" (CBCA) is a core component of the SVA and is a tool used to distinguish true statements from false statements as CBCA scores are expected to be higher for truth tellers than liars.[4] A qualitative review of the CBCA analyzed 37 studies, strong support for the tool was established as truth tellers obtained significantly higher CBCA scores compared to the liars.[5] More recently, a meta-analytic review found CBCA criteria to be a valid technique for discriminating between memories of real self-experienced events and invented or false accounts.[6]
Countries such as The Netherlands, Germany and Sweden use these techniques as scientific evidence in court.[4] However, countries such as the United States, Canada and the UK do not consider these techniques as legally valid evidence in court.[7] Studies have raised serious questions and concerns about the validity of CBCA for assessing the credibility of children's testimonies. One study using 114 children showed that CBCA scores were higher for the group of children describing a familiar event compared to the group of children describing an unfamiliar event.[8] The potential influence of familiarity on CBCA scores raises concerns about the validity of the tool for assessing credibility in children.
It has also been noted that the error rate of CBCA in the laboratory is high, that the error rate of SVA in practice is unknown and that the methodology continues to be disputed among the scientific community.[9] In conclusion, there is still great controversy surrounding the use of the SVA and many studies have investigated its core component, the CBCA, in order to determine its validity and reliability. More research is needed to conclude whether or not the information obtained from these tests should be admissible in court.
Example[edit]
Statement analysis involves an investigator searching for linguistic cues and gaps in a subject's testimony or preliminary statements. Ideally, the technique would guide investigators to ask follow-up questions to uncover discrepancies. The creator of Scientific Content Analysis (SCAN), Avinoam Sapir, gives the example of someone saying, "I counted the money, put the bag on the counter, and proceeded to go home." Sapir says the statement was literally true:
He counted the money (when you steal you want to know how much you are stealing), and then the subject put the bag on the counter. The subject didn't say that he put the money back in the bag after counting it, because he didn't; he left the empty bag on the counter and walked away with the money.[1][2]
Sapir says that a fundamental principle of statement analysis is that "denying guilt is not the same as denying the act. When one says 'I am not guilty' or 'I am innocent,' they are not denying the act; they are only denying guilt." Sapir claims that it is almost impossible for a guilty person to say "I didn't do it." He asserts that guilty people tend to speak in even greater circumlocutions by saying things like "I had nothing to do with it" or "I am not involved in that".[1][2]
Criticism[edit]
Aldert Vrij, one of the leading authorities on detection of deception (DOD) techniques, points out that most studies of the technique did not rely on the ground truth being established and thus examiners could not be certain if "examinees were actually telling the truth or lying".[10] He also notes that there is no standardization among the different methods of analysis and this "implies that much depends on the subjective interpretation and skill of the individual" performing the analysis. Vrij attributes this to an absence of theoretical underpinning behind SCAN/statement analysis.[10] Vrij characterizes SCAN/statement analysis as weaker than CBCA because SCAN/statement analysis lacks "a set of cohesive criteria", being instead "a list of individual criteria".[10] Vrij argues that SCAN/statement analysis is best used as a technique to guide investigative interviews rather than as a "lie detection tool".[11]
Subsequent empirical studies have concurred with these findings, finding that SCAN/statement analysis techniques are applied inconsistently and are not reliable at detecting deceptive statements.[12][13][14][15] The use of SCAN techniques has also been found to be vulnerable to contextual bias on the part of investigators.[16]
Critics argue that the technique encourages investigators to prejudge a suspect as deceptive and affirm a presumption of guilt before the interrogation process has even begun. Statement analysis in general has been criticized as "theoretically vague" with little or no empirical evidence in its favor, and SCAN in particular has been characterized as "junk science"[1] with the Skeptic's Dictionary and Skeptical Inquirer magazine[17] classifying it as a form of pseudoscience.[2] In 2016, the High-Value Detainee Interrogation Group (HIG), a federal agency group consisting of the FBI, the CIA, and the United States Department of Defense, released a report which found that studies commonly cited in favor of SCAN were scientifically flawed and that SCAN's evaluative criteria did not withstand scrutiny in laboratory testing.[18]
See also[edit]
References[edit]
- ^ a b c d e Leo, Richard A. (2008). Police interrogation and American justice. Harvard University Press. ISBN 978-0-674-02648-3.
- ^ a b c d e Carroll, Robert T. (2009-02-23). "L.S.I. SCAN - Too Good To Be True". The Skeptic's Dictionary. Retrieved 14 September 2010.
- ^ Adams, Susan H. (October 1996). "Statement Analysis: What Do Suspects' Words Really Reveal?". Polygraph Volume:25 Issue:4. pp. 266–278. Archived from the original on 7 March 2016. Retrieved 14 September 2010. Alt URL
- ^ a b Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12.
- ^ Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3.
- ^ Amado, Bárbara G., Ramón Arce, and Francisca Fariña. "Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review". The European Journal of Psychology Applied to Legal Context 7.1 (2015): 3–12
- ^ Pérez, Mercedes Novo, and María Dolores Seijo Martínez. "Judicial judgement-making and legal criteria of testimonial credibility". The European Journal of Psychology Applied to Legal Context 2.2 (2010): 9–115.
- ^ Pezdek, Kathy, et al. "Detecting deception in children: event familiarity affects criterion-based content analysis ratings". Journal of Applied Psychology 89.1 (2004): 119
- ^ Vrij, A. (2005). Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. Psychology, Public Policy, and Law, 11(1), 3
- ^ a b c Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 290.
- ^ Aldert Vrij, Detecting Lies and Deceit: Pitfalls and Opportunities, 2nd ed., Chichester, England: John Wiley & Sons, 2008, p. 291.
- ^ Bogaard, Glynis; Meijer, Ewout H.; Vrij, Aldert; Broers, Nick J.; Merckelbach, Harald (2014-05-28). "SCAN is largely driven by 12 criteria: results from sexual abuse statements". Psychology, Crime & Law. 20 (5): 430–449. doi:10.1080/1068316X.2013.793338. ISSN 1068-316X.
- ^ Vrij, Aldert; Granhag, Pär Anders; Ashkenazi, Tzachi; Ganis, Giorgio; Leal, Sharon; Fisher, Ronald P. (2022-12-01). "Verbal Lie Detection: Its Past, Present and Future". Brain Sciences. 12 (12): 1644. doi:10.3390/brainsci12121644. ISSN 2076-3425. PMC 9775025. PMID 36552104.
- ^ Vanderhallen, Miet; Jaspaert, Emma; Vervaeke, Geert (2016-05-03). "SCAN as an investigative tool". Police Practice and Research. 17 (3): 279–293. doi:10.1080/15614263.2015.1008479. ISSN 1561-4263.
- ^ Kleinberg, Bennett; Arntz, Arnoud; Verschuere, Bruno (2019-08-08). "Being accurate about accuracy in verbal deception detection". PLOS ONE. 14 (8): e0220228. doi:10.1371/journal.pone.0220228. ISSN 1932-6203. PMC 6687387. PMID 31393894.
- ^ Bogaard, Glynis; Meijer, Ewout H.; Vrij, Aldert; Broers, Nick J.; Merckelbach, Harald (2013-10-29). "Contextual Bias in Verbal Credibility Assessment: Criteria‐Based Content Analysis, Reality Monitoring and Scientific Content Analysis". Applied Cognitive Psychology. 28 (1): 79–90. doi:10.1002/acp.2959. ISSN 0888-4080.
- ^ "Statement Analysis Scan or Scam?", by Robert A. Shearer, Skeptical Inquirer, May/June 1999
- ^ Armstrong, Ken; Sheckler, Christian (2019-12-07). "Why Are Cops Around the World Using This Outlandish Mind-Reading Tool?". The South Bend Tribune and ProPublica. Retrieved 2019-12-09.