In September I posted a short piece on this blog called Stealing From the Spooks. The argument was simple. The United States Intelligence Community got burned, publicly and catastrophically, by its own mind-sets, and it responded by writing down how its analysts ought to think and then drilling it. Police departments have the same failure mode and, in wrongful convictions and unsolved cases, the same body count. So why in the world has policing not stolen the cure?
The post got more reaction than anything I have written on the subject. Analysts wrote to say they had been fighting that fight alone in their squad rooms for years. A couple of prosecutors wrote to say they had never once seen a written hypothesis matrix in a case file and would pay money for one. One detective wrote to tell me I was full of it, which is fair, and then asked where he could read more. That last question did not have a good answer. The blog post was a sketch. So I wrote the book.
Stealing From the Spooks: Structured Analytic Techniques for Law Enforcement Crime Analysis is a sixty page monograph, free, and you can download it here: ConstantinPoindexterAuthor.com. There is no paywall and no email form. Print it, hand it to your lieutenant, leave it on the prosecutor’s desk.
Where the ideas come from
Let me be clear about credit, because the title is a confession. The twelve techniques in the monograph are not mine. They come from a forty page unclassified document the US Government published in 2009, A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis, which in turn stands on Richards Heuer’s The Psychology of Intelligence Analysis. Heuer’s diagnosis is the whole foundation: analysts do not fail for lack of information, they fail because the human mind decides which facts to notice before conscious thought ever gets a vote (Heuer 1999; US Government 2009). Anyone who has watched a homicide squad lock onto a suspect in the first seventy two hours and then spend months bending every new fact to fit knows exactly what he was describing. The wrongful conviction literature calls it tunnel vision (Findley and Scott 2006). Heuer called it a mind-set. It is the same animal.
What is mine is the translation. The primer was written for people who track missile programs. I rebuilt it for the detective sergeant staring at a whiteboard full of string, the civilian crime analyst who can smell that the squad’s theory is running ahead of its evidence, the supervisor who signs charging recommendations, and the prosecutor who inherits whatever the investigation did or did not think about. Every chapter follows the same plan: what the primer says, what it looks like in a case file, how to run it with the people and hours a real unit actually has, and where it goes wrong.
What is in it
The primer sorts its techniques into three families, and the monograph keeps that order. The diagnostic techniques make the argument visible: the Key Assumptions Check, the Quality of Information Check, indicators, and Heuer’s Analysis of Competing Hypotheses. The contrarian techniques attack it on purpose: Devil’s Advocacy, Team A/Team B, High-Impact/Low-Probability analysis, and “What If?” analysis. The imaginative techniques go looking for the theories and futures nobody in the room has thought of yet: structured brainstorming, outside-in thinking, red teaming, and alternative futures.
Each one gets a worked example built for police work. A burglary series with an assumptions register that exposes two assumptions resting on nothing but habit. A shooting investigation with a source log that shows, in one column, that the whole theory is standing on a paid informant with secondhand knowledge and an identification run by a detective who already had a favorite. An arson matrix in which the squad’s two favorite facts, the unpaid rent and the increased insurance coverage, turn out to be consistent with every hypothesis on the board and therefore eliminate nobody. That last one is the lesson I most want a working detective to take away. A case is not built by piling up facts that fit. It is built by eliminating the explanations that do not.
The primer’s own showcase example, by the way, is a police case. During the 2002 Washington sniper shootings the working theory was a lone white male with military training in a white van. The primer breaks that sentence into its five assumptions and grades each one. The shooters were two Black males, one of them seventeen, in a blue Chevrolet Caprice that officers had run more than once during the spree. Nobody had written down that the investigation was assuming a van, so nobody recognized the Caprice as a contradiction of anything. You cannot notice the violation of an assumption you never admitted making. That sentence is the monograph in miniature.
The objection, and the answer
The pushback I hear most from investigators is legal, not analytical. “If we write down our doubts, the defense gets them.” The monograph spends a full chapter on that, because it is the objection that kills the practice before it starts. The short version: assume the defense will read every analytic product you write, and understand that this is a feature. Under Brady and Kyles the prosecution already owes the accused everything favorable that the police know, whether the prosecutor has heard about it or not. A dated matrix of considered and rejected hypotheses, a source log that recorded the informant’s motive on day one, a labeled devil’s advocate memo showing the department tried to break its own case before asking a jury to believe it: those are the things that survive cross examination. The cases that fall apart are the ones where the doubt existed, went unrecorded, and came out anyway, ten years later, in a habeas petition.
I also wrote a chapter the enthusiasts will not like, on the limits. The experimental evidence that these techniques make any individual analyst more accurate is thin, and the serious critics have a point (Chang et al. 2018; Dhami, Belton, and Mandel 2019). My answer is that accuracy is not the strongest argument for them in policing. Transparency is. A criminal case gets its accuracy from adversarial testing, and adversarial testing needs something written down to test. A theory that lives only inside the lead investigator’s head can be reviewed by no one.
For the chief who has read this far
The last part of the monograph is a program, not a sermon. A one page directive. A table of who owns what, with the civilian analyst as the owner of the method, deliberately, because the analyst is the person in the building least invested in the lead detective’s theory and least able to challenge it without standing. A ninety day rollout. A way to measure whether any of it is working that does not depend on the clearance rate. And a note for the nine officer department with no analyst, which can still do this with one sheet of paper and a devil’s advocate borrowed from the agency next door.
If a department adopts only three things from the whole document, they should be the assumptions register, the source log, and a devil’s advocate before charging. They are the cheapest. They catch the most.
The appendices hold blank worksheets for all of it and a supervisor’s checklist to run before a charging recommendation goes up. Photocopy them. That is what they are for.
Why I bother
I spent years inside the community that invented this discipline, and I carried a badge before that. I have sat in both rooms. The analytic cadre at Langley and the detective squad in a county building are closer cousins than either would admit: incomplete information, people who lie, a hierarchy in which the senior person’s theory becomes everyone’s theory, and a long record of confident error traced afterward to assumptions nobody wrote down. One of those communities got humiliated badly enough to fix it. The other is still running investigations with the analytic rigor of a bar argument.
The framework is public, it is free, and it is forty pages long. There is no excuse left for not using it. I put sixty more pages around it so there would be even less.
A Spanish edition, Robándoles a los Espías, is ready as well and will be posted separately on the author’s law firm blog for colleagues in the Dominican Republic, Puerto Rico, and the rest of the hemisphere.
References
- Chang, Welton, Elissabeth Berdini, David R. Mandel, and Philip E. Tetlock. 2018. “Restructuring Structured Analytic Techniques in Intelligence.” Intelligence and National Security 33 (3): 337-356.
- Dhami, Mandeep K., Ian K. Belton, and David R. Mandel. 2019. “The ‘Analysis of Competing Hypotheses’ in Intelligence Analysis.” Applied Cognitive Psychology 33 (6): 1080-1090.
- Findley, Keith A., and Michael S. Scott. 2006. “The Multiple Dimensions of Tunnel Vision in Criminal Cases.” Wisconsin Law Review 2006 (2): 291-397.
- Heuer, Richards J., Jr. 1999. The Psychology of Intelligence Analysis. Washington, DC: Central Intelligence Agency, Center for the Study of Intelligence.
- US Government. 2009. A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis. March 2009.
