Thursday, March 4, 2010 - 4:15 AM
Steve Walt alerts us to a curious post by CNAS' Andrew Exum -- a.k.a., Abu Muqawama -- intended to create a "manifesto... for those using quantitative analysis to study war."
Steve thinks these are "wise words indeed." I think... well, let's go through Exum's rules, shall we?
War is a human endeavor. I recognize that it is a phenomenon that does not conform to neat mathematical equations.
Sure.
I will use quantitative analysis in conjunction with theory and qualitative analysis to describe what I see as phenomena in war and peace. I will be honest about the limits of both my theory and my analysis
Of course. Good job nailing the compulsories so far.
In war and peace, the variables are infinite, and not everything can be measured or assigned a numerical value
Um... the variables are infinite on just about every dimension of life. No operationalization, econometric equation or formal model is going to completely capture reality. I guarantee you, however, that no qualitiative analysis will perfectly capture reality either (I will further note that qualitative scholars often fool themselves into believing this is not the case, which gets them into all sorts of trouble -- but some quant jockeys commit this sin as well). This doesn't mean you give up on explanation -- it just means you acknowledge the limitations of your approach.
I will not use numbers to signify what are fundamentally qualitative assessments without acknowledging to my reader that I have done so in order to satisfy a departmental requirement, gain tenure, or get published in the APSR. Or because I have been in graduate school for so long that I have forgotten how to effectively write in prose.
Yeah, this is where Exum's manifesto departs from the land of common sense and enters the world of unadulterated horses**t. First, I've occasionally used this kind of data, and I sure as hell didn't do it to get tenure -- I did it because I thought it was a good way to test my explanation. Second, whether someone can write clear and crisp prose has nothing to do with whether they use quantitative methods or not. That Exum seems not to know this is the first sign that we're dealing with some very muddled thinking.
I recognize there are no mathematical equations in Vom Kriege and that it is nonetheless unlikely that my legacy will transcend that of Clausewitz.
Um... I could provide the undisputed, univerally-hailed-by-all explanation for why the United States invaded Iraq in 2003 and my legacy wouldn't transcend Clausewitz. Or Thucydides. But that's a really high bar to set.
Just to turn things around, there are plenty of mathematical equations in Strategy of Conflict and it is nevertheless likely that Exum's -- or your -- legacy will never transcend that of Thomas Schelling.
And finally:
I recognize that very few squad leaders in the 10th Mountain Division have ever taken a course in statistics yet probably know more about the conduct and realities of war than I do.
I think there is some truth to this statement. It is also a fair statement, however, that very few graduate students in security studies have ever served a day in uniform yet probably know more about the causes of war than those squad leaders do.
As Drew Conway points out, it takes a special kind of chutzpah for someone who admits that they don't "get" quantitative methods to write something like this.
Be sure to read the rest of Conway's post, as well as Cato's Justin Logan.
UPDATE: Also check out Kindred Winecoff and Henry Farrell on Exum's post as well. Farrell's concluding point about the value of social science is worth repeating in full:
In my opinion... the most important lesson that the social sciences have to offer to policy makers - be careful about selection bias. Policy debates in Washington DC are rife with selection effects, with advocates highlighting convenient cases for a particular policy argument and hiding inconvenient ones. I’m co-teaching a big MA intro course on IR theory and international affairs practice with a practitioner this semester. If I can get this one single point across to my students, so that they really understand it, I think I’ll have given them good value for money.
Quite true. Sophisticated qualitiative scholars are quite adept at coping with this issue. But there's a lot of hackwork that misses this point entirely.
EXPLORE:ACADEMIA, FOREIGN POLICY COMMUNITY, INTERNATIONAL RELATIONS THEORY, POLITICAL SCIENCE, SECURITY STUDIES
"First, I've occasionally used this kind of data, and I sure as hell do it to get tenure."
I hope this is a typo...
:-)
“that very few graduate students in security studies have ever served a day in uniform yet probably know more about the causes of war than those squad leaders do.”
I had a good laugh reading this! It reminded me of (not always so) good old times in gradschool when a very gracious young lady, active duty in the US armed forces, was sharing with so much candor her concerns about the lack of understanding of her “comrades in arms” regarding “why are we sending people to war...” this was a puzzle to her and she wanted to break the ranks and understand “why on God’s green earth we send people to die?!”
I really admired her for the courage to ask the hard questions and for trying to bring light into the minds of her fellow servicemen (as she was hoping), but at the same time I sadly realized that those hard questions should have been asked A Priori by each of those who joined the armed forces “Why do we fight wars? Why are people sent to die? Why will I be sent to die? Is it worth the candle?”
But as the saying goes “it is never too late…” and I can only hope that she made good use of gradschool education to figure out the answer to those hard questions and kept her grace while trying to raise the level of awareness of her fellow “squad leaders.”
Since I can't seem to comment on Walt's post...
...I will comment here. I made a similar comment over at Drew's blog:
Exum comes off as a rather snarky social scientist. Frankly, I could care less about his status as a leading thinker on counterinsurgency. When you willfully flaunt your ignorance of a methodology–all the while denigrating it–you don’t exactly pain a flattering picture of yourself.
Methods are like tools–not every tool is appropriate for every job, but lacking fluency in all tools severely limits one’s ability to tackle different jobs as they come along (or to tackle certain jobs well). Carpenters don’t use lathes for every project, nor do they use a sawzall. But they need how to use both and understand when it is appropriate to use either or both. It is the same for social scientists. Understanding which methods are most appropriate for separating relevant information from noisy observations is key. If you willfully ignore an entire set of these methods you risk reaching erroneous conclusions in your own work, and will fail in your attempt to legitimately criticize the work of others.
I know Walt's criticism of statistical and game theoretic methods well. Sometimes, he does risk slipping into the same category as Exum, since the problem isn't with statisticians, it is with ANYONE that refuses to be humble about their methods and the conclusions they draw from their analysis. Qualitative, quantitative--it doesn't really matter.
I wrote the following elsewhere, but given the byzantine FP comment process have been unable to actually simply comment here.
"What I found interesting about Steve Walt’s post at FP is the way he invoked Schelling. Dan Drezner has insisted that there are plenty of equations in Schelling - but Dan overlooks the fact - and it is a fact - that what is most compelling in The Strategy of Conflict is the lesson that math runs out pretty quickly; none of the enduring lessons of the book (not a single one of them) are mathematical." - Jim Johnson
Jim,
I agree that the equations are not terribly important in Schelling. On the other hand, I could have said "Robert Axelrod" or "Bruce Russett" and the same principle applies.
Or to phrase it in a different way: Exum's logic is as follows:
a) Von Clausewitz wrote a classic on war and strategy
b) Von Calusewitz did not use any mathematics in his book
c) Ergo, no one can write a classic on war and strategy and use quantitative methods.
Do you really accept this specious brand of logic? Really?
Dan actually I think you have the manifesto wrong in a pretty uncharitable way. It is not a luddite tract. Here is what he says:
" I will use quantitative analysis in conjunction with theory and qualitative analysis to describe what I see as phenomena in war and peace. I will be honest about the limits of both my theory and my analysis.
In war and peace, the variables are infinite, and not everything can be measured or assigned a numerical value.
I will not use numbers to signify what are fundamentally qualitative assessments without acknowledging to my reader that I have done so in order to satisfy a departmental requirement, gain tenure, or get published in the APSR. Or because I have been in graduate school for so long that I have forgotten how to effectively write in prose."
I take it to mean that we can and should use theory, mathematical methods (i'd include both formal models and quantitative methods here) and qualitative analysis in studying security matters. From my perspective this is true of any social/political/economic subject. Having said that he then goes on to a truism - there are lots of things that cannot be meausred. Indeed, if you think in terms of causal mechanisms there are lots of things that cannot be observed. And in the third paragraph he basically says that we ought not to try to shoe horn things into mathematical form that are not amenable to being expressed that way. And he rightly identifies the institutional and professional pressures to make just that error.
I really don't see anything wrong there. And I do not see it as the reductio that you portray it as being. I take the final references to Clausewitz etc as a reminder that we can say smart things without math not that we can ONLY say smart things without math. I think another sentence acknowledging that strictly qualitative analysis is not sacrosanct would've helped, but there is nothing terribly shocking in anything the manifesto-ista says as far as I can see.
In any case, viewed from where I sit out here in Western New York I can tell you that there is a strong tendency in the discipline to assert the contrary - that we can only say smart things with math. But you know that. In any case, that is why I thought Walt's qute froom Schelling was a nice touch.
I hope all is well! ~ Jim
Useful for retrospective analysis
As I commented on Abu's post, I think quantitative analysis usefully informs the reading of military history. A leading practitioner of this sort of analysis, the late Trevor Dupuy, created a quantitative model that attempted to capture as many variables as possible, and in his only attempt to apply it to a future event (Desert Storm) his forecast outcome missed by a lesser margin than many other pundits who prognosticated during the Desert Shield period.
Obviously quantitative methods will have less applicability in situations like Iraq or Afghanistan, where variables are extremely hard to nail down and quantify. But of course straightforward historical analysis should have given us plenty of clues about probable outcomes.
Actually, Clausewitz did not like quants.
Interesting post!
The only thing I’ll add is that Clausewitz was, actually, directly attacking an empirical tradition among military writers of his era. These writers, like Jomini, used which used mathematical equations (in the form of strategic lines) to demonstrate flanking manouevers that would allow generals to outwit their enemies before they really had a chance to fight.
This, (according to Anzer Gat’s wonderful book on the subject, “The Origins of Military Thought” ) is what angered Clausewitz. It was the inspiration behind his phrase “Let us not hear of Generals who conquer without bloodshed.” He wasn’t talking about humane generals – he was attacking theorists who felt that you could apply trigonometry to the battlefield to win without really getting your hands dirty.
I had lunch with an Foreign Office friend at ISA this year who expressed his frustration with those who sought to understand suicide terrorism through quantitative methods. The conclusions, he felt, were either testing the obvious or had crunched the numbers in such a way to be useless.
I don’t speak math, so I won’t comment. But I do feel that there is an important place for quants. Exum sounds like a bit of a dork here.
Daniel W. Drezner is professor of international politics at the Fletcher School of Law and Diplomacy at Tufts University.
Read More
(9)
HIDE COMMENTS LOGIN OR REGISTER REPORT ABUSE