Comments
Having now read both the RAND study and the Rovner/Hoyt critique, I would offer the following comments.
1. The study breaks no new ground, except perhaps methodologically. It simply confirms the quantitative analysis that Max Manwaring and I first published in the journal Small Wars & Insurgencies (Winter 1992) and more recently in the Small Wars Journal as "The SWORD Model Of Counterinsurgency" as well as such qualitative studies as our Uncomfortable Wars Revisited and the Daniel Marston & Carter Malkesian edited volume of historical case studies, Counterinsurgency in Modern Warfare.
While I found the quantitative analysis in their QCA interesting, I believe that our use of Factor Analysis (not to be confused with their use of the term "factor") coupled with Probit Analysis was more compelling especially when amplified by qualitative analysis.
In the end, however, these authors add simply another set of supporting data and analysis to our general understanding of what works and doesn't work in COIN.
Rovner and Hoyt, on the other hand, attempt to make a case that the RAND group both fails in its elucidation of COIN success (and failure) but that their methodology is actually pernicious. Frankly, attempting to prove that a large scale analysis is wrong by introducing a few examples of where the analysis fails only argues for more research. That research is needed to explain the outlying cases. In our study, we had five outliers among 43 cases which, indeed, required additional explanation. So, too, does the RAND group have outliers in their larger data set (or among cases they did not consider as Rovner and Hoyt argue).
The most interesting case that Rovner and Hoyt introduce to "refute" the RAND study is that of Sri Lanka. Indeed, it does require additional analysis as to why it runs counter to more general population centric successes. However, I would start such analysis by proposing that the Sri Lanka government had relatively high levels of legitimacy among the Sinhalese majority population. And (after all) the Tamil Tigers revolt was that of an ethnic minority located in a relatively smaller area of Tamil concentration. This might be an excellent research project for Rovner and Hoyt to undertake.