{"id":13451,"date":"2015-02-15T08:13:14","date_gmt":"2015-02-15T12:13:14","guid":{"rendered":"https:\/\/etherwave.wordpress.com\/?p=13451"},"modified":"2015-02-15T08:13:14","modified_gmt":"2015-02-15T12:13:14","slug":"the-challenges-and-opportunities-of-policy-analysis-history-some-notions","status":"publish","type":"post","link":"https:\/\/rational-action.com\/etherwave\/2015\/02\/15\/the-challenges-and-opportunities-of-policy-analysis-history-some-notions\/","title":{"rendered":"The Challenges and Opportunities of Policy Analysis History: Some Notions"},"content":{"rendered":"

Historian of economics Beatrice Cherrier has\u00a0asked<\/a><\/span>\u00a0what a history of policy analysis might look like. She quite reasonably notes that, as a faculty member at the Centre de Researche en \u00c9conomie et Management<\/a><\/span> at Rennes, she wants her\u00a0“students to know why and how the theories, tools and practices they will later use on a daily basis were conceived and spread, and a good 80% of them will participate in a policy evaluation in the next 10 years.”<\/span><\/p>\n

\"cover_5_2up\"<\/a>I suspect\u00a0we will be\u00a0best served in answering this call\u00a0if we admit the poverty of our current historical knowledge. We have a number of useful\u00a0historical studies of various bits of policy analysis, and many more dislocated fragments of such a history are also to be found in the practitioner literature. However, I do not think we can even, at this stage, outline what a synthetic history would look like.<\/span><\/p>\n

I arrive at this conclusion out of lessons learned while researching and\u00a0writing my book,\u00a0Rational Action<\/em>, which is due out in a couple of months (and which I will not attempt to dissuade\u00a0you from pre-ordering<\/a><\/span>). The book uses 300 pages of text to outline the history of a cluster of influential fields—primarily operations research\/management science (OR\/MS), systems analysis, and decision theory—that developed in the middle of the twentieth century.<\/span><\/p>\n

One of the key lessons learned is that many, including most historians,\u00a0have been too quick to assume that they understood the basic outlines of the story as having primarily to do with these sciences’ attempts to apply “scientific” methodology to the realm of policy. Conceived in this way, the history becomes one of various attempts to define what constitutes a properly scientific approach, and of various attempts to command authority through the application of such an approach. As a consequence, the histories of very different fields become blurred together as part of a general mid-twentieth-century movement to make politics and society more scientific.<\/span><\/p>\n

<\/span><\/p>\n

In fact, Beatrice, having read over my introduction, took me to be making exactly this point:\u00a0“…Thomas argues that\u00a0scientists believed that their science’s association with technology and rationality made it\u00a0de facto\u00a0policy relevant.”<\/span><\/p>\n

Reading that was a bit alarming to\u00a0me, because I actually rewrote my introduction a large\u00a0number of times to try and convey just\u00a0the opposite:\u00a0invocations of\u00a0“science,” while\u00a0having some rhetorical<\/em>\u00a0(and thus substantial historiographical) importance, had very little\u00a0bearing on how anyone, scientist or non-scientist, actually judged the legitimacy and utility of these sciences at that time.<\/span><\/p>\n

Of course, a few\u00a0proponents of the sciences of policy did<\/em> suppose\u00a0that, as people committed to the application of scientific method, they held a\u00a0skeleton key to problems of policy analysis. Accordingly, they\u00a0made recommendations such as the establishment of advisory groups to analyze\u00a0“national political objectives” for the U.S. President, or the problems of economic development for India. These recommendations were\u00a0rejected not by policymakers, but by these individuals’ colleagues, and primarily because those colleagues were skeptical that they could legitimately claim any special skill or knowledge to address problems in those areas.<\/span><\/p>\n

\"One<\/a>
One of the more hyperbolic claims about postwar operations research. Physicist Ellis Johnson, pictured, was head of the Army’s Operations Research Office, 1948\u20131961. In 1951 he privately (and vainly) suggested to a National Research Council committee that OR be immediately implemented in the White House.<\/span><\/figcaption><\/figure>\n

Legitimacy, I believe, was actually conferred through a more subtle calculus that matched (or failed to match) particular approaches to particular problems in a convincing way. Therefore, the histories of these sciences—the patterns in\u00a0which they were taken up, rejected, and evolved—only really make sense if we understand the differences between them, and how they developed in response to particular<\/em> problems of policy<\/em>.<\/span><\/p>\n

And here we come to our main challenge: to understand the history of policy analysis or policy evaluation, we really need to get a\u00a0better\u00a0grasp on the history of policy itself.<\/strong><\/span><\/p>\n

Policy is an extraordinarily broad terrain,\u00a0encompassing\u00a0both how policies are made and administered, as well as the various domains (e.g., health, education, military, business, etc.), levels (e.g., Congressional, departmental, local, corporate, managerial, strategic, tactical, etc.), and types (e.g., budgetary, regulatory, program building, etc.) of policy that exist. And this is leaving aside international comparisons!<\/span><\/p>\n

In the cases of the sciences I deal with, their main successes came through their ability to identify and address very particular\u00a0problems. Military operations research was primarily about the articulation of rationales underlying plans for combat operations, and conducting empirical research to discern whether those rationales could be improved upon. OR, and related activities, also contributed to\u00a0the problem of developing equipment designs that accorded with military needs, as well as tactics that best made use of available equipment. Naturally, all these problems were also subject to contemplation by military planners and engineers, so the\u00a0real\u00a0<\/em>question was where\u00a0improvements\u00a0<\/em>to existing practices could be made.<\/span><\/p>\n

In industry, I argue, there were fewer\u00a0opportunities for generalized study in a\u00a0business\u00a0culture crowded with both specialized and generalized expertise. Here their main contribution came through the application of\u00a0advanced mathematics to optimization problems in\u00a0logistics, inventory replenishment and production control policies, and other problems of organization that turned on complex quantifiable\u00a0considerations.<\/span><\/p>\n

Some figures, eager to have a more fundamental impact on business management and policymaking, later ventured into things like “soft systems”<\/a><\/span> and “wicked problems,”<\/a><\/span> but these were always domains where it was difficult to legitimately claim any special expertise.* The term “policy sciences” (the reason I had to use the construction “sciences of policy”)\u00a0came into being\u00a0circa 1970<\/a><\/span>\u00a0to connote the study of policymaking from a more sociological standpoint. Such an approach\u00a0was viewed as essential for confronting the practical and political difficulties of\u00a0social policy, which\u00a0at that time was becoming more prevalent.<\/span><\/p>\n

Here’s a video of soft systems pioneer Peter Checkland<\/a><\/span> talking about the origins of the methodology:<\/span><\/p>\n

http:\/\/www.youtube.com\/watch?v=XA2i1n-o9L0<\/p>\n

Both more and less formal analytical approaches to policy have had strong academic components. I believe it is important not to assume that ideas moved in anything but the most oblique ways from the academy to policy<\/strong>, despite critics’ and historians’ frequent\u00a0claims that in the mid-century period the abstract, formal, supposedly rationalist analytical approaches ascendant in the academy carried an unreasonable intellectual and political authority.<\/span><\/p>\n

For example, although the famous\u00a0“Measurement without Theory”<\/a><\/span>\u00a0(pdf) debate of the late 1940s was a clarion call for academic theorization in economics, culminating with\u00a0the\u00a0ascendancy\u00a0of such strict\u00a0theoretical desiderata as “microfoundations,”<\/a><\/span> practical economic analysis\u00a0followed its own track<\/a>\u00a0(pdf)<\/span><\/span>.<\/span><\/p>\n

Similarly, on the subject of nuclear strategy, I am partial to David Alan Rosenberg’s emphasis<\/a><\/span> on military policymakers’ contributions to U.S. strategic doctrine, which plays down\u00a0the role of “strategic thinkers,” to whom\u00a0others, such as Fred Kaplan<\/a><\/span>, have given a prominent role.<\/span><\/p>\n

Probably the most important players in policymaking and policy evaluation\u00a0have continued to be\u00a0people with experience in those areas who are familiar with the broad and detailed questions\u00a0that go into the craft and implementation of policy.<\/strong> This includes civil servants and contractors, appointed administrators, and then, to a lesser extent, members of\u00a0external advisory and oversight boards, and even some\u00a0members of Congress with a dedicated interest in certain subjects. They make policy in consultation with a wide variety of individuals with varying forms of experience and expertise. For the most part, we don’t know who any of these people are or what they are thinking, or why they think they way they do. If we think we do, we’re probably wrong.<\/span><\/p>\n

For historians, a crucial task would be simply to trace these people’s history, both individually, and, prosopographically (i.e.,\u00a0to trace trends in their training, professional background,\u00a0socioeconomic status, and so forth). To venture an educated guess, these\u00a0individuals would not have\u00a0claimed their measure of influence through any sort of epistemic authority—most were not scientific or engineering figures—but through happenstance, shifting political and social trends, and, no doubt, individuals’ political initiative as well as their ability to formulate and think through detailed problems of administration.<\/span><\/p>\n

We could go on, for instance to suggest just\u00a0where technically, economically, and social scientifically (not to mention legally, humanistically, etc.) trained individuals did fit into the larger sphere of policy, and how that shifted through time.\u00a0I will refrain since our<\/strong>\u00a0problem is already monstrously complex. But, I argue, therein lies our opportunity.<\/strong><\/span><\/p>\n

If we accept that there is no good resource encompassing\u00a0the history (and, for that matter, the present) of\u00a0policies, policymaking, policy analysis. And, if we accept that history can bring clarity, by providing information about motivation, context, and reasoning,<\/strong> then, by making available systematic, accessible, well articulated<\/strong>\u00a0pictures of policy problems and of the thinking of the people who\u00a0normally address them, it should be possible to lend concreteness, sharpness, and openness to deliberations for those who can benefit from such concreteness, sharpness, and openness.<\/span><\/p>\n

This sort of thing is not really amenable to pithy conclusions about the mentality of policymaking elites, which has been a temptation that has too often consumed prior history. Nor would it\u00a0be fit for articles in\u00a0The Atlantic\u00a0<\/em>or for broadcast on BBC4, which are good examples of historians’ preferred vehicles of outreach. But I do think, if done right, it could be a game changer for contemporary history as a relevant discipline.<\/span><\/p>\n

—<\/span><\/p>\n

*I owe my understanding of “soft systems methodology” and its tension with “operational research” in Britain to several works by Maurice Kirby on this topic.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Historian of economics Beatrice Cherrier has\u00a0asked\u00a0what a history of policy analysis might look like. She quite reasonably notes that, as a faculty member at the Centre de Researche en \u00c9conomie et Management at Rennes, she wants her\u00a0“students to know why and how the theories, tools and practices they will later use on a daily basis<\/p>\n

Continue Reading… The Challenges and Opportunities of Policy Analysis History: Some Notions<\/span>Continue Reading…<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[23],"tags":[],"class_list":["post-13451","post","type-post","status-publish","format-standard","hentry","category-operations-research"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":false,"_links":{"self":[{"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/posts\/13451","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/comments?post=13451"}],"version-history":[{"count":0,"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/posts\/13451\/revisions"}],"wp:attachment":[{"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/media?parent=13451"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/categories?post=13451"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rational-action.com\/etherwave\/wp-json\/wp\/v2\/tags?post=13451"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}