The Federal Circuit and a few other counterexamples notwithstanding, American courts are not substantively specialized.\u00a0 By and large, the American judge is thus a generalist.\u00a0 For better or worse, our judiciary seems to be holding out against the \u00a0pressures toward specialization that have so marked the contemporary legal and medical professions.\u00a0<\/p>\n
Is this a good thing?\u00a0 In the law review literature, there\u00a0are plenty\u00a0of calls for the creation of this or that new specialized court.\u00a0 Certainly, specialization leads to quicker and more efficient decisionmaking.\u00a0 But should we expect the specialized judge also to render decisions that are substantively better?<\/p>\n
This is the question that lies at the heart of Chad Oldfather\u2019s <\/a>new article, \u201cJudging, Expertise, and the Rule of Law<\/a>.\u201d\u00a0 <\/p>\n Chad\u2019s analysis rests on the burgeoning psychological literature on expertise.\u00a0 His conclusion is that the claims about the ability of specialist judges to develop and successfully use a higher level of substantive expertise are probably much overstated.\u00a0 Chad\u2019s analysis has many nuances.\u00a0 To highlight just one dimension that I found especially intriguing, he considers the likelihood that specialist judges are better able to make accurate predictions regarding the consequences of ruling one way or another.\u00a0 He suggests that the answer depends on the certain personal qualities of the judge:<\/p>\n A final body of research that bears consideration is Philip Tetlock\u2019s work on expert political judgment. \u00a0Tetlock\u2019s project was, in effect, to attempt to isolate the components of \u201cgood political judgment,\u201d and he did so primarily by getting experts to make predictions about future states of the world and then, over time, assessing whether those predictions came true. This is, as he readily acknowledges, a slippery task, in large part because disagreements turn on more than ascertainable factual claims. Instead, they involve \u201chard-to-refute counterfactual claims about what would have happened if we had taken different policy paths and on impossible-to-refute moral claims about the types of people we should aspire to be\u2014all claims that partisans can use to fortify their positions against falsification.\u201d While Tetlock acknowledges the impossibility of eradicating all the subjectivity from the inquiry, he maintains that it is possible to assess them by reference both to the correspondence between experts\u2019 predictions and reality and the coherence of the processes by which they approach the task.<\/p>\n Tetlock concluded that, overall, experts\u2019 judgment was not good. As he puts it, \u201cHumanity barely bests the chimp.\u201d \u00a0\u201c[V]ariation in forecasting skill is roughly normally distributed, with means hovering not much above chance and slightly below case-specific extrapolation algorithms.\u201d\u00a0 Tetlock found that demographic and life-history factors bore very little relationship to forecasting success. \u201cIt made virtually no difference whether participants had doctorates, whether they were economists, political scientists, journalists, or historians, whether they had policy experience or access to classified information, or whether they had logged many or few years of experience in their chosen line of work.\u201d \u00a0Nor did ideology or other factors relating to worldview or disposition correlate with forecasting success.<\/p>\n What did matter, Tetlock found, was the process by which experts approached the predictive task. Drawing on Isaiah Berlin\u2019s famous fox-hedgehog distinction, he found a \u201cdimension [that] did what none of the measures of professional background could do: distinguish observers of the contemporary scene with superior forecasting records, across regions, topics, and time.\u201d<\/p>\n “Low scorers look like hedgehogs: thinkers who \u2018know one big thing,\u2019 aggressively extend the explanatory reach of that one big thing into new domains, display bristly impatience with those who \u2018do not get it,\u2019 and express considerable confidence that they are already pretty proficient forecasters, at least in the long term. High scorers look like foxes: thinkers who know many small things (tricks of their trade), are skeptical of grand schemes, see explanation and prediction not as deductive exercises but rather as exercises in flexible \u2018ad hocery\u2019 that require stitching together diverse sources of information, and are rather diffident about their own forecasting prowess, and \u2026 rather dubious that the cloudlike subject of politics can be the object of clocklike science.”<\/p>\n Looking beyond the simple fox-hedgehog divide, Tetlock found that \u201chedgehog extremists making long-term predictions in their domains of expertise\u201d were the worst performers.\u00a0 The best were \u201cfoxes making short-term predictions within their domains of expertise.\u201d \u00a0In all, he concludes, \u201cthe performance gap between foxes and hedgehogs \u2026 is statistically reliable, but the size of the gap is moderated by at least three other variables: extremism, expertise, and forecasting horizon.\u201d<\/p>\n Tetlock reasons that these results are consistent with other research on cognition. Hedgehogs, he suggests, \u201cbear a strong family resemblance to high scorers on personality scales designed to measure needs for closure and structure\u2014the type of people who have been shown in experimental research to be more likely to trivialize evidence that undercuts their preconceptions and to embrace evidence that reinforces their preconceptions.\u201d \u00a0Hedgehog experts perform especially poorly because their expertise better equips them to discount contrary evidence as well as to characterize evidence as bolstering their beliefs. Extremism magnifies the effect. \u00a0Meanwhile, foxes are more self-critical and more inclined to anticipate criticism from others, and consequently more likely to give due consideration to all information that bears on their position. \u00a0For foxes, expertise pays dividends, since it enhances their ability to assess all information.\u00a0 (41-43)<\/p><\/blockquote>\n In addition to questioning the advantages claimed for a specialized judiciary, Chad also discusses the case for generalists.\u00a0 He identifies rule-of-law values as the most important justification for our generalist traditions:<\/p>\n The strongest arguments for a generalist judiciary seem to require the acceptance of a certain conception of law, and in turn of the judicial role. Stated simply, the conception of law that seems to underlie the generalist judiciary is one in which law strives to be something of a common language. There are at least two ideas at work here. One is that the expertise relevant to judging exists at a similarly broad level. On that view, the key is not expertise in or familiarity with the particulars of, say, tax law that matters, but rather an advanced ability to deploy the tools of legal analysis. The second idea extends beyond the act of judging to the impact of that act on the relationship between the law and those who are governed by it. It goes beyond the notion that we have a government of laws and not of men to the suggestion that we must have a government of laws that can be understood and adhered to by more-or-less ordinary people. The generalist judiciary can further these goals not only by preventing the sort of balkanization that is likely to occur if separate judiciaries have responsibility for their own areas of law, but also by serving as a more general barrier to needless technicality and complexity in the law. The presence of the generalist effectively requires specialist lawyers to translate their arguments into the common language of the generalist, which in turn facilitates the generality of law. This barrier provided by the generalist is hardly impermeable. It is not difficult to find examples of needless technicality and complexity in the law created by generalists. Nonetheless, one can easily imagine generalism serving as an antidote to some of the more severe pathologies that might afflict the law under a regime based more on specialization.\u00a0 (48-49)<\/p><\/blockquote>\n Chad’s very fox-like\u00a0article is forthcoming in the Washington University Law Review.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":" The Federal Circuit and a few other counterexamples notwithstanding, American courts are not substantively specialized.\u00a0 By and large, the American judge is thus a generalist.\u00a0 For better or worse, our judiciary seems to be holding out against the \u00a0pressures toward specialization that have so marked the contemporary legal and medical professions.\u00a0 Is this a good […]<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ocean_post_layout":"","ocean_both_sidebars_style":"","ocean_both_sidebars_content_width":0,"ocean_both_sidebars_sidebars_width":0,"ocean_sidebar":"","ocean_second_sidebar":"","ocean_disable_margins":"enable","ocean_add_body_class":"","ocean_shortcode_before_top_bar":"","ocean_shortcode_after_top_bar":"","ocean_shortcode_before_header":"","ocean_shortcode_after_header":"","ocean_has_shortcode":"","ocean_shortcode_after_title":"","ocean_shortcode_before_footer_widgets":"","ocean_shortcode_after_footer_widgets":"","ocean_shortcode_before_footer_bottom":"","ocean_shortcode_after_footer_bottom":"","ocean_display_top_bar":"default","ocean_display_header":"default","ocean_header_style":"","ocean_center_header_left_menu":"","ocean_custom_header_template":"","ocean_custom_logo":0,"ocean_custom_retina_logo":0,"ocean_custom_logo_max_width":0,"ocean_custom_logo_tablet_max_width":0,"ocean_custom_logo_mobile_max_width":0,"ocean_custom_logo_max_height":0,"ocean_custom_logo_tablet_max_height":0,"ocean_custom_logo_mobile_max_height":0,"ocean_header_custom_menu":"","ocean_menu_typo_font_family":"","ocean_menu_typo_font_subset":"","ocean_menu_typo_font_size":0,"ocean_menu_typo_font_size_tablet":0,"ocean_menu_typo_font_size_mobile":0,"ocean_menu_typo_font_size_unit":"px","ocean_menu_typo_font_weight":"","ocean_menu_typo_font_weight_tablet":"","ocean_menu_typo_font_weight_mobile":"","ocean_menu_typo_transform":"","ocean_menu_typo_transform_tablet":"","ocean_menu_typo_transform_mobile":"","ocean_menu_typo_line_height":0,"ocean_menu_typo_line_height_tablet":0,"ocean_menu_typo_line_height_mobile":0,"ocean_menu_typo_line_height_unit":"","ocean_menu_typo_spacing":0,"ocean_menu_typo_spacing_tablet":0,"ocean_menu_typo_spacing_mobile":0,"ocean_menu_typo_spacing_unit":"","ocean_menu_link_color":"","ocean_menu_link_color_hover":"","ocean_menu_link_color_active":"","ocean_menu_link_background":"","ocean_menu_link_hover_background":"","ocean_menu_link_active_background":"","ocean_menu_social_links_bg":"","ocean_menu_social_hover_links_bg":"","ocean_menu_social_links_color":"","ocean_menu_social_hover_links_color":"","ocean_disable_title":"default","ocean_disable_heading":"default","ocean_post_title":"","ocean_post_subheading":"","ocean_post_title_style":"","ocean_post_title_background_color":"","ocean_post_title_background":0,"ocean_post_title_bg_image_position":"","ocean_post_title_bg_image_attachment":"","ocean_post_title_bg_image_repeat":"","ocean_post_title_bg_image_size":"","ocean_post_title_height":0,"ocean_post_title_bg_overlay":0.5,"ocean_post_title_bg_overlay_color":"","ocean_disable_breadcrumbs":"default","ocean_breadcrumbs_color":"","ocean_breadcrumbs_separator_color":"","ocean_breadcrumbs_links_color":"","ocean_breadcrumbs_links_hover_color":"","ocean_display_footer_widgets":"default","ocean_display_footer_bottom":"default","ocean_custom_footer_template":"","ocean_post_oembed":"","ocean_post_self_hosted_media":"","ocean_post_video_embed":"","ocean_link_format":"","ocean_link_format_target":"self","ocean_quote_format":"","ocean_quote_format_link":"post","ocean_gallery_link_images":"on","ocean_gallery_id":[],"footnotes":""},"categories":[68,35,122],"tags":[],"class_list":["post-14942","post","type-post","status-publish","format-standard","hentry","category-judges-judicial-process","category-legal-scholarship","category-public","entry"],"_links":{"self":[{"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/posts\/14942","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/comments?post=14942"}],"version-history":[{"count":0,"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/posts\/14942\/revisions"}],"wp:attachment":[{"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/media?parent=14942"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/categories?post=14942"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/law.marquette.edu\/facultyblog\/wp-json\/wp\/v2\/tags?post=14942"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}