Ranking Philosophy Programs

There are now two sets of rankings of Ph.D.-granting philosophy departments in the United States: Brian Leiter’s Philosophical Gourmet (PG) and Academic Analytics’ Faculty Scholarly Productivity Index (FSPI). The latter only ranks the top ten, so I’ll stick with comparing both rankings’ top ten. Only two universities are listed in both rankings: Princeton and Rutgers. The rest are entirely different. FSPI ranks Michigan State first; PG ranks NYU first. Here’s the run-down:

Academic Analytics’ Faculty Scholarly Productivity Index

1. Michigan State University
2. CUNY Graduate School
2. Princeton University
4. University of Virginia
5. Rutgers
6. University of California – San Diego
7. Pennsylvania State University
8. The University of Texas at Austin
9. SUNY at Stony Brook
10. Rice University

Brian Leiter’s Philosophical Gourmet ranking

1. New York University
2. Rutgers
3. Princeton University
3. University of Michigan-Ann Arbor
5. University of Pittsburgh
6. Stanford University
7. Harvard University
7. MIT
7. UCLA
10. Columbia University
10. Univ. of North Carolina –Chapel Hill

The discrepancy can be explained by different methodologies. FSPI is based on data generated by a web-crawler of individual faculty members’ productivity in terms of scholarly publications, honors and awards, and grants. Comparing the sheer volume of scholarly publications is, I think, a bit dicey, since it equates publication in more- and less-selective presses and journals. However, the honors, grants, and awards criteria, a better gauge of quality, probably balances things out. Also FSPI takes into consideration whether one’s journal articles are cited in others’ journal articles — certainly an excellent indication of the influence of one’s work.

The Philosophical Gourmet’s methodology is as follows, according to its web site:

This report ranks graduate programs primarily on the basis of the quality of faculty. In late September and early October 2006, we conducted an on-line survey of 450 philosophers throughout the English-speaking world; over 300 responded and completed some or all of the surveys. The survey presented 99 faculty lists, from the United States, Canada, United Kingdom, and Australia and New Zealand . Note that there are some 110 PhD-granting programs in the U.S. alone, but it would be unduly burdensome for evaluators to ask them to evaluate all these programs each year. The top programs in each region were selected for evaluation, plus a few additional programs are included each year to “test the waters.”

Leiter lists the names and affiliations of the people who filled out his survey. The full list is available here http://www.philosophicalgourmet.com/reportdesc.asp. Note that there is no one on the list from Michigan State, Penn State, or Stony Brook: and only one each from Rice, and CUNY — and none of these schools show up in his top ten even though they do show up in FSPI’s top ten. But four of Leiter’s responders are with NYU; nine have been affiliated with Stanford; thirteen with Michigan; twenty-two with Pittsburgh; and another twenty-some with Harvard — and all of these schools show up in his top ten. Leiter notes that no one who has received a Ph.D. or taught at a particular institution may rank that institution. That’s goood. But still one might suspect that the entire pool of respondents comes from a particular orientation and holds a certain set of conceptions of what counts as quality faculty. Few hale from truly pluralist departments, and so it’s not suprising that truly pluralist departments don’t end up on PG’s top ten. In fact several of PG’s top ten bill themselves on their own web sites as working solely in the analytic tradition.

Note the following.

Schools ranked in the top ten by Academic Analytics that don’t appear in the top ten Philosophical Gourmet rankings:

Michigan State University (lots of strengths in ethics, continental philosophy, feminist philosophy, social and political philosophy, and philosophy of science)

CUNY Graduate School (mostly analytic, diverse interests)

University of Virginia (strong analytic department with strengths in ethics and political philosophy)

University of California San Diego (analytic faculty, strengths in philosophy of mind, history of modern, ancient)

Pennsylvania State University (some faculty have left since the study was done, but it still has its characteristic strengths in continental philosophy, pragmatism, and feminist theory)

The University of Texas at Austin (at the time of the study, it had a bit more strength in continental philosophy – Louis Mackey and Robert Solomon have since passed away)

SUNY at Stony Brook (a school exceptionally strong in continental philosophy, feminist theory, and critical race theory)

Rice University (also has strengths in continental philosophy)

Schools ranked in the top ten by the Philosophical Gourmet that don’t appear in the top ten Academic Analytics rankings (links can be found here ) :

New York University
University of Michigan – Ann Arbor
University of Pittsburgh
Stanford University
MIT
UCLA
Columbia University
UNC-Chapel Hill

No doubt these are excellent programs, but to say they are the very best based on the judgment of an unrepresentative cohort of faculty selected by someone with already marked views about what counts as quality is simply bad logic. I’d opt for the Academic Analytics’ Faculty Scholarly Productivity Index any day. It more accurately reflects the productivity and range of scholarship in philosophy today.

13 Responses to “Ranking Philosophy Programs”

  1. Leiter’s report is more of a popularity contest than a serious attempt to rank departments by academic worth. And while we at Michigan State are pumped to be at the top of the FSPI ranking, there’s more than a bit of bean-counting in its methodology. I prefer bean-counting to social snobbery myself, but there’s gotta be another option!

  2. I share your concerns about the lack of distinction between more and less selective journals, but at least what we have here is a strict methodology with a definite conclusion tied specifically to that which it tests. In other words, it purports to study productivity, it measures (measures, doesn’t ask subjective opinions about) productivity, and concludes which programs are most productive. Leiter, by contrast, asks for subjective opinions from a non-random (hence non-representative) sample of faculty about where the “best” faculty are (whatever that means) and then generalizes from those subjective statements to conclusions about “best programs.” My first-year critical thinking students could drive a truck through the holes in Leiter’s methods.

  3. I agree about the Leiter’s Gourmet Report being a rather biased beauty pageant, and as a faculty member of the MSU philosophy department, I’d love it if MSU philosophy really was #1. Unfortunately, there is a very, very serious problem with the methodology of FSPI with regard to the humanities. In particular, the index FSPI used for references to journal articles and citations of them, Scopus, only covers the sciences and not the humanities! Scopus covers life science, health science, physical science and social science. This can be verified by visiting the Scopus webpage.

    http://info.scopus.com/detail/what/

    You can also check to the FSPI website to verify that they do not use another index besides Scopus. In fact, I contacted FSPI via email about this to confirm this point.

    So, philosophy publications in the Journal of Philosophy, for example, would not be found in Scopus. In contrast, the main bioethics journals are there, as are some philosophy of science journals Biology and Philosophy and Philosophy of the Social Sciences. (Incidentally, I had publications in both of those journals in the study period for the FSPI ranking.)

    I think the coverage of Scopus explains why MSU philosophy came out #1. MSU philosophy has strength in bioethics, and the main bioethics journals would be covered in the medical science section. So, ironically, while bioethics counts for almost nothing in the Leiter report, it makes a big impact on the philosophy section of the FSPI. Moreover, MSU philosophy has a few faculty who publish in science journals (like Rob Pennock).

    Basically, you can think of the FSPI as a ranking of research productivity if all that counted were philosophy papers published in journals that are included in science citation indices. That might tell us something interesting, but it definitely does not provide an overall assessment of the research productivity of philosophy departments. I hope that in the future FSPI will use an index that covers the humanities. And my guess is that, if they did, their rankings would look a little bit more like the Leiter report.

    Dan Steel

  4. Note that the ‘productivity’ that the FSPI more accurately represents is a ‘marked view about what counts as quality’ as well.

  5. Dan, Thanks for this information. I checked the SCOPUS database and it does include the Philosophy Documentation Center as well as databases in all the humanities. But as you noted SCOPUS doesn’t bill itself as a humanities site, so I’ve also left a message with Academic Analytics to clear this up. To John Z, yes, I admit to placing a value on productivity. We all have values; let’s just put them on the table. –Noelle McAfee

  6. Philosophical Gourmet is the best site for those interested in the intense, rigorous, logic skills used at analytic universities.

  7. how does Noelle McAfree know that there are only two philosophy school ranking websites?

  8. philosophical gourmet updates
    it is more of a specialized rating guide
    it helps with undergraduate school choices and masters programs as well.

  9. Concerning the worry about the evaluators being from a select number of depts, I seem to remember a paper statistically analysing the feedback and showing near total consensus amongst faculty from the entire range of depts assessed as to who was top and who bottom (I actually think those from lower ranked depts tended to be harsher in their evaluations).

    Of course, I’m sure people will say that this is because everyone has been brainwashed by the PGR into thinking the rankings are gospel and so rank accordingly.

    But there have always been rankings of depts; at least Leiter’s methodology is explicit and based on up-to-date information. Thanks to the statistical analyses it’s possible for people to be fully informed of the fact that having metaphysicians will count for more than having historians of philosophy (and know exactly how much that counts). Whatever else you think of the PGR, it at least allows people to think clearly about these matters.

  10. [...] someone named Ann posted a comment to an earlier thread about philosophy rankings. The upshot of her comment is that (1) she recalls a paper “statistically analysing the feedback and showing near total [...]

  11. very interesting, but I don’t agree with you
    Idetrorce

  12. I would like to see a continuation of the topic

  13. To be totally honest, as an MA student in philosophy with aspirations to continue on to a Ph.D, I’d like to see a site that ranked philosophy departments by their job placement record. This information is often hard to find on department websites, and it doesn’t seem that either of these ranking systems takes that into consideration. Just a thought. Obviously placement isn’t all that matters, but lets be honest, it matters a little bit.

Leave a Reply