A philosopher elsewhere writes:
Prompted by your post, I was looking at the "pluralist guide". It has all the problems you mention, but more too. The most obvious or important is when the person leading to a ranking isn't at the institution. You noted some of those in the "continental philosophy" section, but there are others, too. So, in the "Latin American philosophy" section they note Temple for "Caribbean philosophy" because of Lewis Gordon, even though Gordon isn't at Temple any more. (I think you had noted he moved to U Conn.) The also have a listing of undergrad programs for this area, despite the fact that this would be a close to insane reason to pick between undergrad program, not least because the schools listed are really wildly different.
There's a strange second guessing of rankers in the "GLBT Philosophy" section, especially in
the second part. I'd think that you'd either want to trust the rankers or not. It's an odd situation.
The "feminist philosophy" section is odd for many reasons. SUNY Albany is "recommended", though only one (untenured) person there works on feminist philosophy at all. That's the same level of recommendation as Stanford, which has both Deborah Satz and Helen Longino. (I think that only ideology could justify placing Stanford, which I'd take to be a top lace for this stuff, below many of the "highly recommended" places.)
The "race and ethnicity" bit is very odd, too. Both UNC and Harvard have one main person who works in this area- Bernard Boxill and Tommie Shelby, respectively. But, UNC is "highly recommended" while Harvard is just "recommended". The same goes for Rutgers. (Princeton is also in the "also recommended", but that might be more reasonable given that I'm not sure that Appiah is working on race much these days.) Kansas isn't ranked at all, even though one of their best philosophers, Derrick Darby, works directly on these issues. (He's visiting at Michigan, though, so maybe he won't stay there.) Most oddly, there is a ranking for both "Rutgers" and "Rutgers University-New Brunswick". I have no real idea what' s going on there- perhaps the first means Rutgers-Newark, which does have an interesting philosopher working on race (Anna Stubblefield) but no grad program. Anyway, she's an "affiliated" faculty member at New Brunswick, so it's a bit nuts in any case.
Anyway, as you already know, the quality control level there isn't very good. I suppose I should not be surprised, but still, it's surprising to find something so shoddy put up on the web.