Now that David Wallace (Oxford) has destroyed the purportedly data-driven analysis in the Bruya critique of the PGR (and here), confirming with damning details the crux of my initial criticisms and adding several other important criticisms, what are the takeaways from this sorry episode?
I begin by observing that anyone who actually read the first few pages of the Bruya paper would have immediately heard the sound of an axe grinding, a clear sign that one needed to examine carefully what's to come. As Prof. Wallace's analysis has now established, whenever Bruya had a choice to make, he opted for massive inflation of the categories into which he put the data for analysis: doubling the size of the "metaphysics & epistemology" category, for example, by arbitrarily incorporating all of the specialties in philosophy of the sciences, math and logic into that category; and treating institutional affiliation as meaning either the school at which the evaluator currently teaches or the school from which s/he received the PhD, thus massively inflating the institutional affiliation numbers for schools that have granted lots of PhDs over the past several decades. In both cases, the fabrications were not acknowledged clearly in the text or even sensibly defended; the fabrications were buried in appendices and footnotes. And in both cases, the fabrications biased the purportedly "data driven" analysis of bias, as Prof. Wallace has shown. Between the fabrications, the mathematical mistakes (noted by Prof. Wallace) and the defamatory racism smear, it was fairly obvious that something was, shall we say, amiss. But it's quite clear most of those enthusing about the paper on social media had not read it, and simply repeated its self-advertising as a "data-driven" critique, which we now know was a bit of false advertising.
So here are a few lessons I think we can learn from all this:
1. Peer review isn't all that it's cracked up to be, at least at some journals. Metaphilosophy is now on notice that something went very wrong, and the journal's reputation now hangs in the balance. Between the defamation and the fabrications and the mathematical mistakes, someone wasn't really paying attention--or perhaps the referee (assuming there really was one, I don't know) shared the relevant bias so was only too happy to give the paper a pass, despite its incompetence.
2. If philosophy is still a Wissenschaft, then it should be possible for philosophy papers to end up on Retraction Watch. A purportedly interdisciplinary paper, in which misrepresentations and mathematical errors abound, is surely a rather good candidate.
Recent Comments