In our newest "how can we help you?" thread, a reader writes:
Maybe we could have a thread on 'types of referee reports'. I am working on a particularly frustrating R&R right now, and could use the entertainment. It maybe could also be instructive (?) on what not to do when writing a referee report?
Here, I'll start:
“You have not cited my book. No one else will tell you to cite my book, but I wrote it, someone published it, it’s on a glancingly related topic, so this lack of engagement with my work is a severe deficiency of your paper. Reject.”
“You have cited my book, but apparently you disagree with me. This means that you have not read my book carefully enough. Read it again. Reject.”
“You have talked about how X is related to Y, but have you considered that perhaps Z is related to Y? I do not know if it is, but neither do you, apparently, since you do not write about it, so … reject.”
“You are here writing about X. But have you considered mildly related issues Y and Z? Apparently you are ignorant of them. I would not consider publishing any paper on X that does not address Y and Z. Revise and resubmit […] This paper is too disjointed. What you write about Y and Z is nuanced and insightful, I am not sure why you discuss Y and Z in a paper on X. Reject.”
“I am just not convinced by this. Reject.”
“This is a great paper, unfortunately it’s on a topic I’m not super interested in. Have you considered rewriting the paper on a different topic, that is more related to my specific areas of interest and expertise? Thanks in advance. Revise and resubmit.”
This could be a rather fun and potentially illuminating exercise to end the week with, as it might help us all to reflect a bit on how we and others around us approach the practice of peer-review. I'll probably share an example or two in the comments section below, but I think I'd just like to open things up for comments first!
Your paper is on topic X. I don't know much about X, but it's vaguely adjacent to my specialty Y, so I guess I'll just review it. Anyways, X looks like a stupid topic to me, it would have been better to write on Y. I never heard of the argument you're addressing in section 2, I suppose it's not worth hearing of. Alright, I'm bored. Here are some objections I remember from an intro-level book on X that I read 20 years ago, hopefully the author will find them helpful. Reject.
Posted by: Overseas Tenured | 05/28/2021 at 11:18 AM
Your paper argues (i) that thesis P, despite being weird and previously undiscussed, is free of any forceful philosophical reasons for doubting that it is possibly true, and (ii) that if P is possibly true then widely influential thesis Q is false. But I don't get why we should care about a paper on P, since P is weird and no one has defended it. Also, Q is only widely influential among those who got their PhD after 2002. Reject.
Posted by: Stateside Tenured | 05/28/2021 at 12:17 PM
Your paper is on what theory X can say about problem Y. But you fail to address unrelated objection Z that many people have to theory X. Reject.
Posted by: Richard Y Chappell | 05/28/2021 at 12:24 PM
For the historians out there:
Your paper argues that Historical Philosopher P believes X. But you do not consider the wide variety of unnamed, uncited, non-existent places where P says not-X. Reject.
Posted by: Stateside Untenured | 05/28/2021 at 12:56 PM
It seems to be common ground amongst the people you're engaging with that X is a phenomenon worth writing about. But I hadn't heard of X until reading this manuscript! Does X even really exist? Is it possible to adequately define X? Reject.
Posted by: anon | 05/28/2021 at 01:12 PM
In my first referee report, I asked you to clarify a couple of things. Now that you have done this, I can see more clearly that your paper deserves rejection.
Posted by: Postdoc | 05/28/2021 at 03:30 PM
My recommendation is that the paper be rejected. This isn't a bad paper, but in my judgement isn't up to the usual standards of journal X.
Posted by: anom | 05/28/2021 at 05:00 PM
You clearly and cogently refute some views of prominent philosophers. But those views are dumb. I already thought they were false. Reject.
Posted by: Tim | 05/28/2021 at 09:36 PM
This paper fails to cite some relevant works published in the time between when the author sent the manuscript to the journal and when the journal got around to sending it to me (or perhaps the journal sent it to me a while ago and I neglected to review it until now). Reject.
Posted by: Daniel Weltman | 05/28/2021 at 10:31 PM
(I work in logic)
You used a computer to help with a tedious part. Reject.
Posted by: Timmy J | 05/28/2021 at 11:19 PM
Here are several subtle points that may be helpful to your paper, or may be minor criticisms that you can easily address. These points are subtle enough that you now know that I am an expert on this topic who knows this literature very well. Now that you know this, consider this completely nonsensical objection to your paper that no expert on this topic could ever take seriously. Me and you both know that it's rubbish and that it's confusion could be decisively demonstrated in a couple of sentences. But the editors are unfamiliar with this topic don't realise this. Thus, they will accept it when I offer it as my reason for rejection. You've been trolled sucker!
Posted by: The Sucker | 05/29/2021 at 12:46 AM
You establish your conclusion by way of methodology X. While X is the standard methodology for approaching the issue, I think X is misguided. Reject.
Posted by: AR | 05/29/2021 at 07:05 AM
Another for the historians (not mine but one a friend ran into a bunch of times with one paper):
Sure you find a bunch of overlooked places where Locke himself clearly says that X and not Y despite the fact Y is the currently trendy reading of Locke and X has been dismissed out of hand. But clearly this is wrong because A, B, C articles in the secondary literature you are challenging assert Y and dismiss X. Reject.
Posted by: SD | 05/30/2021 at 09:11 AM
Reviewer: Excellent paper - by all means accept!
Editor: Reject.
Reviewer: I don't have any philosophical complaints about this paper. However, I use how much has been published on a topic as a measure for how interesting the topic is. Not much has been published on this topic yet. So this paper isn't interesting enough to be published. But a word of encouragement to the author: perhaps other people will publish on the topic and your paper will thereby become worthy of publication!
Reviewer: I'm of course aware that this journal has a strict word limit and that the paper is currently right at that limit. Still, I'd like the paper more if it raised and replied to variations of objections it already considers. R&R. Oh, and here's a list of ten obscure works that could be cited. The author might be wondering which of the works on the list are by yours truly and whether my evaluation of the revised manuscript will be sensitive to whether it cites those works. These questions are best passed over in silence. Maybe the author can just cite everything on the list if they're worried about this? Best of luck respecting the word limit!
Reviewer: Your argument is subject to two objections. While I am writing this report after not having looked at the paper for weeks, as far as I can tell these are objections that I came up with on my own and there is no way to reply to them. We can safely assume that I did not learn of these objections by reading them, along with the detailed replies to them, in the paper's objections and replies section. Reject.
Posted by: another postdoc | 05/30/2021 at 10:02 AM
Reviewer #1: This paper is amazing and fantastic and I wish I'd been wearing diapers when I read it, cuz I pooped my pants. Accept as is!
Reviewer #2: This paper is boring and I don't like the topic. Reject.
Editor: Um, ok. R&R.
Posted by: historygrrrl | 05/30/2021 at 08:06 PM
You argue that premise 1 of previously published argument X is false. But I say that premise 2 of argument X is also false, and therefore your result is irrelevant. Reject.
Variant: You argue that premise 1 of previously published argument X is false. But I say that premise 2 of argument X is also false, and because you do not discuss premise 2 you think it is true. Therefore you are wrong. Reject.
Posted by: Sebastian Lutz | 06/04/2021 at 12:44 PM