In our newest "how can we help you?" thread, a reader writes:
I am a junior faculty member and started to receive referee requests. I am curious about people's criteria for recommendations (acceptance, minor revision, major revision, and rejection, among others).
In addition to any general thoughts, I am particularly interested in hearing your thoughts on the following two questions. First, do you take the "quality" of a journal into consideration? For example, is it reasonable to think, "this paper is not good enough for Phil Review or PPR, but for this journal, sure, it should be accepted"? I feel that this sounds pretty normal, but I also know that people do not like journal rankings. If the quality of a journal should be considered, what is your standard? Do you implicitly or explicitly follow a specific ranking such as the survey by Leiter?
Second, is there a principle that you follow when you make your recommendations? To be honest, the rejections that I received usually raised some objections to my arguments. Is it a good principle that if you can find an objection to the author's main argument, then you should (probably) reject the paper? Do you recommend direct acceptance only when you cannot find a good objection? Thank you!
Good questions! Another reader submitted the following reply:
[E]veryone follows different criteria for their verdict. But I often take the quality of the journal into account while deciding whether my comments and feedback mean accept/r&r/reject. This is not because of the quality of the paper, but because of the ratio of space available in those journals to the volume of submissions. This naturally implies a higher level of selectivity than perhaps otherwise merited. Re. how I evaluate my accept/r&r/reject verdicts: I do not take any objection to an argument to be a reason to reject a paper. A straightforward rejection usually takes me to believe that no small amount of work could salvage a novel, interesting and close-to-being-sound argument/idea from the paper. Sometimes this is an objection to the main claim of the paper and sometimes it is about how well-formulated the claim and the case for the claim in the paper are. If the paper is well-structured and interesting, but you have a prominent objection to one of the main parts of the paper, I think it usually worth giving the author to revise the paper and after the revision, if the problem is still there, then reject it (the caveats about journal rankings apply here as well).
And one other reader wrote in:
(1) I usually only really consider originality and specialisation in this. So, if I review something for the British Journal for Philosophy of Science, I recognise they are looking for groundbreaking work and am hesitant to recommend a decent and correct but not very novel paper. Or, if I review for Foundations of Physics I realise that they are more open to somewhat technical stuff than, say, Synthese. But I wouldn't otherwise make a difference in 'quality'. (2) I definitely don't think only papers without any potential objections to them deserve acceptance. The distinction I try to make is: is this an objection that should really be addressed in the paper, or is it an objection that could itself form a significant part of the literature? If it's the former, then I would urge a revision, or in some cases a rejection. If it's the latter, I am happy to accept the paper - the fact that someone else can object to it in a way that is itself of interest only proves that the paper under review pushes the literature forward in some way!
What about the rest of you? Which criteria do you use as a journal referee? And do you tailor your standards to different journal types or rankings?
Recent Comments