Our books






Become a Fan

« Notes from both sides of the market - part 6: interpreting interview results | Main | Notes from both sides of the market, part 7: standing out for teaching jobs »

06/07/2017

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Amanda

Some of my bad reviews I've received I would have been happy to have gotten 4-5 sentences. Instead I got 1-2 very mean-spirited sentences!

I do think there was a couple of reviews I have given that I did not make enough of an effort to be positive and helpful. What a lot of reviewers should think about is often just stating the facts (which, naturally, are often critical) can come across as very rude. I think many reviewers don't put enough thought into things like that. Writing a good and helpful review takes effort, but I think we have moral obligation to do so.

Marcus I have heard you tell the story about your 78-page paper a number of times, and to be honest I would have said the same thing as the reviewer. (Even though, I like to consider myself nicer and more generous than the average reviewer.)

What doesn't seem to cross your mind is that long papers can be bad not for any scholarly or philosophical reasons, but for human and practical reasons. Many people simply do not have the time, patience, or motivation to read a 78 page paper, no matter how wonderful it might be. I think since you are the sort of person who works like a maniac (given your descriptions of how much work you put into your students) perhaps you don't take into account the average philosopher's perspective. I admire how much you work, but I don't think it's morally necessary to do what you do. And I do think as philosophers we should try to consider how best to have a conversation with other philosophers. Other philosophers are persons with lives and work and personal limitations. That is why I try to write short papers: I want to have actual conversations with people, and I know they won't read my work if it is too long. Anyway I have thought this for a while so I thought I would share my perspective.

Chris Stephens

I've never received a bad review - at least not in the sense that the comments were mean and hostile. But I have received very short reports - just a few sentences - but I don't consider those bad. Sometimes they say "the paper is mostly secondary, responding to X or and doesn't develop much of their own positive view - it merely criticizes X." or "it seems pretty similar to Y's view" and I think "that sounds right". I don't think it is the referees job to necessarily provide detailed comments. All I want is some reason why it wasn't published - "Not original enough" or "not in the scope of this journal" or whatever, is good enough for me. I send it somewhere else, or revise it.

I have received reports where I thought the author didn't understand my point -but I've always thought: I could've been clearer, and so I revise. I've been lucky never to have received a truly incompetent report (e.g., where the referee didn't appear to read the paper). Maybe it helps that I don't work in really contentious areas like ethics or political philosophy.

Have I written any bad reviews? I'm careful not to be mean - I do sometimes write short reports of only a few sentences, so I guess by Marcus' account those count as bad.

One manuscript I was asked to referee cited only two papers. There was a sizable literature on the topic (30-40 papers at least). So I wrote a very short report, along the lines of "This paper only cites 2 references, and the point the author makes seems to be made elsewhere, in X, which the author doesn't cite." Am I really required to write a detailed reply in such cases? Of course, I suppose I could've written a long reply about whether what the author said is exactly the same as what X says - but when the author hasn't done their homework - they don't tell me how/why their contribution is original by situating it in the literature - is it really the referee's job to do that? (I was tempted to add something snarky like "was this written by a student?" but it was more likely written by someone outside the area or outside philosophy or academia altogether). I resist all such temptations to be insulting once I submit the report.

I also wrote a slightly grumpy report when asked to referee a 20,000 word paper. I provided 5 or 6 pages of comments, but the main problem (unlike Marcus' long paper) is that this one rambled and could easily have been half the length.

Now that I get asked to referee a lot more (compared to early in my career), I tend to write shorter reports, but I'm also more generous with what counts as publication worthy. I probably recommend half of the papers I referee for publication. I don't reject it because I think it has a problem or flaw; instead, I ask myself: is it comparable to the average paper published in this journal? is it original? (I tend to think many journal articles have flaws, so...) If yes, I usually recommend it for publication and tell the editor that (along with whatever other comments I have).
But I have no idea whether I'm getting a random sample of papers (are many desk rejected?)

So I don't mind short reports. The only thing I mind is if the journal takes a long time to get back to me.

Shay Allen Logan

I suppose I should give my two cents since Marcus took the time to post my question (thanks, btw!).

I've definitely received bad reviews. I've also definitely mistaken ok reviews for bad reviews by misunderstanding the reviewer. The worst review I've ever gotten went something along the lines of "When I saw extremely common word W in the title of the paper, I assumed it meant X from obscure field Y unrelated to the declared subject of the paper. But if W means X then the paper doesn't make sense. In particular the definition of W given on page 2 is wrong, because it doesn't define W to mean X. And if W does mean X, as I assumed it did after reading only title, then saying W means something else is wrong. So the paper should be rejected."

Luckily in that case, the editor intervened. (She basically said something like "Erm... no," but in an official and intelligent-sounding way.)

I guess I asked the question because I assume that (a) I'm roughly an average reviewer and (b) the people who have reviewed my papers are (on average) average, so (c) I'm probably (proportionally) giving out as many awful reviews as I get. I'd like to not be doing that. But of course this requires knowing how to identify awfulness in the reviews I write, which seems hard...

Striped shirt

I get asked to referee a lot (15-20 papers a year). I used to do about 15 a year, now, though, because of other work demands, I only referee about 8 or 10 papers per year. I decline whenever the paper is long. In fact, I even ask editors when they invite me to referee how long the paper is. Anything over 9000 words I generally say no. I once refereed a paper that was 37,000 words. I was so angry because so much of it was unnecessary, and this is almost half a short book. That is not what I agreed to when I said I would referee for a journal.
Also, I am now more choosy about the topic. I used to be willing to referee more broadly, but because of these other constraints, I now focus more narrowly on stuff related to topics in which I am well versed.

Marcus Arvan

Striped shirt: 37,000 words!? That's like 140 double-spaced pages. I mean, I know I sent out a 78-page paper myself (which I would review too, though I know it's pushing it)...but 140 pages? I'm surprised you didn't refuse. Surely the line has to be drawn somewhere. ;P

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been saved. Comments are moderated and will not appear until approved by the author. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment

Comments are moderated, and will not appear until the author has approved them.

Your Information

(Name and email address are required. Email address will not be displayed with the comment.)

Open job-market threads