Our books






Become a Fan

« Graduate student query on confidence | Main | Does philosophy need to be less purified, or more? »

01/11/2016

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Eugene

Nice post, Marcus.

I agree that 4-6 are unhelpful comments to receive, but 1-3 seem fine to me.

"1. The reviewer claimed that my paper contains no clear expression of its thesis statement. The thesis statement was in fact clearly stated near the end of the first paragraph on page 2 of the manuscript in the last few sentences of the introduction. In my experience, the default position of the thesis statement is the end of the introduction, so this criticism was baffling."

This is baffling? The lesson here is that in addition to including a thesis at the end of the introduction, include it again (and perhaps again and again), elsewhere.

"2. The reviewer claimed that there was an obvious response to argument A and that argument A should thus be rejected. While I agreed with the reviewer, my paper acknowledged that fact and rejected argument A in the second half of the relevant section. The section was actually a defense of argument B, which builds on the rejection of argument A. It’s a safe bet that the reviewer did not read this section of the paper in its entirety."

The lesson I would take from such a comment is that it would be useful to readers to remind them, perhaps in a footnote, why the "obvious response" is a bad or irrelevant one.

"3. The reviewer claimed that I had misinterpreted the views of Philosopher X. I had sent Philosopher X a copy of my manuscript in advance of submitting it to the journal, and he acknowledged that my presentation of his views was accurate. So either the reviewer knew Philosopher X’s work better than Philosopher X himself or this criticism was misguided. I suspect the latter."

Sure, but Philosopher X might not themselves present their views in a way where people can easily pin them down, so in a way it doesn't matter whether X thinks your interpretation is accurate. Lesson? Include a footnote to the effect that "it might be tempting to interpret X this way, but...".

All of these lessons seem to me to fall out of a moral general injunction to minimize cognitive demand on one's readers. It's often difficult to remember complex philosophical claims, and readers shouldn't have to scroll back to page two to recall them.

Eugene

Sorry, I got ahead of myself and meant to say nice post Trevor, not Marcus.

Marcus Arvan

Hi Trevor: Thanks for the great post!

I think, as Eugene's comment suggests, your post is useful for two things:

(1) Drawing attention to some common reviewer errors.

(2) Understanding how to "play the publishing game" better.

My experience as an early-career philosopher learning the publishing ropes is that it is *really* important to link these things together. Allow me to explain.

Early in my career, when I was having trouble publishing, I too was similarly perturbed by what I took to be unhelpful/mistaken reviewer comments. However, I also learned that there were certain *patterns* to how reviewers read papers, and that if one wants to publish successfully, one must anticipate and head off reviewer misreadings (the point of Eugene's comment!).

One general thing I've learned--which seems supported by the unhelpful tendencies you report experiencing--is that one must be *really* clear to reviewers, so as to head off misunderstanding. Among other things, one needs to:

(A) Make one's thesis as clear as possible.
(B) Say very clearly, and up front, how the thesis adds something of value to the literature.
(C) Head off potential reviewer concerns very early in the paper, before they have any chance to arise/bother the reviewer.

These are just a few things, but again, I found they were very important lessons to learn from reviewer responses. For instance, one of my now-published papers bounced around journals for years, despite the fact that I thought it dealt well with most of the objections reviewers raised. Then I had one reviewer tell me, "You dealt with objection X really well, but it came too late in the paper, and I had been worrying about the objection the whole time I was reading."

In short, I suspect that the more experience you have with "unhelpful reviewers", the more you'll learn how to anticipate their "unhelpful" tendencies, and actually, as an author, help *them* avoid their unhelpful tendencies. This, at any rate, has been my experience!

Trevor Hedberg

Hi, Eugene. Thanks for your comments. You may be right about #3, at least in some cases. That particular instance is too far in the past for me to know whether that's a reasonable interpretation of what happened. I'm more skeptical about your claims about #1 and #2, though.

Regarding #1, the thesis was stated at other places in the paper, and since the paper was accepted (pending minor revisions) at a journal of comparable quality shortly thereafter (with virtually no changes made to the manuscript), I'm inclined to think that the reviewer wasn't reading the paper closely.

As for #2, the problem is that the reviewer claimed that I was endorsing argument A when a central point of the section was to reject argument A. Given that the relevant section was fairly short (about 800 words) and that this point was not made in a convoluted or mysterious way, I couldn't see how a reviewer could come to that judgment without either not reading the entire section or not reading the section carefully.

My broader concern is that we teach our undergraduates to interpret philosophers charitably and to try to understand their arguments as well as we can given what the authors have said but appear to frequently fail to meet that standard in peer reviews of other philosophers' work. While I agree with the general injunction that you mention (i.e., to reduce the cognitive demands on the reader), I don't think all cases akin to what I've described are attributable to a failure on the author's part to meet that standard.

Trevor Hedberg

Hi, Marcus. I agree with your (A)-(C) list and have heard similar advice from other sources. I imagine that one does get better at preemptively addressing reviewer concerns as one gains experience. Simultaneously, even the most productive and successful philosophers I know encounter unhelpful reviewer comments with some regularity. In those cases, they know the ins-and-outs of publishing as well as most anyone does, so it's definitely reasonable for us to strive to do a little better as peer reviewers than we are in the status quo.

Marcus Arvan

Hi Trevor: I totally agree! Like most people, I still get reviewer comments that drive me batty--and we very much should encourage helpfulness among reviewers. I think your post is very...helpful (pun intended) in this regard. I merely meant to point out that, at the same time, paying attention to common forms of reviewer feedback, even the unhelpful type, can help one improve as an author, helping one recognize that there are certain types of errors that readers are apt to make, errors that one can develop authorial strategies to avoid!

postdoc

Part of the problem with the review process is that the hyper competitiveness of the discipline is forcing everyone, including MA students to submit papers to journals. There just are not enough quality philosophers to review all of this work. So, journals resort to lower and lower quality referees. I have gotten many reports from referees who were clearly incompetent. (I am not saying this out of spite. I have been successful at publishing in top journals.)

Scott Forschler

I have received a number of very helpful comments from reviewers over the years, some of which led to revision, others leading me to at least temporarily abandon the article. I have been also been astounded by the gross stupidity of some reviewers. Recently the chief editor at a major journal told me there had been too much published on the topic of my article recently, when my own literature review concluded that there was almost nothing published on that precise topic, ever. When I asked for an example, the editor gave one example--which was actually only an only marginally-related topic, and published 50 years ago! Off to the next journal, then. And several times I've gotten comments which reveal that the reviewer only skimmed the article and misunderstood it in elementary ways, sometimes even accusing me of making incorrect assumptions when the falsity of those assumptions was, rather, the precise basis of my criticism of other authors!

These experiences are apparently legion. I highly recommend Mark Twain's own amusing experiences on this issue, related in his delightful story here. http://www.twainquotes.com/Galaxy/187007a.html

Scott Forschler

How can I find journals who could benefit from additional book or article ms reviewers? I have more free time than most philosophers and my usual turn-around time for review requests is 1 week for books, 1 day for journal articles. I would love to do more--hook me up!

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been saved. Comments are moderated and will not appear until approved by the author. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment

Comments are moderated, and will not appear until the author has approved them.

Your Information

(Name and email address are required. Email address will not be displayed with the comment.)

Subscribe to the Cocoon

Job-market reporting thread

Current Job-Market Discussion Thread

Philosophers in Industry Directory

Categories

Subscribe to the Cocoon