Our books






Become a Fan

« There's another way | Main | Interesting! »

03/26/2014

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

eyeyethink

YES! I especially like your third and fourth bullet points. I'd suggest that you and I start a journal, if I thought anyone would take it seriously. (Two non-TT editors? WTF?)

I see the intent behind your second bullet, but isn't the answer always going to be 'yes'? Perhaps you mean to ask: "will the paper appeal only to those who accept mainstream intuitions?"

Matt DeStefano

Thanks for this post, Marcus, it's really interesting. I have some reservations about the bullet points. The third and fourth points seem to ask too much of any referee. When an editor queries for referees, I take it that they are asking for the referee's opinion about a piece. It would be a mistake, I think, to have those referees try to guess what philosophers with very different backgrounds or in very different areas might or might not find plausible about a given argument. Is it possible for a person to reliably predict what those with very different backgrounds will or will not find plausible? I'm skeptical.

If I were asked a question like this as a referee, I would be afraid that I would do more harm than good. Either by being too permissive and encouraging an editor to accept a bad paper ("I think this is completely implausible, but maybe some other philosophers may find it plausible"), or by thinking that those from different backgrounds would share my own notions of plausibility.

I don't know that I have a good alternative in mind (other than by pulling referees from very different backgrounds in the first place), but I thought I would share my concerns.

Elisa Freschi

Marcus, this is a very interesting post. Accordingly, the following ones are just suggestions:
As for me, when I review/ask someone to review an article, I try to check the "objective" soundness of the article first, i.e.,

—whether the overall structure of the article holds (no articles with no sections, or which repeat the same points again and again, or say that X without having shown why…)

—whether the author knows the literature on the topic s/he is dealing with. This is consistent with my general idea that one should read more (and also, I believe, with some posts of you, e.g.: http://philosopherscocoon.typepad.com/blog/2013/12/things-i-think-ive-learned-thing3-read-widely.html and, more relevantly: http://philosopherscocoon.typepad.com/blog/2014/02/on-citation-practices-in-philosophy.html). More in general, I mistrust authors who think they can come out with fantastic new theories and do not need to bother about reading anyone else's work.

I know, these are not completely "objective" criteria (as is evident from the fact that the lack of a quotation of X will be evalued very differently if you happen to be X!), but they still seem to me to be better than "Did you like the article?". Hopefully, they will force the reviewer to re-focus while reading the article.

This being said, I agree with most of your points.

Moti Mizrahi

Hi Marcus,

I like your proposal overall. But I have some doubts about the last bullet-point:

"Will this paper be remembered in five years as making a major contribution to the debate, or does it merely make a "small point"?"

First, as we discussed on the Cocoon before, it is difficult to distinguish between "small" and "big" points. For instance, one might think that Gettier’s point was "small" (after all, it’s just a counterexample against JTB), but this "small" point has had a great impact on epistemology. (Whether the impact was positive or negative is a different question.)

Second, what counts as a "major"—as opposed to a "minor" or "significant"—contribution to a debate?

Finally, I think that the "remembered in five years" condition sets a very high bar for publication. Many papers in philosophy "fall still-born from the press" (i.e., they’re not cited or even read), but that doesn’t necessarily mean that they are not worthy of publication. Maybe philosophers just don’t read widely enough. :)

Marcus Arvan

eyeyethink: I think we'd run a rad journal. :) But maybe the Journal of the American Philosophical Association got there first? (http://journals.cambridge.org/images/fileUpload/documents/J-APA_Editorial_Statement.pdf ) I guess we'll have to wait and see!

Matt: thanks for your comment. I understand the worry, but *I* don't think it asks too much. I read papers all the time where I think to myself, "I'm not sure if I buy these premises, but I expect there are people out there who *may* -- and the paper is interesting!" I think this kind of openmindedness is good, and I think too many reviewers (e.g. those who prioritize rigor above *all* else) seem to lack it. Moreover, I think one can recognize things that are likely to be attractive to people from other backgrounds and perspectives. When, for instance, I read Charles Mills -- who argues that traditional political philosophy, by all but ignoring race, ignores the reality that non-whites face (racial domination) -- I can recognize that although some traditionalists may not find the argument attractive, there may be a lot of people who will. And this isn't just an isolated case. Authors who come from different backgrounds and argue for different premises often make it *explicit* that they are trying to challenge the status quo from another vantage point. I don't think it takes a rocket scientist to pick up on it. What is *does* take is openmindedness to agree not to reject it simply because it "doesn't engage with the mainstream literature."

Look, to be sure, there is the possibility of a type 1 error (accepting a crappy paper). But, I say, current standards give rise to too many type-2 errors (rejecting *good* papers simply because the reviewer "finds it counterintuitive"). A good editorial process, I want to say -- just like a good judicial process -- has to strike the right balance between the two. And I think things right now have gone *way* too far in the conservative direction. Personally, I'd rather read a few more interesting-but-flawed papers than boring, unimaginative, but "rigorous" papers. Again, this may just be me, but others have complained about it too (and indeed, the new Journal of the American Philosophical Association recognizes it as a problem!).

Elisa: thanks for your comment. My reply is: absolutely! I was not suggesting that my bullet-pointed questions take the *place* of other questions (viz. "Is the paper clear?", "Is it coherent?", etc.). We have every reason to want those "objective" standards! My claim was merely that they should be supplemented with questions prompting reviewers to consider and judge the paper along other dimensions as well.

Marcus Arvan

Hi Moti: thanks for your comment. I take your point well. It's not obvious how to construe a "small" point vs. a "large" point. In one sense, Gettier's point was a small one, in another sense a large one.

I guess I would gloss the relevant distinction in terms of how much "conventional wisdom" the point overthrows. Yes, Gettier's paper was two pages long, but it essentially (in the eyes of many) refuted a conception of knowledge (knowledge=justified true belief) that had been taken more or less as given in Western philosophy ever since Plato. That's a pretty large point!

At any rate, that's how I think we should understand the distinction here. The more a paper buys into conventional wisdom, the "smaller" its point in the relevant sense. The more deeply it (successfully) challenges conventional wisdom, the "bigger" its point.

Finally, point taken on the "will this paper be remembered in 5 years" question. Perhaps it should be: "In your judgment, *should* this paper be remembered in 5 years?" That might deal with the problem of papers falling stillborn from the presses. Even if a paper *isn't* remembered in 5 years, it might be good for a reviewer to reflect on whether, in their judgment, it is the sort of thing that should be remembered.

Giulia

Thank you for the challenging post. I'm too young to be an experienced author or referee, but these points are definitely worth considering for the future. Not only editors (who can explicitly state such aims in the journal review practice rules) but also referees as individuals and the scientific community can and should think about the issues Marcus and and commentators raised.

I only have some problems with this guiding question:
Can this paper be expected to appeal primarily to a crowd sharing certain intuitions, but not appeal to people not sharing those intuitions?

Onestly, I don't think that being appealing in that sense is a crucial factor for the quality of a paper. I appreciate that we usually do evaluate a paper and its arguments also with respect to intuitions, but often a paper is strikingly good and philosophically interesting even if it is very counter-intuitive (whatever that may mean) and its thesis is prima facie paradoxical: many genuine contribution to philosophical debates were precisely like that, I dare say.
In point of fact, it's not even so important that the paper appeals to a minority sharing certain intuitions. While it's certainly desirable that the paper makes a novel point, and that a journal makes an effort to include non-mainstream approaches to a problem, the conformity to intuitions is not a reliable indicator of a paper's quality. A good philosopher should be able to defend her theory in a way that accounts for our intuitions (IF - a big if - there are such things), but it is not necessary to apparently agree with anyone's pre-theoretical intuitions, no matter if the intuitions at stake are commonsense, mainstream, or a minority's.

But I'm open to clarifications!

Ruth Groff

I love this post. I think that it is absolutely practical. I already review that way.

John Jones

As a post-graduate I gave a solution to the Analytic/Continental split, posing it as an organizational, and not a conceptual divide. This was radically different from the mainstream view, a view that was represented, in my case, by professor Christopher Norris. The professor did not discuss the ideas with me, deeming it sufficient to give my work a bare pass, even though the ideas were critically relevant to his own work. Naturally, I could say nothing for fear of compromising my academic ambitions. The rot starts well before the journal.

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been saved. Comments are moderated and will not appear until approved by the author. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment

Comments are moderated, and will not appear until the author has approved them.

Your Information

(Name and email address are required. Email address will not be displayed with the comment.)

Open job-market threads

Categories