In our October "how can we help you?" thread, a reader asks
How are publications in invite-only journals (like Phil Issues and Phil Topics) viewed? These journals often perform very badly in journal rankings (i.e. the Leiter polls), but I have the impression that those polls might be significantly understating the reputation of these journals. Is that right?
Good question. I have to confess that I'm not certain, but I suspect that people might consider papers in these journals primarily on a case-by-case basis (i.e. "you have to read the paper" to know how good it is). Frankly, I think this is probably the best way to evaluate a paper in any journal, but for all that, I suspect that people are more inclined to actually think this way for papers in journals like these (whereas there may be a greater tendency to evaluate papers in other journals by how prestigious the venue is).
But this is really just me speculating. What do you all think? It would be great to hear from everyone, but particularly from people who have served on hiring or tenure-and-promotion committees!
I wouldn't say they perform very badly in the rankings. They're not at the top, sure, but the 20-25 range for the generalist journals is still quite good. I, for one, regularly read great work in The Monist, Thought, and Ratio.
For my part, I view publications in invite-only venues as equivalent to other invited publications--which is to say, a step below an unsolicited peer-reviewed publication, but above other kinds of work. I don't think any journal should work this way. I suspect my view is not at all common, however.
For the same reason, I also have a relatively dim view of the Oxford Studies... volumes which are tied to workshops/conferences, although I know that they're widely regarded as top specialist venues. (Meaning that I'm usually more impressed by a publication elsewhere, although having said that, if I had a research hat on then I'd also want to see a specialist publishing there in addition to elsewhere.) So: that should be a clear indication that my view is kind of idiosyncratic. But I'm sticking to it.
Posted by: Michel | 11/01/2022 at 01:22 PM
One reason why invited-only submissions may not be seen positively is because they either bypass the anonymous peer review process or they are solicited through social networks (e.g. your advisor reaching out to you to write a chapter for one of the thematic volumes for an invite-only journal). So these articles lack the few barely functional egalitarian processes in our profession.
Posted by: Grad student | 11/01/2022 at 04:08 PM
It depends. I think those publications are viewed very differently in different contexts, such as research-oriented programs, teaching-oriented programs, and the job market. For example, my department only has an undergraduate program and is teaching-oriented. For tenure and promotion, we mostly care about whether the publications are peer reviewed (blind or not). So, publications in invite-only journals will not be viewed differently if there is a reviewing process, by the editor(s) or reviewers.
Posted by: G | 11/02/2022 at 08:33 AM
For what it's worth, I share the op's impression that Leiter's rankings understate the reputation of these journals, or at least the Nous supplements--Phil Issues and Phil Perspectives. (Which isn't to argue with Michel and Grad student about whether they deserve their reputations.) Publications in these journals are very clear indicators that you are in the in-crowd--which can be especially important in the absence of other such indicators (e.g. if you come from a less-than-Leiterrific PhD program, or have a less-than-famous advisor). In my experience, these signals do really give job applicants a leg up (relative to what's signaled by a publication in Synthese or Phil Studies, say).
One guess about why they may be underranked: being annual supplements, they don't publish nearly as many articles as other prestigious-but-not-tippy-top journals, even (most) quarterly ones. So, many fewer people have published in them. And people are very likely to favor the journals they've published in when filling out Leiter's polls.
Posted by: grymes | 11/03/2022 at 11:45 AM