Drop-In Discussion on Refereeing and Publishing Norms & XPhi

Joe Ulatowski (University of Waikato) has drawn my attention to this interesting looking drop-in Zoom session, to be held on September 17th, 2020 at 5:00PM EDT. A quick description:

At a recent XPhi Under Quarantine, participants discussed the possibility of drafting a public statement concerning norms for journals on publishing non-xphi articles that were about xphi, but that didn’t contain any studies.  So, e.g., someone wants to float a hypothesis about what philosophical expertise could consist in but has no data to back up the claim that philosophers actually work that way. Or a paper that sketches an idea for a study, but doesn’t actually do the study it sketches. Or if a non-x-phi paper involves an out-there kind of vignette, can one reasonably ask of an author to go run a study on it? 

Because participants had an interest in talking over these issues, we have decided to host a special edition of X-Phi Under Quarantine. We will host a drop-in discussion session to consider not just the questions outlined above but any such question concerning refereeing norms or publishing norms that affect work in xphi. We ask participants to be prepared to talk about the following questions:

• • What are the norms of refereeing papers in experimental philosophy?
  • Do these norms follow the strict norms of general philosophy journals? If they are different, how so?
  • Is it sufficient for a referee to recommend a paper be rejected because they just don’t believe the data?
  • How much should data & methods be reported on exactly the model of a social science journal, when it is being published in a philosophy journal, especially a general one? (I.e., not Mind & Language, where one can perhaps presume a certain comfort level with such things on the part of the audience)
  • Should general philosophy journals even be publishing methodologically ambitious x-phi? Do they have the refereeing and editorial bench to do it well? one thing we could look to do is make up some sort of database of x-phi-comfortable philosophers and scientists who are willing to serve as referees for such work.
  • Pre-registration? Making data publicly available? Other anti-QRP practices that should be made more widespread?
  • Publishing studies that are adequate empirically but don’t really have anything new to say philosophically? Should null results be published? Should replications be published?

This seems great, and it also drew my attention to the New XPhi Blog, which I wasn't aware of!