In a recent issue of the Communications of the ACM, Moshe Vardi discusses the pros and cons of journal archival publications versus conference contributions. The upshot of his statement, which points to two recent contributions to the viewpoint columns of the journal [1], [2] is that perhaps it is time for Computer Scientists to shift emphasis away from conference and workshop contributions, and start publishing in journal as all other sciences do. A lively discussion followed, see among others, the opinion piece of Lance Fortnow.
As an editor myself of Genetic Programming and Evolvable Machines I have always wondered why it would be more attractive for people in our discipline to publish in conference venues than in archival journals. Are there not enough journals to allow for scientific progress? Or is there a dire need to communicate with colleagues in spatial co-location? Well, to my mind, none of the two! We are not the types of people that wanted to discuss our results to extreme length. Our conferences and workshops usually operate under tight time constraints, and one to three questions is about the average a presenter receives, anything else would eat into the next presenter’s time and is discouraged. Also, the number of journals now accepting work from our field has grown over the years to a very reasonable number so that there is no shortage of places where quality work could find a home.
What is it then, that makes us submit and publish so much at conferences? Possible explanations are the existence of deadlines and the incremental nature of much of the work published. The existence of deadlines is a valuable selection pressure in our hectic times where everything is under the dictate of time-driven priorities. It can only be mimicked by journals through the introduction of regular “special issues” which also come with this requirement, and usually are successful in attracting work. As for the second possible explanation, I’d like to cite from [1] on the pitfalls of program committee work: “And arguably it is the more innovative papers that suffer because they are time consuming to read and understand, so they are the most likely to be either completely misunderstood or underappreciated by an increasingly error-prone process.” So while innovative work has a harder time at conferences, “our culture creates more units to review with a lower density of new ideas.” It is not only that we get to review smaller pieces of work, we are also more busy, with all the workshops and conferences that make us look at these papers. “Genuinely innovative papers that have issues, but could have been conditionally accepted, are all too often rejected in this climate of negativism. So the less ambitious, but well-executed work trumps what could have been the more exciting result.” Those would have to be revised and revised and revised again, and there is no time to do this for conferences. Journal articles, on the other hand, can be worked on for a long time, if need be, and there is no time pressure except for the fact that delays could be unbearable and make results obsolete.
In the end, however, it is the impact of the work that counts most. And it is my experience that a carefully edited journal paper is worth the effort, as it produces impact on a scale that conference papers have diffulty to achieve.
[1] K. Birman and F.B. Schneider. Comm. ACM, 52(5) 2009, p. 34
[2] J. Crowcroft, S. Keshav, and N. McKeown, Comm. ACM, 52(1) 2009, p. 27
