An assessment of this Ninth SOSP Submissions -or- How (and exactly how perhaps maybe perhaps Not) to create a great systems Paper

Roy Levin and David D. Redell, Ninth SOSP Program Committee Co-chairmen

Introduction

On March 21, 1983, this program committee for the symposium that is 9th running System Principles, having see the eighty-three documents submitted, chosen sixteen for presentation during the symposium. This acceptance ratio of approximately one in five approximates those of previous SOSPs, even though quantity of submissions had been notably less than in the past few years. A few people of this program committee discovered it interestingly an easy task to split up the good documents from the bad people; certainly, the ten committee users quickly write my papers for me agreed upon the disposition of over 80% for the documents. Because the acceptance ratio suggests, many of these were rejections.

Following the committee had finished its selectio n process, a few users indicated dissatisfaction into the general quality associated with the submissions. Most of the refused documents exhibited comparable weaknesses, weaknesses that the committee felt need to have been obvious towards the writers. Within the hope of increasing the standard of future SOSP submissions, and systems papers generally speaking, the committee made a decision to explain the requirements found in assessing the documents it received. This informative article combines the requirements employed by every one of the people in the committee, not only the writers.

To try and avoid sounding preachy or pedagogic, we’ve cast this presentation in the 1st and 2nd individual and adopted a light, periodically funny design. Nevertheless, the intent is severe: to indicate the problems that are common look over and over repeatedly in technical documents in a fashion that can make it easier for future writers to prevent them. While you look at this article, then, assume you to ultimately be described as a potential writer when it comes to tenth SOSP or for TOCS. You have done some ongoing work you may like to publish, so that you sit back to create a paper. Exactly What questions for anyone who is thinking about as you compose? They are additionally the relevant concerns that individuals, the reviewers of the paper, would be asking to find out its suitability for publication.

Classes of documents

Your paper will probably fall obviously into certainly one of three groups:

• It presents a system that is real either by a worldwide study of a whole system or by a selective study of specific themes embodied in the machine.
• It presents something this is certainly unimplemented but uses ideas or methods which you have the technical community should know.
• It addresses an interest when you look at the areas that are theoretical as an example, performance modelling or protection verification.

Demonstrably, a set that is single of requirements can’t be used uniformly across these groups; however, many requirements use similarly well to all or any three. Even as we describe each one below, we shall attempt to stress the classes of documents to which it is applicable. Frequently it will be obvious from context.

Requirements for Evaluation of Submissions

Original Tips

Will be the a few ideas within the paper brand new? there is absolutely no point in publishing a paper to a meeting or journal worried about initial work unless the paper contains a minumum of one brand new concept.

How can you understand? You really must be acquainted with their state regarding the art and research that is current the region included in your paper so that you can realize that your projects is initial. Possibly the many failing that is common the submissions in the 1st category (genuine systems) had been a lack of the latest some ideas; the systems described were usually isomorphic to at least one of only a few pioneering systems well-documented within the literary works.

Is it possible to state the brand new concept concisely? Should your paper is always to advance their state of real information, your audience needs to be capable of finding the brand new a few ideas and realize them. Decide to try composing each concept down in a paragraph that some body generally speaking versed into the area that is relevant comprehend. That you don’t really understand the idea yourself if you can’t, consider the possibility. When you’ve got the paragraphs, utilize them when you look at the abstract for the paper.

What is the issue being resolved? Your reader can’t be anticipated to imagine the issue you encountered provided just a description for the solution. Be particular. Make sure to explain why your problem could not just be solved aswell by formerly posted practices.

Will be the some ideas significant adequate to justify a paper? Often, papers explaining real systems have 1 or 2 little improvements of founded methods. The latest idea(s) could be described in a couple of paragraphs; a twenty-page paper is unneeded and frequently obscures the real innovation. Since construction of an actual system will be a lot of work, the writer for the paper often unconsciously confuses the sum total work with all the work this is certainly really brand new. (“My group labored on this method for 2 years and now we’re finally done. Let us inform the global globe exactly just exactly how wonderful it really is.”) In the event that innovation is little, a tiny paper or technical note in the right log is much appropriate than an SOSP submission.

May be the ongoing work described notably different from current related work? a apparent expansion to a formerly posted algorithm, method, or system, will not generally justify publication. Needless to say, the label “obvious” must certanly be used very very very carefully. ( recall the tale of Columbus sjust howing steps to make an egg get up at a time (by carefully crushing it): “it’s apparent once i have shown you how”.) you need to show that your particular work represents a departure that is significant their state regarding the art. You should ask yourself why you are writing the paper and why anyone except your mother should want to read it if you can’t.

Is all related work referenced, and also have you actually see the cited material? You’ll have trouble persuading the skeptical audience for the originality of the efforts until you especially differentiate it from formerly posted work. This involves citation. Also, you will discover it harder to persuade your reader of this superiority of one’s approach you haven’t if he has read the cited works and.

Are evaluations with past work explicit and clear? You can’t simply state: “Our approach varies notably from that used within the BagOfBits system 3.” Be certain: ” Our memory that is virtual management makes use of magnetic news as opposed to punched paper tape such as the BagOfBits system 3, because of the expected improvements in transfer rate and janitorial expenses.”

Does the job comprise an extension that is significant validation, or repudiation of earlier in the day but unverified tips? Execution experiences supporting or contradicting a formerly posted paper design are incredibly valuable and candidates that are worthy book. Designs are inexpensive, but implementations (specially those predicated on unsound designs) are costly.

What’s the earliest paper you referenced? The latest? Have actually you referenced work that is similar another organization? Have actually you referenced technical reports, unpublished memoranda, individual communications? The responses to those concerns help alert you to definitely blind spots in your understanding or understanding. Often, papers with just references that are venerable recently published work of that the writer is unaware. Papers with just current references frequently “rediscover” (through ignorance) old tips. Documents that cite just unpublished or material that is unrefereed to have problems with narrowness and parochialism. Keep in mind that citations not just acknowledge a financial obligation to other people, but additionally act as an abbreviation device to spare your audience a complete development from first maxims. In the event that audience has to get some good of the development, but, he must certanly be in a position to transform your citations into supply product they can read. Personal communications and interior memoranda fail this test. Technical reports are often posted in limited amounts, out-of-print, and hard to get. Consequently, such citations as supply product must be prevented whenever we can.

In the event that system was implemented, how has it been used, and just just what has this usage shown in regards to the practical significance of the a few ideas? Again, a numerous implementation that is man-year will not of itself justify book of a paper. In the event that system that is implemented brand new tips, you will need to explain the way they worked down in training. a seemingly good notion that didn’t pan away is at minimum since interesting as you that did. You should be precise and specific. “Our weather prediction system is installed and operating with no you have reported about its periodic inaccurate forecasts” is a lot less convincing than “everytime we don’t forecast rainfall, the users hang their damp tops on the tape drives to dry”. When you look at the second instance, at minimum we understand that folks are employing and with regards to the system.