Call for Papers
The 2020 ACM SIGMETRICS conference will be held in Boston, MA, June 8-12, 2020.
We solicit papers on the development and application of state-of-the-art, broadly applicable analytic,
simulation and measurement-based performance evaluation techniques. The conference provides a high-quality
forum for presenting results and discussing ideas that further our knowledge and understanding of the measurement,
modeling, analysis, and design of computing and networked systems. Of particular interest is work that presents
new performance evaluation methods or that creatively applies previously developed methods to make predictions about,
or gain insights into key design trade-offs in a variety of computing, networked, and cyber-physical systems,
ranging from mobile devices and Internet-of-Things (IoT) applications to large-scale cloud computing systems and
the smart grid.
Papers that are accepted to appear in the conference will be published in Proceedings of the ACM on
Measurement and Analysis of Computing Systems (POMACS).
We solicit papers describing original and previously unpublished
research. Specific topics of interest include, but are not limited
to, the following.
Quantitative measurement, design and evaluation studies of:
- Computer and communication networks, protocols and algorithms
- Wireless, mobile, ad-hoc and sensor networks, IoT applications
- Computer architectures, multi-core processors, memory systems and storage networks
- High Performance Computing
- Operating systems, file systems and databases
- Virtualization, data centers, distributed and cloud computing
- Mobile and personal computing systems
- Energy-efficient computing systems
- Real-time and fault-tolerant systems
- Security and privacy of computing and networked systems
- Software systems and enterprise applications
- Social networks, multimedia systems, service-oriented architectures and Web services
- Cyber-physical systems, including the smart grid
Methodologies, formalisms, metrics, solution techniques and algorithms for:
- Analytical modeling techniques and model validation
- Workload characterization and benchmarking
- Performance, scalability, power and reliability analysis
- Sustainability analysis and power management
- System measurement, performance monitoring and forecasting
- Anomaly detection, problem diagnosis and troubleshooting
- Capacity planning, resource allocation, run time management and scheduling
- Experimental design, statistical analysis, simulation
- Game theory, network economics, and platform design
- Big data, machine learning, data mining, graph analysis, optimization
There are three submission opportunities over the course of the year.
Summer submission website: sigmetrics20summer.hotcrp.com
- Registration of abstract:
August 1st, 2019
- Paper submission:
August 8, 2019
- Author notification:
September 30, 2019
Fall submission website: sigmetrics20fall.hotcrp.com
- Registration of abstract:
October 14, 2019
- Paper submission:
October 21, 2019
- Author notification:
December 16, 2019
Winter submission website: sigmetrics20winter.hotcrp.com
- Registration of abstract:
January 27, 2020
- Paper submission:
February 3, 2020
- Author notification: March 31, 2020
Deadlines are hard and at 5:00pm Eastern Time (New York).
Papers may be submitted to any deadline and, upon acceptance, papers will be scheduled for publication in the
Proceedings of the ACM on Measurement and Analysis of Computing Systems (POMACS) and presentation at the ACM SIGMETRICS 2020 conference. The journal publication
of accepted papers will appear in the issue of POMACS immediately following acceptance; i.e. papers that are accepted for the summer and fall deadlines will appear in
POMACS before the conference.
Papers must be submitted electronically in printable pdf form via the submission site posted on this page. All submissions must satisfy the following requirements:
- Up to 12 pages, in the 2-column ACM format, for technical content (including all tables and figures), PLUS unlimited pages for references.
- Additionally, authors may supplement their paper with an appendix, whose length is not constrained. However it may only be used for the
purpose of justifying the technical correctness of their claims stated in the body of the paper, e.g., the technical details needed for a
proof to be self-contained or additional experimental validation.
- Papers must follow the ACM format.
Templates for the standard ACM format can be found at this link. Authors should use the
"sigconf" proceedings template. No changes to margins, spacing, or font sizes are allowed from those specified by the style files. Papers violating the formatting guidelines will be returned without review.
The Reviewing Process
The reviewing process for submissions is a hybrid of the traditional conference and journal models in computer science. There are three possible
outcomes from the first round of submission:
- Accept with Shepherding: Every accepted paper will be shepherded in order to insure that important suggestions from the reviewers are
incorporated into the final version of the paper. This is similar to the “Minor Revision” outcome at a journal.
- One-shot Revision: Papers where the reviewers see promise, but also issues that need to be addressed before publication, will receive the option of a
“One-shot revision”. This is similar to the “Major Revision” outcome at a journal. In such cases, the authors will receive a list of issues that are required
to be addressed before the paper can be accepted. Authors may then submit a revision of the paper during one of the next two submission deadlines.
The revision should include an author response to the issues raised by the reviewers as part of the appendix
of the paper. If the paper is not submitted within this time then any resubmission is treated as a new paper. The outcome after resubmission of a “one-shot revision”
will either be “Accept with Shepherding”, "Accept as a Poster", or “Reject”. If the revision is accepted as a poster or rejected then any future revision of it may
not be resubmitted to any SIGMETRICS deadline within 12 months following the initial submission of the paper.
- Reject: If the paper is rejected it may not be resubmitted to any SIGMETRICS deadline within 12 months following the initial submission of the paper.
- Anonymity guidelines: ACM SIGMETRICS is double-blind, meaning that authors should make a good faith effort to anonymize papers. As an author, you should
not identify yourself in the paper either explicitly or by implication (e.g., through the references or acknowledgments).
However, only non-destructive anonymization is required. For example, system names may be left un-anonymized, if the system name
is important for a reviewer to be able to evaluate the work. Specifically, please take the following steps when preparing your submission:
- Remove authors' names and affiliations from the title page.
- Remove acknowledgment of identifying names and funding sources.
- Use care in naming your files. Source file names, e.g., Joe.Smith.dvi, are often embedded in the final output as readily accessible comments.
- Use care in referring to related work, particularly your own. Do not omit references to provide anonymity, as this leaves the reviewer unable to grasp the context.
Instead, a good solution is to reference your past work in the third person, just as you would any other piece of related work.
- If you need to reference another submission at ACM SIGMETRICS 2020 on a related topic, reference it as follows: "A related paper describes the design and implementation
of our compiler [Anonymous 2020]." with the corresponding citation: "[Anonymous 2020] Under submission. Details omitted for double-blind reviewing."
- If you cite anonymous work, you should also send the deanonymized reference(s) to the PC chairs in a separate email.
- Work that extends an author's previous workshop paper is welcome, but authors should (i) acknowledge their own previous workshop publications with an anonymous citation
and (ii) explain the differences between the SIGMETRICS submission and the prior workshop paper. A rule of thumb is that a prior workshop publication should be at most 6 pages long.
- Publication of a pre-submission version of the submission on your personal website, institutional archive, or the arxiv is allowed.
- Blinding is intended to not be a great burden. If blinding your paper seems too burdensome, please contact the program co-chairs and discuss your specific situation.
- The paper must have a substantive title and abstract. Placeholders are not allowed after the registration deadline. Any submission that does not have a substantive
title and abstract by the registration deadline will be rejected without further notice.
- Submissions must present original research. However, previous publication of preliminary work as an extended abstract at a workshop is acceptable as long as the submission
includes substantial new material. A rule-of-thumb is that the workshop paper should be no longer than 6 pages in length. See the note above for information on how to ensure
double-blind submission in such cases.
- It is ACM policy not to allow double submissions, where the same paper is submitted to more than one conference/journal concurrently. Any double submissions detected
will be immediately rejected from all conferences/journals involved. It is considered a double submission for a paper that is being considered for a one-shot revision to be
submitted to another conference/journal before being withdrawn from the SIGMETRICS process. This applies to all papers, including those papers whose authors plan to opt out of
POMACS publication to publish in another journal. Thus, authors who wish to opt out of POMACS can only submit to a journal after they have received a decision from SIGMETRICS.
- Rejected papers may not be resubmitted within 12 months of the initial submission of the work. Any resubmissions within this period will be rejected without review.
- Authors have the option to “opt out” of publication in the ACM POMACS journal if they would like to publish their work in some other journal. Authors who choose this option must
still present their work at the conference. Additionally, a 1-2 page abstract of the work must be included in the conference proceedings. This abstract is required to contain a link
to an online version of the full paper that will be maintained for at least 2 years.
- Papers accompanied by nondisclosure agreement forms will not be considered. All submissions will be treated as confidential prior to publication; rejected submissions will be
permanently treated as confidential.
Papers describing experiments with users or user data (e.g., network traffic, passwords, social network information), should follow the basic principles of ethical research, e.g.,
beneficence (maximizing the benefits to an individual or to society while minimizing harm to the individual), minimal risk (appropriateness of the risk versus benefit ratio),
voluntary consent, respect for privacy, and limited deception. When appropriate, authors are encouraged to include a subsection describing these issues. Authors may want to
consult the Menlo Report
for further information on ethical principles, or the Allman/Paxson IMC '07 paper
for guidance on ethical data sharing.
Authors must, as part of the submission process, attest that their work complies with all applicable ethical standards of their home institution(s), including but not limited
to privacy policies and policies on experiments involving humans. Note that submitting research for approval by one's institution's ethics review body is necessary, but not
sufficient—in cases where the PC has concerns about the ethics of the work in a submission, the PC will have its own discussion of the ethics of that work. The PC’s review
process may examine the ethical soundness of the paper just as it examines the technical soundness.
Contact the SIGMETRICS 2020 PC chairs at email@example.com in case of questions or concerns.