User menu

Accès à distance ? S'identifier sur le proxy UCLouvain

Evaluating the artifacts of SIGCOMM papers

Primary tabs

download
  • Open access
  • PDF
  • 1.37 M
Saucez, Damien [Inria] Iannone, Luigi [ParisTech] Bonaventure, Olivier [UCL]

A growing fraction of the papers published by CCR and at SIGCOMM-sponsored conferences include artifacts such as software or datasets. Besides CCR, these artifacts were rarely evaluated. During the last months of 2018, we organised two different Artifacts Evaluation Committees to which authors could submit the artifacts of their papers for evaluation. The first one evaluated the papers accepted by Conext’18 shortly after the TPC decision. It assigned ACM reproducibility badges to 12 different papers. The second one evaluated papers accepted by CCR and any SIGCOMM-sponsored conference. 28 papers received ACM reproducibility badges. We report on the results of a short survey among artifacts authors and reviewers and provide some suggestions for future artifacts evaluations.

Document type Article de périodique (Journal article) – Éditorial
Access type Accès libre
Publication date 2019
Language Anglais
Journal information "ACM SIGCOMM Computer Communication Review" - Vol. 49, no.2, p. 44-47 (2019)
Publisher Association for Computing Machinery (ACM)
issn 0146-4833
Publication status Publié
Affiliation UCL - SST/ICTM/INGI - Pôle en ingénierie informatique
Keywords Computer Networks and Communications ; Software
Links
  1. Zhou, Y., Alipourfard, O., Yu, M., and Yang, T. http://doi.acm.org/10.1145/3276799.3276800Accelerating network measurement in software. SIGCOMM Comput. Commun. Rev. 48, 3 (Sept. 2018), 2–12.
  2. Zheng, P., Benson, T., and Hu, C. http://doi.acm.org/10.1145/3281411.3281436P4visor: Lightweight virtualization and composition primitives for building and testing modular programs. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 98–111.
  3. Zannettou, S., Caulfield, T., Blackburn, J., De Cristofaro, E., Sirivianos, M., Stringhini, G., and Suarez-Tangil, G. http://doi.acm.org/10.1145/3278532.3278550On the origins of memes by means of fringe web communities. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 188–202.
  4. Xhonneux, M., Duchene, F., and Bonaventure, O. http://doi.acm.org/10.1145/3281411.3281426Leveraging ebpf for programmable network functions with ipv6 segment routing. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 67–72.
  5. Vermeulen, K., Strowes, S. D., Fourmaux, O., and Friedman, T. http://doi.acm.org/10.1145/3278532.3278536Multilevel mda-lite paris traceroute. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 29–42.
  6. Scouarnec, N. L. http://doi.acm.org/10.1145/3230718.3232629Cuckoo++ hash tables: High-performance hash tables for networking applications. In Proceedings of the 2018 Symposium on Architectures for Networking and Communications Systems (New York, NY, USA, 2018), ANCS '18, ACM, pp. 41–54.
  7. Scheitle, Q., Hohlfeld, O., Gamba, J., Jelten, J., Zimmermann, T., Strowes, S. D., and Vallina-Rodriguez, N. http://doi.acm.org/10.1145/3278532.3278574A long way to the top: Significance, structure, and stability of internet top lists. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 478–493.
  8. Scheitle, Q., Gasser, O., Nolte, T., Amann, J., Brent, L., Carle, G., Holz, R., Schmidt, T. C., and Wählisch, M. http://doi.acm.org/10.1145/3278532.3278562The rise of certificate transparency and its implications on the internet ecosystem. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 343–349.
  9. Scheitle, Q., Chung, T., Hiller, J., Gasser, O., Naab, J., van Rijswijk-Deij, R., Hohlfeld, O., Holz, R., Choffnes, D., Mislove, A., and Carle, G. http://doi.acm.org/10.1145/3213232.3213235A first look at certification authority authorization (caa). SIGCOMM Comput. Commun. Rev. 48, 2 (May 2018), 10–23.
  10. Reuter, A., Bush, R., Cunha, I., Katz-Bassett, E., Schmidt, T. C., and Wählisch, M. http://doi.acm.org/10.1145/3211852.3211856Towards a rigorous methodology for measuring adoption of rpki route validation and filtering. SIGCOMM Comput. Commun. Rev. 48, 1 (Apr. 2018), 19–27.
  11. Razaghpanah, A., Niaki, A. A., Vallina-Rodriguez, N., Sundaresan, S., Amann, J., and Gill, P. http://doi.acm.org/10.1145/3232755.3232779Studying tls usage in android apps. In Proceedings of the Applied Networking Research Workshop (New York, NY, USA, 2018), ANRW '18, ACM, pp. 5–5.
  12. Pirelli, S., Zaostrovnykh, A., and Candea, G. http://doi.acm.org/10.1145/3310165.3310176A formally verified nat stack. SIGCOMM Comput. Commun. Rev. 48, 5 (Jan. 2019), 77–83.
  13. Pedrosa, L., Iyer, R., Zaostrovnykh, A., Fietz, J., and Argyraki, K. http://doi.acm.org/10.1145/3230543.3230573Automated synthesis of adversarial workloads for network functions. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 372–385.
  14. Niu, K., Zhang, F., Xiong, J., Li, X., Yi, E., and Zhang, D. http://doi.acm.org/10.1145/3281411.3281425Boosting fine-grained activity sensing by embracing wireless multipath effects. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 139–151.
  15. Neves, M., Freire, L., Schaeffer-Filho, A., and Barcellos, M. http://doi.acm.org/10.1145/3281411.3281421Verification of p4 programs in feasible time using assertions. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 73–85.
  16. Neugebauer, R., Antichi, G., Zazo, J. F., Audzevich, Y., López-Buedo, S., and Moore, A. W. http://doi.acm.org/10.1145/3230543.3230560Understanding pcie performance for end host networking. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 327–341.
  17. Narayan, A., Cangialosi, F., Raghavan, D., Goyal, P., Narayana, S., Mittal, R., Alizadeh, M., and Balakrishnan, H. http://doi.acm.org/10.1145/3230543.3230553Restructuring endpoint congestion control. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 30–43.
  18. Montazeri, B., Li, Y., Alizadeh, M., and Ousterhout, J. http://doi.acm.org/10.1145/3230543.3230564Homa: A receiver-driven low-latency transport protocol using network priorities. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 221–235.
  19. Melis, L., Pyrgelis, A., and De Cristofaro, E. http://doi.acm.org/10.1145/3310165.3310168On collaborative predictive blacklisting. SIGCOMM Comput. Commun. Rev. 48, 5 (Jan. 2019), 9–20.
  20. Marcos, P., Chiesa, M., Müller, L., Kathiravelu, P., Dietzel, C., Canini, M., and Barcellos, M. http://doi.acm.org/10.1145/3281411.3281419Dynam-ix: A dynamic interconnection exchange. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 228–240.
  21. Mani, A., Wilson-Brown, T., Jansen, R., Johnson, A., and Sherr, M. http://doi.acm.org/10.1145/3278532.3278549Understanding tor usage with privacy-preserving measurement. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 175–187.
  22. Mammen, P. M., Kumar, H., Ramamritham, K., and Rashid, H. http://doi.acm.org/10.1145/3208903.3208941Want to reduce energy consumption, whom should we call? In Proceedings of the Ninth International Conference on Future Energy Systems (New York, NY, USA, 2018), e-Energy '18, ACM, pp. 12–20.
  23. Kumar, P., Yu, C., Yuan, Y., Foster, N., Kleinberg, R., and Soulé, R. http://doi.acm.org/10.1145/3185467.3185498Yates: Rapid prototyping for traffic engineering systems. In Proceedings of the Symposium on SDN Research (New York, NY, USA, 2018), SOSR '18, ACM, pp. 11:1–11:7.
  24. Kulkarni, S. G., Liu, G., Ramakrishnan, K., Arumaithurai, M., Wood, T., and Fu, X. http://doi.acm.org/10.1145/3281411.3281441Reinforce: Achieving efficient failure resiliency for network function virtualization based services. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 41–53.
  25. Jensen, J. S., Krøgh, T. B., Madsen, J. S., Schmid, S., Srba, J., and Thorgersen, M. T. http://doi.acm.org/10.1145/3281411.3281432P-rex: Fast verification of mpls networks with multiple link failures. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 217–227.
  26. Huang, Q., Lee, P. P. C., and Bao, Y. http://doi.acm.org/10.1145/3230543.3230559Sketchlearn: Relieving user burdens in approximate measurement with automated statistical inference. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 576–590.
  27. Høiland-Jørgensen, T., Brouer, J. D., Borkmann, D., Fastabend, J., Herbert, T., Ahern, D., and Miller, D. http://doi.acm.org/10.1145/3281411.3281443The express data path: Fast programmable packet processing in the operating system kernel. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 54–66.
  28. Heorhiadi, V., Chandrasekaran, S., Reiter, M. K., and Sekar, V. http://doi.acm.org/10.1145/3281411.3281431Intent-driven composition of resource-management sdn applications. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 86–97.
  29. Gvozdiev, N., Vissicchio, S., Karp, B., and Handley, M. http://doi.acm.org/10.1145/3230543.3230575On low-latency-capable topologies, and their impact on the design of intra-domain routing. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 88–102.
  30. Dhamdhere, A., Clark, D. D., Gamero-Garrido, A., Luckie, M., Mok, R. K. P., Akiwate, G., Gogia, K., Bajpai, V., Snoeren, A. C., and Claffy, K. http://doi.acm.org/10.1145/3230543.3230549Inferring persistent interdomain congestion. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (New York, NY, USA, 2018), SIGCOMM '18, ACM, pp. 1–15.
  31. Deng, H., Peng, C., Fida, A., Meng, J., and Hu, Y. C. http://doi.acm.org/10.1145/3278532.3278546Mobility support in cellular networks: A measurement study on its configurations and implications. In Proceedings of the Internet Measurement Conference 2018 (New York, NY, USA, 2018), IMC '18, ACM, pp. 147–160.
  32. Cao, L., Fahmy, S., Sharma, P., and Zhe, S. http://doi.acm.org/10.1145/3230718.3230725Data-driven resource flexing for network functions visualization. In Proceedings of the 2018 Symposium on Architectures for Networking and Communications Systems (New York, NY, USA, 2018), ANCS '18, ACM, pp. 111–124.
  33. Bischof, S., Trittenbach, H., Vollmer, M., Werle, D., Blank, T., and Böhm, K. http://doi.acm.org/10.1145/3208903.3210278Hipe: An energy-status-data set from industrial production. In Proceedings of the Ninth International Conference on Future Energy Systems (New York, NY, USA, 2018), e-Energy '18, ACM, pp. 599–603.
  34. Beysens, J., Galisteo, A., Wang, Q., Juara, D., Giustiniano, D., and Pollin, S. http://doi.acm.org/10.1145/3281411.3281423Densevlc: A cell-free massive mimo system with distributed leds. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 320–332.
  35. Basat, R. B., Einziger, G., Keslassy, I., Orda, A., Vargaftik, S., and Waisbard, E. http://doi.acm.org/10.1145/3281411.3281427Memento: Making sliding windows efficient for heavy hitters. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 254–266.
  36. Basat, R. B., Einziger, G., Feibish, S. L., Moraney, J., and Raz, D. http://doi.acm.org/10.1145/3230718.3230729Network-wide routing-oblivious heavy hitters. In Proceedings of the 2018 Symposium on Architectures for Networking and Communications Systems (New York, NY, USA, 2018), ANCS '18, ACM, pp. 66–73.
  37. Barth, L., Hagenmeyer, V., Ludwig, N., and Wagner, D. http://doi.acm.org/10.1145/3208903.3208909How much demand side flexibility do we need?: Analyzing where to exploit flexibility in industrial processes. In Proceedings of the Ninth International Conference on Future Energy Systems (New York, NY, USA, 2018), e-Energy '18, ACM, pp. 43–62.
  38. Bano, S., Richter, P., Javed, M., Sundaresan, S., Durumeric, Z., Murdoch, S. J., Mortier, R., and Paxson, V. http://doi.acm.org/10.1145/3213232.3213234Scanning the internet for liveness. SIGCOMM Comput. Commun. Rev. 48, 2 (May 2018), 2–9.
  39. Aubry, F., Vissicchio, S., Bonaventure, O., and Deville, Y. http://doi.acm.org/10.1145/3281411.3281424Robustly disjoint paths with segment routing. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (New York, NY, USA, 2018), CoNEXT '18, ACM, pp. 204–216.
Bibliographic reference Saucez, Damien ; Iannone, Luigi ; Bonaventure, Olivier. Evaluating the artifacts of SIGCOMM papers. In: ACM SIGCOMM Computer Communication Review, Vol. 49, no.2, p. 44-47 (2019)
Permanent URL http://hdl.handle.net/2078.1/216874