User menu

Accès à distance ? S'identifier sur le proxy UCLouvain

NetPaxos: Consensus at Network Speed

Primary tabs

Dang, Huynh Tu [Universita della Svizzera italiana] Sciascia, Daniele [Universita della Svizzera italiana] Canini, Marco [UCL] Pedone, Fernando [Universita della Svizzera italiana] Soulé, Robert [Universita della Svizzera italiana]

This paper explores the possibility of implementing the widely deployed Paxos consensus protocol in network devices. We present two different approaches: (i) a detailed design description for implementing the full Paxos logic in SDN switches, which identifies a sufficient set of required OpenFlow extensions; and (ii) an alternative, optimistic protocol which can be implemented without changes to the OpenFlow API, but relies on assumptions about how the network orders messages. Although neither of these protocols can be fully implemented without changes to the underlying switch firmware, we argue that such changes are feasible in existing hardware. Moreover, we present an evaluation that suggests that moving Paxos logic into the network would yield significant performance benefits for distributed applications.

Document type Communication à un colloque (Conference Paper) – Présentation orale avec comité de sélection
Access type Accès interdit
Publication date 2015
Language Anglais
Conference "ACM SOSR"
Peer reviewed yes
Host document "ACM SOSR" (ISBN : 978-1-4503-3451-8)
Publication status Publié
Affiliation UCL - SST/ICTM/INGI - Pôle en ingénierie informatique
Keywords 1162
Links
  1. R. Soulé, S. Basu, P. J. Marandi, F. Pedone, R. Kleinberg, E. G. Sirer, and N. Foster. Merlin: A Language for Provisioning Network Resources. InACM International Conference on Emerging Networking Experiments and Technologies (CoNEXT), pages 213--226, Dec. 2014.
  2. Sciascia Daniele, Pedone Fernando, Geo-replicated storage with scalable deferred update replication, 10.1109/dsn.2013.6575360
  3. Schneider Fred B., Implementing fault-tolerant services using the state machine approach: a tutorial, 10.1145/98163.98167
  4. D. R. K. Ports, J. Li, V. Liu, N. K. Sharma, and A. Krishnamurthy. Designing Distributed Systems Using Approximate Synchrony in Data Center Networks. InUSENIX Symposium on Networked Systems Design and Implementation (NSDI), Mar. 2015.
  5. Pedone Fernando, Schiper André, Urbán Péter, Cavin David, Solving Agreement Problems with Weak Ordering Oracles, Dependable Computing EDCC-4 (2002) ISBN:9783540000129 p.44-61, 10.1007/3-540-36080-8_5
  6. Pedone Fernando, Schiper André, Optimistic atomic broadcast: a pragmatic viewpoint, 10.1016/s0304-3975(01)00397-8
  7. Pedone F., Frolund S., Pronto: a fast failover protocol for off-the-shelf commercial databases, 10.1109/reldi.2000.885405
  8. Ouyang Jian, Lin Shiding, Jiang Song, Hou Zhenyu, Wang Yong, Wang Yuanzheng, SDF : software-defined flash for web-scale internet storage systems, 10.1145/2541940.2541959
  9. B. Oki and B. Liskov. Viewstamped Replication: A General Primary-Copy Method to Support Highly-Available Distributed Systems. InACM Symposium on Principles of Distributed Computing (PODC), pages 8--17, Aug. 1988.
  10. NoviFlow. NoviSwitch 1132 High Performance OpenFlow Switch datasheet. http://noviflow.com/wp-content/uploads/2014/12/NoviSwitch-1132-Datasheet.pdf.
  11. Netronome. NFP-6xxx - A 22nm High-Performance Network Flow Processor for 200Gb/s Software Defined Networking, 2013. Talk at HotChips by Gavin Stark. http://www.hotchips.org/wp-content/uploads/hc_archives/hc25/HC25.60-Networking-epub/HC25.27.620-22nm-Flow-Proc-Stark-Netronome.pdf.
  12. Netronome. FlowNICs -- Accelerated, Programmable Interface Cards. http://netronome.com/product/flownics.
  13. McKeown Nick, Anderson Tom, Balakrishnan Hari, Parulkar Guru, Peterson Larry, Rexford Jennifer, Shenker Scott, Turner Jonathan, OpenFlow : enabling innovation in campus networks, 10.1145/1355734.1355746
  14. Marandi Parisa Jalili, Benz Samuel, Pedonea Fernando, Birman Kenneth P., The Performance of Paxos in the Cloud, 10.1109/srds.2014.15
  15. P. Marandi, M. Primi, N. Schiper, and F. Pedone. Ring Paxos: A High-Throughput Atomic Broadcast Protocol. InIEEE International Conference on Dependable Systems and Networks (DSN), pages 527--536, June 2010.
  16. Mai Luo, Rupprecht Lukas, Alim Abdul, Costa Paolo, Migliavacca Matteo, Pietzuch Peter, Wolf Alexander L., NetAgg : Using Middleboxes for Application-specific On-path Aggregation in Data Centres, 10.1145/2674005.2674996
  17. Lamport Leslie, Fast Paxos, 10.1007/s00446-006-0005-x
  18. Lamport Leslie, The part-time parliament, 10.1145/279227.279229
  19. Lamport Leslie, Time, clocks, and the ordering of events in a distributed system, 10.1145/359545.359563
  20. V. Jeyakumar, M. Alizadeh, D. Mazières, B. Prabhakar, A. Greenberg, and C. Kim. EyeQ: Practical Network Performance Isolation at the Edge. InUSENIX Symposium on Networked Systems Design and Implementation (NSDI), pages 297--312, Apr. 2013.
  21. Han Jong Hun, Mundkur Prashanth, Rotsos Charalampos, Antichi Gianni, Dave Nirav, Moore Andrew W., Neumann Peter G., Blueswitch: enabling provably consistent configuration of network switches, 10.1109/ancs.2015.7110117
  22. T. Gupta, J. B. Leners, M. K. Aguilera, and M. Walfish. Improving Availability in Distributed Systems with Failure Informers. InUSENIX Symposium on Networked Systems Design and Implementation (NSDI), pages 427--441, Apr. 2013.
  23. Glendenning Lisa, Beschastnikh Ivan, Krishnamurthy Arvind, Anderson Thomas, Scalable consistency in Scatter, 10.1145/2043556.2043559
  24. Gibb G., Lockwood J.W., Naous J., Hartke P., McKeown N., NetFPGA—An Open Platform for Teaching How to Build Gigabit-Rate Network Switches and Routers, 10.1109/te.2008.919664
  25. Ferguson Andrew D., Guha Arjun, Liang Chen, Fonseca Rodrigo, Krishnamurthi Shriram, Participatory networking : an API for application control of SDNs, 10.1145/2486001.2486003
  26. Défago Xavier, Schiper André, Urbán Péter, Total order broadcast and multicast algorithms : Taxonomy and survey, 10.1145/1041680.1041682
  27. Corsa Technology. http://www.corsa.com/.
  28. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's Globally-Distributed Database. InUSENIX Symposium on Operating Systems Design and Implementation (OSDI), pages 251--264, Oct. 2012.
  29. B. Charron-Bost, F. Pedone, and A. Schiper, editors.Replication: Theory and Practice, volume 5959 of Lecture Notes in Computer Science.Springer, 2010.
  30. Chandra Tushar D., Griesemer Robert, Redstone Joshua, Paxos made live : an engineering perspective, 10.1145/1281100.1281103
  31. M. Burrows. The Chubby Lock Service for Loosely-Coupled Distributed Systems. InUSENIX Symposium on Operating Systems Design and Implementation (OSDI), pages 335--350, Nov. 2006.
  32. Bosshart Pat, Gibb Glen, Kim Hun-Seok, Varghese George, McKeown Nick, Izzard Martin, Mujica Fernando, Horowitz Mark, Forwarding metamorphosis : fast programmable match-action processing in hardware for SDN, 10.1145/2486001.2486011
  33. Bosshart Pat, Varghese George, Walker David, Daly Dan, Gibb Glen, Izzard Martin, McKeown Nick, Rexford Jennifer, Schlesinger Cole, Talayco Dan, Vahdat Amin, P4 : programming protocol-independent packet processors, 10.1145/2656877.2656890
  34. G. Bianchi, M. Bonola, A. Capone, and C. Cascone. OpenState: Programming Platform-Independent Stateful Openflow Applications Inside the Switch. InSIGCOMM Computer Communication Review (CCR), volume 44, pages 44--51, Apr. 2014.
  35. H. Ballani, P. Costa, C. Gkantsidis, M. P. Grosvenor, T. Karagiannis, L. Koromilas, and G. O'Shea. Enabling End Host Network Functions. InSIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM), Aug. 2015.
  36. Arista. Arista 7124FX Application Switch datasheet. http://www.arista.com/assets/data/pdf/7124FX/7124FX_Data_Sheet.pdf.
Bibliographic reference Dang, Huynh Tu ; Sciascia, Daniele ; Canini, Marco ; Pedone, Fernando ; Soulé, Robert. NetPaxos: Consensus at Network Speed.ACM SOSRIn: ACM SOSR, 2015
Permanent URL http://hdl.handle.net/2078.1/161639