A test suite for QUIC

QUIC is a new transport protocol that is being standardised within the IETF. It is built on top of UDP and is designed to address the shortcomings of TCP. Google has already deployed an experimental version of QUIC and claims that it conveys 7% of the Internet traffic. The IETF QUIC working group in charge of the standardisation process counts fifteen implementations that provide feedback and improvements to the specification. In this thesis, we propose an independent test suite that verifies the correctness of several QUIC mechanisms with regard to the specification. The test suite exchanges packets with QUIC implementations to evaluate them. We propose a methodology to extract test scenarii from the specification and implement a set of tools to easily create them. A web application allows to visualise the results of the test suite to ease the communication of bug reports to QUIC implementers. We report the results we collected during a 3-month period starting in March 2018. We present the evolution of QUIC versions during the specification process. We assess the evolution of transport parameters and patterns of retransmission during connection establishment. We detail the bugs and regressions we found involving the flow control mechanism as well as the reordering mechanism of several implementations. We provide evidence that our work has been useful to the IETF QUIC working group and that it can be easily extended for future uses. All our software is publicly available under an open-source license.