AuthorsX. Wang, P. Arcaini, T. Yue and S. Ali
TitleApplication of Combinatorial Testing to Quantum Programs
AfilliationSoftware Engineering
Project(s)Department of Engineering Complex Software Systems, Quantum Software Engineering Project, Enabling Future Dependable Ubiquitous Services and Data with Novel Testing Methods for Quantum Programs
StatusPublished
Publication TypeProceedings, refereed
Year of Publication2021
Conference Name2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS)
PublisherIEEE
Abstract

The capability of Quantum Computing (QC) in solving complex problems has been increasingly recognized. However, similar to classical computing, to fully exploit QC's potential, it is important to ensure the correctness of quantum programs. Doing so via software testing is, however, very challenging because of QC's inherent properties: superposition and entanglement. Towards the direction of ensuring the correctness of quantum programs, we propose an approach called QuCAT (QUantum CombinAtorial Testing) for systematic and automated testing of quantum programs by benefiting from combinatorial testing, which has been proven to be cost-effective in testing classical programs. QuCAT supports two combinatorial test suite generation scenarios, i.e., generating combinatorial test suites of a given strength, and incrementally generating and executing combinatorial test suites of increasing strength until a fault is found. The approach employs two types of test oracles to assess test results. We performed an empirical study with 18 faulty versions of quantum programs to evaluate QuCAT with strengths of two, three, and four in the two test generation scenarios. We compare the cost-effectiveness of combinatorial testing of various strengths and random testing (taken as baseline approach). Results show that combinatorial testing always performs better than random testing with the same cost and finds faults more quickly (in terms of required number of test cases). In addition, in most cases, combinatorial testing with a higher strength outperforms the lower strength in terms of effectiveness.

URLhttps://ieeexplore.ieee.org/document/9724888
DOI10.1109/QRS54544.2021.00029
Citation Key42899

Contact person