Application-motivated, holistic benchmarking of a full quantum computing stack

Tools

Mills, Daniel and Sivarajah, Seyon and Scholten, Travis L. and Duncan, Ross (2021) Application-motivated, holistic benchmarking of a full quantum computing stack. Quantum, 5. 415. ISSN 2521-327X (https://doi.org/10.22331/q-2021-03-22-415)

[thumbnail of Mills-etal-Quantum-2020-Application-motivated-holistic-benchmarking-of-a-full-quantum-computing-stack]
Preview
 Text. Filename: Mills_etal_Quantum_2020_Application_motivated_holistic_benchmarking_of_a_full_quantum_computing_stack.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

Quantum computing systems need to be benchmarked in terms of practical tasks they would be expected to do. Here, we propose 3 "application-motivated" circuit classes for benchmarking: deep (relevant for state preparation in the variational quantum eigensolver algorithm), shallow (inspired by IQP-type circuits that might be useful for near-term quantum machine learning), and square (inspired by the quantum volume benchmark). We quantify the performance of a quantum computing system in running circuits from these classes using several figures of merit, all of which require exponential classical computing resources and a polynomial number of classical samples (bitstrings) from the system. We study how performance varies with the compilation strategy used and the device on which the circuit is run. Using systems made available by IBM Quantum, we examine their performance, showing that noise-aware compilation strategies may be beneficial, and that device connectivity and noise levels play a crucial role in the performance of the system according to our benchmarks.

ORCID iDs

Mills, Daniel, Sivarajah, Seyon, Scholten, Travis L. and Duncan, Ross ORCID logoORCID: https://orcid.org/0000-0001-6758-1573;
CORE (COnnecting REpositories)