Key takeaways
- Benchmarks differ widely depending on whether you measure raw hardware performance, application-level results, or business value, so comparing vendors on a single number is misleading
- Standardization efforts like QED-C's application-oriented benchmarks aim to give end-users a common yardstick instead of relying on vendor-reported qubit counts or fidelities alone
- End users should care about benchmarks tied to their specific use case rather than generic metrics, since a chip that excels at one algorithm class may lag on another
- Consulting-side view from BCG stresses that enterprises need benchmark data translated into business-relevant terms like time-to-solution and cost, not just physics metrics
Summary
Tom Lubinski, Chief Software Architect for Quantum Circuits, Matt Langione, a partner at the Boston Consulting Group, and Pranav Gokhale, VP of Software at Infleqtion, are interviewed by Yuval Boger. Tom, Matt, Pranav and Yuval talk about quantum benchmarking – why benchmarks are important, what types of benchmarks exist, whether end-users should care, standardization efforts and much more.
Listen below or get the full transcript on the Quantum Computing Report site