Adaptive directional gradients for parameterised quantum circuits

· Source: Machine Learning · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Expert, quick

Summary

A new framework of forward gradient estimators is proposed for training parameterised quantum circuits (PQCs), directly addressing the high measurement cost of traditional gradient estimation methods like the parameter-shift rule. This framework, based on the forward mode of automatic differentiation, provides an unbiased gradient estimator by averaging a freely tunable number of random directional derivatives. It recovers SPSA, random coordinate descent, and the parameter-shift rule as limiting cases, without requiring ancilla qubits or controlled-gate overhead. The work introduces QUIVER (Quantum Iterative V-adaptive Estimator Rule), an adaptive optimizer derived from a closed-form minimum measurement-cost allocation. Numerically, forward gradients train 60-qubit, 1770-parameter orthogonal quantum neural networks on ECG5000 and MNIST datasets orders of magnitude more efficiently, and QUIVER outperforms iCANS and gCANS on quantum approximate optimisation algorithm (QAOA) and variational quantum eigensolver (VQE) problems.

Key takeaway

For Machine Learning Engineers optimizing parameterised quantum circuits on quantum hardware, adopting the QUIVER adaptive optimizer or forward gradient estimators can drastically reduce the measurement cost. This enables more efficient training of larger models, such as 60-qubit orthogonal quantum neural networks. You should explore integrating these methods to overcome the parameter-shift rule's scaling limitations and accelerate quantum algorithm development.

Key insights

Forward gradient estimators significantly reduce measurement cost for training PQCs by averaging random directional derivatives.

Principles

Method

QUIVER derives an update rule from a closed-form minimum measurement-cost allocation for adaptive PQC optimization, based on forward gradient estimators.

In practice

Topics

Best for: AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.