Adaptive directional gradients for parameterised quantum circuits
Summary
A new framework of forward gradient estimators is proposed for training parameterised quantum circuits (PQCs), directly addressing the high measurement cost of traditional gradient estimation methods like the parameter-shift rule. This framework, based on the forward mode of automatic differentiation, provides an unbiased gradient estimator by averaging a freely tunable number of random directional derivatives. It recovers SPSA, random coordinate descent, and the parameter-shift rule as limiting cases, without requiring ancilla qubits or controlled-gate overhead. The work introduces QUIVER (Quantum Iterative V-adaptive Estimator Rule), an adaptive optimizer derived from a closed-form minimum measurement-cost allocation. Numerically, forward gradients train 60-qubit, 1770-parameter orthogonal quantum neural networks on ECG5000 and MNIST datasets orders of magnitude more efficiently, and QUIVER outperforms iCANS and gCANS on quantum approximate optimisation algorithm (QAOA) and variational quantum eigensolver (VQE) problems.
Key takeaway
For Machine Learning Engineers optimizing parameterised quantum circuits on quantum hardware, adopting the QUIVER adaptive optimizer or forward gradient estimators can drastically reduce the measurement cost. This enables more efficient training of larger models, such as 60-qubit orthogonal quantum neural networks. You should explore integrating these methods to overcome the parameter-shift rule's scaling limitations and accelerate quantum algorithm development.
Key insights
Forward gradient estimators significantly reduce measurement cost for training PQCs by averaging random directional derivatives.
Principles
- Measurement cost bottlenecks PQC training.
- Forward gradients offer unbiased estimation.
- Adaptive optimizers can minimize measurement cost.
Method
QUIVER derives an update rule from a closed-form minimum measurement-cost allocation for adaptive PQC optimization, based on forward gradient estimators.
In practice
- Train orthogonal quantum neural networks efficiently.
- Optimize QAOA and VQE problems with fewer measurements.
Topics
- Parameterised Quantum Circuits
- Quantum Gradient Estimation
- Forward Gradient Estimators
- QUIVER Optimizer
- Quantum Machine Learning
- Measurement Cost Reduction
Best for: AI Scientist, Machine Learning Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.