PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation
Abstract
Generating an image with a diffusion or flow-matching model typically involves integrating a velocity field for hundreds of sequential steps. That computation suits a GPU poorly and an analog neuromorphic substrate well, where one fast, low-power physical relaxation could replace the whole sequence. Two things are needed: a generative algorithm whose computation is a relaxation, and a way to train it without backpropagation, whose global gradient transport is hard to realise in analog. Energy Matching supplies the first, sampling by gradient-descent relaxation on a time-independent potential - but obtaining the gradient that descent follows is itself a backward pass, once per integration step. We prove that a predictive coding network with a single linear injection term added to its energy relaxes to a state whose visible layer carries that gradient inherently, with an error that vanishes for small injection strengths. An Energy Matching model trained by backpropagation can therefore be loaded into this network unchanged and sampled by relaxation alone, matching the original model's FID to within 0.04 at CIFAR-10 and ImageNet-32 scale. The network can also be trained without backpropagation: Equilibrium Propagation reproduces backpropagation's parameter updates to a cosine similarity of 0.9998, and training end to end with those updates reaches an FID of 3.64 on unconditional CIFAR-10 against 3.54 for backpropagation. To our knowledge this is the first CIFAR-10 generative model trained with Equilibrium Propagation, and the first at competitive quality by any backpropagation-free rule. This quality does not require group normalisation or attention: an architecture of only convolutions and pointwise nonlinearities, both native to an analog crossbar, reaches an FID of 3.51 when trained by backpropagation.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents a rigorous method for training CIFAR-scale generative models using Equilibrium Propagation, achieving competitive FID scores without backpropagation. It bridges the gap between energy-based generative models and neuromorphic hardware by proving that predictive coding networks can inherently compute the gradients required for sampling and training via local relaxation dynamics.
Methodology
The paper proposes a rigorous theoretical and practical framework for training generative models without backpropagation, specifically targeting analog neuromorphic hardware. The core contribution is the "PotentialPCN," a predictive coding network (PCN) constructed from a standard feedforward energy matching model. The authors prove that by adding a single linear injection term to the energy of the PCN, the relaxed state of the network inherently computes the gradient of the potential (the velocity field required for sampling) with an error that vanishes as the injection strength approaches zero. This allows for sampling via physical relaxation without a backward pass. Furthermore, they demonstrate that Equilibrium Propagation (specifically a GradEP variant with a linearized nudge) can train these models end-to-end, reproducing backpropagation gradients with high fidelity (cosine similarity 0.9998). The methodology is mathematically sound, with clear proofs provided in the appendix regarding the correspondence between the PCN relaxation and the feedforward gradient.
Results & evaluation
The experiments are comprehensive for the scope of the claim. The authors validate the inference correspondence by showing that the PCN relaxation matches the feedforward gradient to machine precision (TF32 limits) across six decades of injection strengths. They demonstrate that an Energy Matching model trained with backprop can be sampled via PCN relaxation with negligible FID loss (within 0.04) on CIFAR-10 and ImageNet-32. Crucially, they show that training *with* Equilibrium Propagation yields competitive results: an FID of 3.64 on unconditional CIFAR-10, compared to 3.54 for backpropagation. They also provide an existence proof for hardware-plausible architectures (convolutions and pointwise nonlinearities only) achieving an FID of 3.51, demonstrating that attention and group normalization are not strictly necessary for competitive performance at this scale.
Reproducibility
The paper provides a high level of reproducibility. The authors release code for training, sampling, and correspondence measurements. The training recipe, including hyperparameters for the Equilibrium Propagation phases (nudge strength, tether stiffness, sweep budgets), is detailed in the appendix. The distinction between the "implicit solve" (IFT) and "Equilibrium Propagation" (EP) arms is clearly defined, allowing readers to replicate the specific backprop-free training procedure.
Limitations
The primary limitation is that all results are simulated on GPUs; no physical neuromorphic hardware was used, so the actual energy and latency benefits remain theoretical. The simulation cost of EP is significantly higher than backprop (16x), which is a major barrier for GPU-based research, though the paper argues this is mitigated on physical hardware. The scope is limited to CIFAR-10 for training; ImageNet-32 was only used for inference validation. Additionally, the "hardware-plausible" architecture was only trained with backprop, not with EP, leaving a gap in demonstrating the full pipeline on the simplified architecture.
Broader impact
This work is significant for the neuromorphic computing community as it provides a concrete, high-quality pathway to implement generative models on analog substrates. By removing the need for backpropagation during both training and inference (sampling), it addresses the two main hurdles for analog AI: global gradient transport and sequential computation. The finding that simple convolutional architectures suffice for competitive FID scores without attention is also valuable for the broader generative modeling field, suggesting that complexity may be overestimated for certain tasks. The paper presents a rigorous method for training CIFAR-scale generative models using Equilibrium Propagation, achieving competitive FID scores without backpropagation. It bridges the gap between energy-based generative models and neuromorphic hardware by proving that predictive coding networks can inherently compute the gradients required for sampling and training via local relaxation dynamics.
Author of this paper? Send a correction.