Machine Learning PapersLandmark papers
← All papers
RESEARCH PAPER / 2021

Highly accurate protein structure prediction with AlphaFold

Hoang-Son Nguyen, Yiran He, Hoi-To Wai

The Chinese University of Hong Kong · landmark

Affiliations: The Chinese University of Hong Kong

Abstract

Recently, the stability of graph filters has been studied as one of the key theoretical properties driving the highly successful graph convolutional neural networks (GCNs). The stability of a graph filter characterizes the effect of topology perturbation on the output of a graph filter, a fundamental building block for GCNs. Many existing results have focused on the regime of small perturbation with a small number of edge rewires. However, the number of edge rewires can be large in many applications. To study the latter case, this work departs from the previous analysis and proves a bound on the stability of graph filter relying on the filter's frequency response. Assuming the graph filter is low pass, we show that the stability of the filter depends on perturbation to the community structure. As an application, we show that for stochastic block model graphs, the graph filter distance converges to zero when the number of nodes approaches infinity. Numerical simulations validate our findings.

The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.

Research summary

The paper establishes that low-pass graph filters remain stable under large-scale edge rewiring as long as the underlying community structure is preserved, providing a frequency-domain stability bound that decouples robustness from the raw number of topological perturbations. This theoretical contribution offers a meaningful refinement to existing graph filter stability literature by shifting focus from perturbation magnitude to structural preservation, though its practical impact is currently constrained by strong spectral assumptions, limited empirical validation, and a lack of direct integration with modern, learnable GNN training paradigms.

Methodology

The paper introduces a frequency-domain analysis of graph filter stability, departing from traditional polynomial-based bounds that scale linearly with the number of edge rewires. By leveraging the low-pass property of the filter, the authors derive a novel bound that ties stability to perturbations in community structure (captured via bottom-$k$ eigenvectors and eigenvalues of the GSO). The theoretical framework is mathematically sound, combining spectral perturbation theory (Davis-Kahan, Weyl) with SBM concentration results. The approach is elegant and correctly identifies why certain structural perturbations do not degrade filter outputs. However, the derivation relies on standard tools rather than introducing fundamentally new analytical machinery, and the low-pass assumption is restrictive for general GCN architectures.

Results & evaluation

Experiments are primarily synthetic, using Planted Partition Models to validate asymptotic convergence under varying graph sizes and rewiring ratios. The inclusion of high-pass filters as a control effectively isolates the role of the low-pass assumption. The real-data experiment on the email-Eu-core network is limited to a single dataset and a simplified rewiring scheme. While results align with theory, the empirical validation lacks breadth (e.g., no direct numerical comparison against prior stability bounds on identical perturbation budgets, limited real-world graph diversity, and no evaluation on downstream GNN tasks like node classification).

Reproducibility

As a theoretical paper, reproducibility relies on clear mathematical derivations and well-specified experimental setups. The assumptions, filter definitions, and SBM parameters are explicitly stated. However, no code repository is provided, which limits immediate verification. The experiments should be straightforward to replicate given the detailed descriptions, but the absence of open-source code slightly hinders rapid community adoption.

Limitations

The theoretical guarantees are tightly coupled to the low-pass filter assumption and SBM/PPM graph structures, which may not generalize to real-world graphs with heavy-tailed degree distributions, overlapping communities, or adversarial perturbations. The requirement for a spectral gap ($\lambda_k < \lambda_{k+1}$) restricts applicability to graphs with clear modular structure. Additionally, the asymptotic nature of the results ($n \to \infty$) leaves finite-sample behavior under-explored. The paper also does not address how to design, enforce, or learn low-pass properties in practical, trainable GCN layers.

Broader impact

This work strengthens the theoretical foundation of GNN robustness by formally linking filter stability to community preservation rather than raw edge counts. It provides valuable insights for designing robust graph augmentation pipelines, understanding transferability across graph domains, and guiding the spectral design of graph filters. While not immediately applicable to engineering pipelines, it offers a principled lens for analyzing structural perturbations in graph learning and may inform future work on topology-invariant GNN architectures. The paper establishes that low-pass graph filters remain stable under large-scale edge rewiring as long as the underlying community structure is preserved, providing a frequency-domain stability bound that decouples robustness from the raw number of topological perturbations. This theoretical contribution offers a meaningful refinement to existing graph filter stability literature by shifting focus from perturbation magnitude to structural preservation, though its practical impact is currently constrained by strong spectral assumptions, limited empirical validation, and a lack of direct integration with modern, learnable GNN training paradigms.

Curator note

Jumper et al.; DeepMind; Nature 2021; solved protein structure prediction

Discussion

Talks & videos

Related later work

Author of this paper? Send a correction.