Skip to main content

Comment on "Localization of the Maximal Entropy Random Walk"

Comment & Archival Record

Title: Comment on "Localization of the Maximal Entropy Random Walk"
Author: R. Fisher, Principal Investigator (ORCID: 0009-0006-2441-3282)
Affiliation: Braid Dynamics Group
Target Article: Z. Burda, J. Duda, J.-M. Luck, B. Wacław, Phys. Rev. Lett. 102, 160602 (2009)
Published / Received: June 21, 2026 · Status: Formal Commentary / Preprint (v1.0.0) · License: Creative Commons Attribution 4.0 (CC BY 4.0)
Classification: Statistical Mechanics · Spectral Graph Theory · Markov Chains
Replication Engine: Python 3.8+ reference simulation script with spectral analysis and lazy-walk recovery.

📁 Downloadable Publication & Replication Files

File NameDescriptionSizeAction
maximal-entropy-random-walk.pdfPhysical Review Letters Two-Column Comment (XeLaTeX)40 KBDownload PDF ↓
maximal_entropy_random_walk_simulation.pyStandalone Python Simulation & Spectral Analyzer4 KBDownload Python ↓
maximal-entropy-random-walk.mdComplete Markdown Source Document8 KBDownload MD ↓

Abstract

Burda et al. [Phys. Rev. Lett. 102, 160602 (2009)] asserted that the discrete-time probability distribution πi(t)\pi_i(t) of the Maximal Entropy Random Walk (MERW) relaxes to the unique stationary profile πi=ψ0,i2\pi_i^* = \psi_{0,i}^2 as tt \to \infty. While π\pi^* is the correct stationary measure and principal-eigenvector localization remains valid, this Comment shows that for any finite connected bipartite graph, the MERW transition matrix possesses a peripheral eigenvalue μ=1\mu = -1, inducing period-two dynamics. Consequently, the unmodified discrete-time distribution does not converge to π\pi^* from initial conditions with nonzero parity imbalance; instead it approaches a persistent two-cycle. For the unmodified chain, convergence to π\pi^* holds if and only if the initial distribution has equal mass on the two bipartition classes. Cesàro or pairwise parity averaging, aperiodic lazy modifications, and continuous-time formulations recover convergence to π\pi^* in the appropriate sense.


I. Introduction

The Maximal Entropy Random Walk (MERW) constructs stochastic trajectories by maximizing entropy globally over paths of fixed length. For a finite, connected graph G=(V,E)G=(V,E) with symmetric adjacency matrix AA, spectral radius λ0\lambda_0, and normalized principal right eigenvector ψ0\psi_0 (ψ02=1\|\psi_0\|_2=1, ψ0,i>0\psi_{0,i}>0), the discrete-time stationary distribution is [1]: πi=ψ0,i2\pi_i^* = \psi_{0,i}^2 Specifically, Ref.[1], following Eq.(2), asserts: ``using spectral properties of the matrix PijP_{ij}, one can show that πi(t)\pi_i(t) reaches for tt \to \infty a unique stationary state πi\pi_i^* obeying (2)''.

For a finite irreducible discrete-time Markov chain, convergence to stationarity from every initial state requires aperiodicity. If PP possesses peripheral eigenvalues on the unit circle other than unity, the chain fails to mix. On bipartite topologies commonly studied in MERW simulations (such as ladder networks and square lattices with open or even-periodic boundary conditions), PP possesses a peripheral eigenvalue μ=1\mu = -1. Consequently, while π\pi^* remains stationary, the unmodified discrete-time chain fails to converge from generic initial conditions, settling into a persistent period-two oscillation.


II. Spectral Projection and Row-Stochasticity

Let G=(V,E)G = (V,E) denote a finite, connected, bipartite graph with disjoint vertex partitions V=V1V2V = V_1 \cup V_2. Ordering vertices conformally yields the symmetric block adjacency matrix: A=(0BBT0)A = \begin{pmatrix} 0 & B \\ B^T & 0 \end{pmatrix} where BB is of dimension V1×V2|V_1| \times |V_2|.

Let λ0\lambda_0 denote the spectral radius of AA. By the Perron-Frobenius theorem, λ0\lambda_0 is a simple, positive eigenvalue, and the corresponding principal right eigenvector ψ0\psi_0 satisfies ψ0,i>0\psi_{0,i} > 0 for all iVi \in V. Conformal partitioning of ψ0=(ψ0(1),ψ0(2))T\psi_0 = (\psi_{0}^{(1)}, \psi_{0}^{(2)})^T under Aψ0=λ0ψ0A\psi_0 = \lambda_0\psi_0 yields the coupled linear system: Bψ0(2)=λ0ψ0(1),BTψ0(1)=λ0ψ0(2)B\psi_{0}^{(2)} = \lambda_0\psi_{0}^{(1)}, \quad B^T\psi_{0}^{(1)} = \lambda_0\psi_{0}^{(2)} Defining the spectral test vector ψ=(ψ0(1),ψ0(2))T\psi_- = (\psi_{0}^{(1)}, -\psi_{0}^{(2)})^T, direct matrix multiplication gives: Aψ=(0BBT0)(ψ0(1)ψ0(2))=(Bψ0(2)BTψ0(1))=(λ0ψ0(1)λ0ψ0(2))=λ0ψA\psi_- = \begin{pmatrix} 0 & B \\ B^T & 0 \end{pmatrix} \begin{pmatrix} \psi_{0}^{(1)} \\ -\psi_{0}^{(2)} \end{pmatrix} = \begin{pmatrix} -B\psi_{0}^{(2)} \\ B^T\psi_{0}^{(1)} \end{pmatrix} = \begin{pmatrix} -\lambda_0\psi_{0}^{(1)} \\ \lambda_0\psi_{0}^{(2)} \end{pmatrix} = -\lambda_0\psi_- Thus, λ0-\lambda_0 is an eigenvalue of AA with eigenvector ψ\psi_-. Because the sign-flip mapping on V2V_2 components provides an invertible isometry between eigenspaces, simplicity of λ0\lambda_0 implies simplicity of λ0-\lambda_0.

The discrete-time MERW transition matrix is defined via diagonal similarity transformation: P=1λ0D1ADP = \frac{1}{\lambda_0} D^{-1} A D where D=diag(ψ0)D = \operatorname{diag}(\psi_0). Under row probability conventions, PP is strictly row-stochastic: jPij=1λ0ψ0,ijAijψ0,j=(Aψ0)iλ0ψ0,i=1\sum_j P_{ij} = \frac{1}{\lambda_0\psi_{0,i}}\sum_j A_{ij}\psi_{0,j} = \frac{(A\psi_0)_i}{\lambda_0\psi_{0,i}} = 1 Because AA is real and symmetric, AA is orthogonally diagonalizable, Jordan blocks do not occur, and spectra satisfy Spec(P)=1λ0Spec(A)\operatorname{Spec}(P) = \frac{1}{\lambda_0}\operatorname{Spec}(A). Since the peripheral spectrum of AA on a connected bipartite graph is strictly {λ0,λ0}\{\lambda_0, -\lambda_0\}, the peripheral spectrum of PP is strictly {1,1}\{1, -1\}.

The right eigenvector v2v_2 of PP corresponding to the peripheral eigenvalue μ2=1\mu_2 = -1 (Pv2=v2P v_2 = -v_2) is the parity vector: v2=D1ψ    v2,i=ψ,iψ0,i={+1if iV11if iV2v_2 = D^{-1}\psi_- \implies v_{2,i} = \frac{\psi_{-,i}}{\psi_{0,i}} = \begin{cases} +1 & \text{if } i \in V_1 \\ -1 & \text{if } i \in V_2 \end{cases} This yields an immediate parity diagnostic observable: π(t)v2=π(0)Ptv2=(1)tπ(0)v2=(1)tc\pi(t)v_2 = \pi(0)P^t v_2 = (-1)^t \pi(0)v_2 = (-1)^t c where c=iV1πi(0)iV2πi(0)c = \sum_{i \in V_1}\pi_i(0) - \sum_{i \in V_2}\pi_i(0) is the initial parity imbalance. Since πv2=iV1ψ0,i2iV2ψ0,i2=ψ0Tψ=0\pi^* v_2 = \sum_{i \in V_1}\psi_{0,i}^2 - \sum_{i \in V_2}\psi_{0,i}^2 = \psi_0^T\psi_- = 0, convergence π(t)π\pi(t) \to \pi^* requires (1)tc0(-1)^t c \to 0, which is impossible whenever c0c \neq 0.


III. Dual Basis Expansion and Asymptotic Oscillations

Let π(t)\pi(t) represent the state probability row vector under iterated applications of PP. We decompose an arbitrary initial probability distribution π(0)\pi(0) into the dual basis of left and right eigenvectors {uαT,vα}\{u_\alpha^T, v_\alpha\} of PP, satisfying the biorthogonality condition uαTvβ=δαβu_\alpha^T v_\beta = \delta_{\alpha\beta}.

A. Subspace Biorthogonality Verification

Let the stationary mode (μ1=1\mu_1 = 1) be defined by u1T=πu_1^T = \pi^* and v1=1v_1 = \mathbf{1}, where πi=ψ0,i2\pi_i^* = \psi_{0,i}^2 subject to iψ0,i2=1\sum_i \psi_{0,i}^2 = 1. Let the oscillatory mode (μ2=1\mu_2 = -1) have right eigenvector v2v_2 and left eigenvector u2T=wTu_2^T = w^T, where wi=ψ0,iψ,iw_i = \psi_{0,i}\psi_{-,i} (satisfying wTP=wTw^T P = -w^T via MERW reversibility with respect to π\pi^*). Element-wise: wi={ψ0,i2if iV1ψ0,i2if iV2w_i = \begin{cases} \psi_{0,i}^2 & \text{if } i \in V_1 \\ -\psi_{0,i}^2 & \text{if } i \in V_2 \end{cases} Eigenvector orthogonality ψ0ψ\psi_0 \perp \psi_- establishes: wTv1=iVwi=iV1ψ0,i2iV2ψ0,i2=ψ0Tψ=0w^T v_1 = \sum_{i \in V} w_i = \sum_{i \in V_1} \psi_{0,i}^2 - \sum_{i \in V_2} \psi_{0,i}^2 = \psi_0^T \psi_- = 0 Therefore, the L2L_2 mass of the Perron vector is split equally between the two partition classes. Biorthogonality constraints for the dominant subspace are satisfied: u1Tv2=iV1ψ0,i2iV2ψ0,i2=0,wTv2=iVψ,i2=iVψ0,i2=1u_1^T v_2 = \sum_{i \in V_1} \psi_{0,i}^2 - \sum_{i \in V_2} \psi_{0,i}^2 = 0, \quad w^T v_2 = \sum_{i \in V} \psi_{-,i}^2 = \sum_{i \in V} \psi_{0,i}^2 = 1

B. Eigenvalue Decay and Asymptotic Oscillation

By the Perron-Frobenius theorem, all remaining subdominant eigenvalues satisfy μα<1|\mu_\alpha| < 1 for α3\alpha \ge 3. State evolution from an arbitrary initial distribution π(0)\pi(0) follows: π(t)=(π(0)v1)(1)tπ+(π(0)v2)(1)twT+α3(π(0)vα)μαtuαT\pi(t) = (\pi(0)v_1)(1)^t \pi^* + (\pi(0)v_2)(-1)^t w^T + \sum_{\alpha \ge 3} (\pi(0)v_\alpha)\mu_\alpha^t u_\alpha^T Taking tt \to \infty, decaying modes vanish exponentially (μαt0|\mu_\alpha|^t \to 0), yielding the leading asymptotic form: πi(t)=ψ0,i2+c(1)tσiψ0,i2+o(1)\pi_i(t) = \psi_{0,i}^2 + c(-1)^t \sigma_i \psi_{0,i}^2 + o(1) where σi=+1\sigma_i = +1 for iV1i \in V_1 and σi=1\sigma_i = -1 for iV2i \in V_2. Hence, for the unmodified discrete-time chain, limtπ(t)=π\lim_{t \to \infty}\pi(t) = \pi^* if and only if c=0c = 0.

For a point-mass distribution localized at node kV1k \in V_1 (π(0)=ekT\pi(0) = \mathbf{e}_k^T), we have c1=1c_1 = 1 and c=+1c = +1. The sequence alternates between two disjoint limits: limtt evenπi(t)={2ψ0,i2if iV10if iV2,limtt oddπi(t)={0if iV12ψ0,i2if iV2\lim_{\substack{t \to \infty \\ t \text{ even}}} \pi_i(t) = \begin{cases} 2\psi_{0,i}^2 & \text{if } i \in V_1 \\ 0 & \text{if } i \in V_2 \end{cases}, \quad \lim_{\substack{t \to \infty \\ t \text{ odd}}} \pi_i(t) = \begin{cases} 0 & \text{if } i \in V_1 \\ 2\psi_{0,i}^2 & \text{if } i \in V_2 \end{cases} Initializing at node kV2k \in V_2 yields c=1c = -1, producing an identical, phase-inverted limit cycle. Although the chain is periodic, irreducibility and positive recurrence guarantee that the Cesàro time average 1Tt=0T1π(t)π\frac{1}{T}\sum_{t=0}^{T-1} \pi(t) \to \pi^*, and the pairwise parity average 12[π(t)+π(t+1)]π\frac{1}{2}[\pi(t)+\pi(t+1)] \to \pi^* as tt \to \infty.


IV. Conclusion

The universal statement that the discrete-time MERW distribution relaxes to π=ψ02\pi^* = \psi_{0}^2 is not valid on finite connected bipartite graphs. The stationary profile π\pi^* remains correct and is recovered by Cesàro or pairwise parity averaging. However, the instantaneous distribution converges to π\pi^* only when the initial parity imbalance cc vanishes; for c0c \neq 0, the distribution approaches a permanent period-two limit cycle. To obtain ordinary convergence of the instantaneous distribution, one must modify the dynamics, for example by using an aperiodic lazy walk Pα=(1α)I+αPP_\alpha = (1-\alpha)I + \alpha P (0<α<10 < \alpha < 1) or transitioning to continuous-time dynamics with generator Q=PIQ = P - I. A companion numerical simulation is provided in the Supplemental Material file maximal_entropy_random_walk_simulation.py [2].


References

  1. Z. Burda, J. Duda, J.-M. Luck, and B. Wacław, Localization of the Maximal Entropy Random Walk, Phys. Rev. Lett. 102, 160602 (2009).
  2. R. Fisher, Maximal Entropy Random Walk Periodicity Simulation, Supplemental Material and Code Archive, Braid Dynamics Research Archive (2026).