Skip to content

01-rkhs-quantum-parallel.md

Latest commit

 

History

History
256 lines (146 loc) · 7.35 KB

01-rkhs-quantum-parallel.md

File metadata and controls

256 lines (146 loc) · 7.35 KB
Raw

RKHS and Quantum Mechanics: A Structural Parallel

Introduction

GRL's reinforcement field framework exhibits a deep structural similarity to quantum mechanics—not as a loose analogy, but as a mathematical identity. Both frameworks are built on the same underlying structure:

Hilbert space + inner product + superposition

This document explores this connection and its implications for probabilistic machine learning.

The Core Parallel

GRL's Formulation

In GRL (Section V of the original paper):

Each experience particle defines a basis function in a reproducing kernel Hilbert space, and the field is expressed as a superposition of these functions.

Quantum Mechanics' Formulation

In quantum mechanics:

Each eigenstate defines a basis vector in Hilbert space, and the wavefunction is expressed as a superposition of these states.

This is not analogy—it is structural identity.

In both cases:

  • The state of the system is a vector in a Hilbert space (not a point)

  • What we "observe" or "infer" comes from inner products

  • Meaning arises from overlap, not identity

  • Probabilities are derived from amplitudes, not primitive

Precise Mathematical Correspondence

1. Particles ↔ Basis States

In GRL:

Each particle $z_i$ induces a function—a vector in RKHS:

$$z_i \mapsto k(z_i, \cdot) \in \mathcal{H}_k$$

In Quantum Mechanics:

Each basis state is a vector in Hilbert space:

$$|i\rangle \in \mathcal{H}$$

Neither is a "thing in the world"—both are representational primitives.

2. Reinforcement Field ↔ Wavefunction

In GRL:

$$Q^+(\cdot) = \sum_i w_i , k(z_i, \cdot)$$

In Quantum Mechanics:

$$|\psi\rangle = \sum_i c_i , |i\rangle$$

The parallel is exact:

  • Coefficients: $w_i \leftrightarrow c_i$
  • Basis vectors: $k(z_i, \cdot) \leftrightarrow |i\rangle$
  • The system state is the superposition itself

Interpretation: The reinforcement field is a wavefunction over augmented state-action space. More specifically, the reinforcement field is a state vector in RKHS, whose projections onto kernel-induced bases yield wavefunction-like amplitude fields over augmented state-action space.

(See 01a-wavefunction-interpretation.md for detailed clarification of this distinction.)

3. Kernel Inner Product ↔ Probability Amplitude

In RKHS:

$$\langle k(z_i, \cdot), k(z_j, \cdot) \rangle_{\mathcal{H}_k} = k(z_i, z_j)$$

In Quantum Mechanics:

$$\langle \phi | \psi \rangle$$

In both cases:

  • Inner product = overlap amplitude

  • Large overlap = strong compatibility

  • Orthogonality = conceptual independence

Why spectral clustering works: It decomposes the space by overlap structure—exactly what eigendecomposition does in quantum mechanics.

Probability Amplitudes vs. Direct Probabilities

In Quantum Mechanics

  • The wavefunction $\psi(x)$ is not a probability
  • $|\psi(x)|^2$ is the probability density
  • Probability is derived from amplitude, not primitive

In GRL

Similarly:

  • The reinforcement field $Q^+(z)$ is not a probability
  • Policy $\pi(a|s) \propto \exp(\beta , Q^+(s, a))$ is derived from the field
  • Inner products $k(z_i, z_j)$ measure compatibility (amplitude overlap)

Why This Matters

Traditional ML: Uses probabilities directly $p(x)$

GRL (Quantum-Inspired): Uses amplitudes $\langle \psi | \phi \rangle$, then derives probabilities via $|\langle \psi | \phi \rangle|^2$

This formulation enables:

  1. Superposition: Represent multi-modal distributions naturally
  2. Interference: Amplitudes can add constructively or destructively
  3. Phase information: (In complex RKHS) Encode temporal/contextual relationships
  4. Spectral methods: Eigendecomposition reveals structure

Observables and Expectation Values

In Quantum Mechanics

Observables are Hermitian operators $\hat{O}$:

$$\langle O \rangle = \langle \psi | \hat{O} | \psi \rangle$$

In GRL

The expected value at a configuration:

$$V(z) = \sum_i w_i , k(z_i, z) = \langle Q^+, k(z, \cdot) \rangle$$

The value function is an expectation over the particle distribution, weighted by kernel overlap.

Parallel: Both frameworks compute expectations as inner products in Hilbert space.

Implications for Machine Learning

1. Novel Probability Formulation

This amplitude-based formulation is not yet mainstream in ML:

Traditional ML Quantum-Inspired (GRL)
Direct probabilities $p(x)$ Amplitudes $\langle \psi | \phi \rangle$
Single-valued Superposition of states
Real-valued Complex-valued possible
No interference Interference effects

2. Spectral Structure is Natural

Because the system state is a superposition in Hilbert space:

  • Eigendecomposition naturally reveals coherent subspaces
  • Spectral clustering groups by amplitude overlap
  • Concepts emerge as eigenmodes of the kernel matrix

This is why Part II (Emergent Structure & Spectral Abstraction) uses spectral methods—they're the natural tool for analyzing Hilbert space structure.

3. Richer Dynamics

With complex-valued RKHS (see next document):

  • Interference effects can guide learning
  • Phase evolution provides temporal dynamics
  • Partial overlaps enable nuanced similarity

What This Is and Isn't

This IS:

  • ✅ A mathematical identity in structure (Hilbert space + inner product)
  • ✅ A principled way to think about multi-modal distributions
  • ✅ Justification for amplitude-based probability in ML
  • ✅ Foundation for spectral methods in concept discovery

This IS NOT:

  • ❌ Claiming GRL involves physical quantum effects
  • ❌ Requiring quantum computers
  • ❌ Just a metaphor or analogy

The mathematics is literally the same—but applied to learning, not physics.

Connection to Part I and Part II

Part I: Particle-Based Learning

Uses real-valued RKHS:

  • Particles as basis functions
  • Reinforcement field as superposition
  • Inner products for similarity
  • GP-based energy landscape

Already leverages the Hilbert space structure!

Part II: Emergent Structure & Spectral Abstraction

Exploits this structure explicitly:

  • Spectral clustering on kernel matrix
  • Eigenspaces as concept subspaces
  • Hierarchical structure from spectral decomposition

The quantum-inspired view explains why spectral methods work for concept discovery.

Further Reading

Within This Tutorial

External References

Quantum Kernel Methods:

  • Havlíček et al. (2019). Supervised learning with quantum-enhanced feature spaces. Nature 567, 209-212.
  • Schuld & Killoran (2019). Quantum machine learning in feature Hilbert spaces. Physical Review Letters 122, 040504.

RKHS Theory:

  • Berlinet & Thomas-Agnan (2004). Reproducing Kernel Hilbert Spaces in Probability and Statistics. Springer.
  • Steinwart & Christmann (2008). Support Vector Machines. Springer.

GRL Original Paper:

Last Updated: January 12, 2026