Inference · diagnostics · learning

Sampling & Energy Lab

See sampled points build a probability distribution, compare samplers using modern diagnostics, and inspect normalized neural energy models. Failed mixing and finite-step bias remain visible alongside stronger baselines.

Repository · Equations and contracts · Measured comparisons
Live analytic finite-step bias

Unadjusted Langevin on a correlated Gaussian

Covariance has unit diagonal and correlation ρ. ULA uses x′ = x − ηΣ⁻¹x + √(2η)z. A stable chain can still have the wrong stationary covariance.

Equal axes; one-standard-deviation covariance ellipses. Teal: exact target. Gold: ULA stationary law when stable. This is an analytic calculation, not an estimated posterior region.

Live reversible integration

Hamiltonian motion and discretization

Standard Gaussian position target, unit mass, initial position 0.8 and momentum 0.3. Leapfrog conserves energy approximately; the acceptance step corrects its integration error.

Owned HMC experiments also randomize trajectory length. Adaptive HMC tunes its step size and diagonal geometry in warmup; NUTS uses the maintained Pyro implementation. Warmup states never enter reported diagnostics.