Energy-Based Models

A short announcement of the Energy-Tweedie preprint and its publication page.

The classical Tweedie’s formula connects the score under Gaussian noise to the posterior mean. We generalize this result to the Energy-Tweedie identity: the score from a wider family of noising distributions is connected to a path-derivative of a matched energy score. Among other things, this opens new routes to score estimation, noise parameter estimation, and provides the score-based perspective on diffusion approaches based on scoring rules.