โ† Research

EBM reconstruction

Using an energy-based model as a learned reconstruction loss.

This experiment trains an energy-based model to distinguish familiar digit images from corrupted or mismatched examples. Its energy then supplies a learning signal for a separate reconstruction model.

The reconstruction model is intended to produce images that the energy model treats as familiar. The setup uses MNIST and includes class-conditional information.

The question is what the learned signal rewards compared with a direct pixel loss. A reconstruction can look familiar to the energy model while still losing details from its input, so lower energy alone is not enough to establish better reconstruction.