Artificial Intelligence #transformers#representation autoencoders
New Drift-RAE Method Distills Transformers Efficiently Using Representation Autoencoders
A new research paper proposes Drift-RAE, a method for distilling pretrained flow models in representation autoencoder latent spaces. It overcomes anisotropy and large curvature challenges, achieving 1.77 FID on ImageNet 256 with only 10,000 distillation steps, outperforming existing RAE distillation methods.
Jun 16, 2026 1 source