latent alignment

Multi-Encoder-Decoder VAE Enables Cross-Subject Neural Alignment Without Shared Stimuli

A new Multi-Encoder-Decoder Variational Autoencoder (MED-VAE) achieves cross-subject alignment of neural activity without shared stimuli by using a pretrained artificial neural network as a scaffold. Tested on the Natural Scenes Dataset, MED-VAE creates semantically organized common latent spaces and outperforms traditional methods in generalization and cross-subject prediction.