Artificial Intelligence #deep learning#lstm
Multiple Descents in Deep Learning Linked to Order-Chaos Transitions in LSTM Networks, New Research Shows
Researchers have observed a 'multiple-descent' phenomenon in LSTM networks, where test performance cycles through ups and downs after overtraining. Asymptotic stability analysis reveals these cycles are linked to order-chaos phase transitions, with the most optimal training step at the first transition from order to chaos, where the 'edge of chaos' is widest.
Jun 16, 2026 1 source