» Articles » PMID: 39653735

Training All-mechanical Neural Networks for Task Learning Through in Situ Backpropagation

Overview
Journal Nat Commun
Specialty Biology
Date 2024 Dec 9
PMID 39653735
Authors
Affiliations
Soon will be listed here.
Abstract

Recent advances unveiled physical neural networks as promising machine learning platforms, offering faster and more energy-efficient information processing. Compared with extensively-studied optical neural networks, the development of mechanical neural networks remains nascent and faces significant challenges, including heavy computational demands and learning with approximate gradients. Here, we introduce the mechanical analogue of in situ backpropagation to enable highly efficient training of mechanical neural networks. We theoretically prove that the exact gradient can be obtained locally, enabling learning through the immediate vicinity, and we experimentally demonstrate this backpropagation to obtain gradient with high precision. With the gradient information, we showcase the successful training of networks in simulations for behavior learning and machine learning tasks, achieving high accuracy in experiments of regression and classification. Furthermore, we present the retrainability of networks involving task-switching and damage, demonstrating the resilience. Our findings, which integrate the theory for training mechanical neural networks and experimental and numerical validations, pave the way for mechanical machine learning hardware and autonomous self-learning material systems.

Citing Articles

Training all-mechanical neural networks for task learning through in situ backpropagation.

Li S, Mao X Nat Commun. 2024; 15(1):10528.

PMID: 39653735 PMC: 11628607. DOI: 10.1038/s41467-024-54849-z.

References
1.
Lin X, Rivenson Y, Yardimci N, Veli M, Luo Y, Jarrahi M . All-optical machine learning using diffractive deep neural networks. Science. 2018; 361(6406):1004-1008. DOI: 10.1126/science.aat8084. View

2.
Li S, Mao X . Training all-mechanical neural networks for task learning through in situ backpropagation. Nat Commun. 2024; 15(1):10528. PMC: 11628607. DOI: 10.1038/s41467-024-54849-z. View

3.
Hopfield J . Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci U S A. 1984; 81(10):3088-92. PMC: 345226. DOI: 10.1073/pnas.81.10.3088. View

4.
LeCun Y, Bengio Y, Hinton G . Deep learning. Nature. 2015; 521(7553):436-44. DOI: 10.1038/nature14539. View

5.
Sun K, Souslov A, Mao X, Lubensky T . Surface phonons, elastic response, and conformal invariance in twisted kagome lattices. Proc Natl Acad Sci U S A. 2012; 109(31):12369-74. PMC: 3412002. DOI: 10.1073/pnas.1119941109. View