2–6 Aug 2021
online
Europe/Brussels timezone

Equivariance and generalization in neural networks

6 Aug 2021, 15:10
20m
online

online

Parallel contribution H. Statistical Methods for Physics Analysis in the XXI Century Parallels Track H

Speaker

Matteo Favoni (TU Wien)

Description

The crucial role played by the underlying symmetries of high energy physics and lattice field theories calls for the implementation of such symmetries in the neural network architectures that are applied to the physical system under consideration. In this talk we focus on the consequences of incorporating translational equivariance among the network properties, particularly in terms of performance and generalization [1]. The benefits of equivariant networks are exemplified by studying a complex scalar field theory, on which various regression and classification tasks are examined. For a meaningful comparison, promising equivariant and non-equivariant architectures are identified by means of a systematic search. The results indicate that in most of the tasks our best equivariant architectures can perform and generalize significantly better than their non-equivariant counterparts, which applies not only to physical parameters beyond those represented in the training set, but also to different lattice sizes.

[1] ``Generalization capabilities of translationally equivariant neural networks'', S.~Bulusu, M.~Favoni, A.~Ipp, D.~I.~Müller, D.~Schuh,
https://arxiv.org/abs/2103.14686

Primary authors

Matteo Favoni (TU Wien) David Müller (TU Wien) Dr Andreas Ipp (TU Wien) Mr Daniel Schuh (TU Wien) Mr Srinath Bulusu (TU Wien)

Presentation materials