Program
s
Summer 2022

Summer Cluster: Deep Learning Theory

Jul. 6Aug. 5, 2022

This cluster will bring together a small group of computer scientists, statisticians, mathematicians and electrical engineers with the aim of developing the theoretical foundations of deep learning, particularly the aspects of this methodology that are very different from classical statistical approaches. The cluster is supported by the NSF/Simons Foundation Collaboration on the Theoretical Foundations of Deep Learning, which aims to understand the mathematical mechanisms that underpin the practical success of deep learning, both to elucidate the limitations of deep learning methods and to allow their extension beyond the domains where they are currently applicable, and to initiate the study of the mathematical problems that emerge. Specific objectives of the cluster include understanding: the role of overparametrization in efficient optimization, mechanisms by which interpolation with implicit regularization enables generalization; and how compositionality confers representational richness.

This cluster is supported by the NSF through grant DMS-2031883 and the Simons Foundation through award #814639.


 

Organizers:

Peter Bartlett (UC Berkeley), Misha Belkin (UCSD), Nati Srebro (Toyota Technological Institute at Chicago), Bin Yu (UC Berkeley)

Long-Term Participants (including Organizers):

Peter Bartlett (UC Berkeley), Misha Belkin (UCSD), Jason Lee (Princeton University), Sasha Rakhlin (Massachusetts Institute of Technology), Saeed Saremi (NNAISENSE & UC Berkeley), Nati Srebro (Toyota Technological Institute at Chicago), Nike Sun (Massachusetts Institute of Technology), Matus Telgarsky (University of Illinois, Urbana-Champaign), Ryan Tibshirani (UC Berkeley), Bin Yu (UC Berkeley), Yizhe Zhu (University of California Irvine)

Visiting Graduate Students and Postdocs:

Amirhesam Abedsoltan (UCSD), Raphaël Berthier (École Polytéchnique Fédérale de Lausanne (EPFL)), Saptarshi Chakraborty (UC Berkeley), Luiz Fernando de Oliveira Chamon (UC Berkeley), Zongchen Chen (Massachusetts Institute of Technology), Spencer Frei (UC Berkeley), Wei Hu (UC Berkeley), Like Hui (UC San Diego), Nirmit Joshi (Northwestern University), Yin-Ting Liao (Brown University), Neil Mallinar (UCSD), Pierre Marion (École Polytechnique/Sorbonne University), Zak Mhammedi (Massachusetts Institute of Technology), Omar Montasser (TTI Chicago), Preetum Nakkiran (Apple & UC San Diego), Parthe Pandit (UC San Diego), Youngtak Sohn (Massachusetts Institute of Technology), Gal Vardi (TTI Chicago & Hebrew University), Austin Zane (UC Berkeley), Yiqiao Zhong (Stanford University)

Workshops

Aug. 1Aug. 5, 2022

Organizers:

Nati Srebro (Toyota Technological Institute at Chicago; chair), Spencer Frei (UC Berkeley), Suriya Gunasekar (Toyota Technological Institute at Chicago), Preetum Nakkiran (Apple & UC San Diego), Youngtak Sohn (Massachusetts Institute of Technology)

Participation in this summer cluster is by invitation only.

Past Internal Program Activities

Thursday, July 28th 2:00 pm3:00 pm
Coordinated by Yizhe Zhu
Wednesday, July 27th 1:30 pm3:00 pm
Coordinated by Raphaël Berthier.
Tuesday, July 26th 3:30 pm5:00 pm
Coordinated by Parthe Pandit
Thursday, July 21st 2:00 pm3:00 pm
Coordinated by Yizhe Zhu
Wednesday, July 20th 1:30 pm3:00 pm
Coordinated by Raphaël Berthier.
Tuesday, July 19th 3:30 pm5:00 pm
Coordinated by Parthe Pandit
Friday, July 15th 2:30 pm4:00 pm
Coordinated by Parthe Pandit