Learning Fast Requires Good Memory: Time-Space Tradeoff Lower Bounds for Learning
- Speaker
-
Ran Raz, Ph.D.Professor, Theoretical Computer Science, Princeton University
Weizmann Institute of Science
Presidential Lectures are free public colloquia centered on four main themes: Biology, Physics, Mathematics and Computer Science, and Neuroscience and Autism Science. These curated, high-level scientific talks feature leading scientists and mathematicians and are intended to foster discourse and drive discovery among the broader NYC-area research community. We invite those interested in the topic to join us for this weekly lecture series.
Can one prove unconditional lower bounds on the number of samples needed for learning, under memory constraints? A recent line of works shows that for a large class of learning problems, any learning algorithm requires either a memory of super-linear size or a super-polynomial number of samples. For example, any algorithm for learning parities of size n, from a stream of samples, requires either a memory of quadratic size or an exponential number of samples.
A main message of these works is that for some learning problems, access to a relatively large memory is crucial. Ran Raz will tell about some of these works and discuss relations to computational complexity and applications in bounded-storage cryptography.
About the Speaker
Raz is a professor of theoretical computer science at Princeton University. He received his B.Sc. in mathematics and physics in 1987 and his Ph.D. in mathematics in 1992 from the Hebrew University of Jerusalem. After spending two years as a postdoc at Princeton University, in 1994 he joined the Weizmann Institute of Science in Israel. He was a visiting professor at Microsoft Research (2006, 2009) and the Institute for Advanced Study (2012–2016). Raz’s main research area is computational complexity theory, with a focus on proving lower bounds for computational models.