Please mark your calendars for the following upcoming talk in the series:

When: August 21, 7-8 AM PT (10-11 AM ET,  2-3 PM GMT, 4-5 PM CEST, 10-11 PM Singapore Time)
Speaker: Katya Scheinberg
Title: Complexity analysis framework of adaptive optimization methods via martingales


We will present a very general framework for unconstrained adaptive optimization which encompasses standard  methods such as line search and trust region that use stochastic function measurements and derivatives. In particular, methods that fall in this framework retain  desirable practical features such as step acceptance criterion, trust region adjustment and ability to utilize second order models and enjoy the same convergence rates as their deterministic counterparts. The assumptions on stochastic derivatives  are weaker than those standard in the literature, in that they are robust with respect to the presence of outliers. The framework is based on bounding the expected stopping time of a stochastic process, which satisfies certain assumptions. Thus this framework provides strong convergence analysis  under weaker conditions than alternative approaches in the literature. We will conclude with  a discussion about some interesting open questions.


Katya Scheinberg is a Professor and Director of Graduate Studies at the School of Operations Research and Information Engineering at Cornell University. Prior to joining Cornell she was the Harvey E. Wagner Endowed Chair Professor at the Industrial and Systems Engineering Department at Lehigh University. She attended Moscow University for her undergraduate studies and received her PhD degree from Columbia University. She has worked at the IBM T.J. Watson Research Center as a research staff member for over a decade before joining Lehigh in 2010. Katya’s main research areas are related to developing practical algorithms (and their theoretical analysis) for various problems in continuous optimization, such as convex optimization, derivative free optimization, machine learning, quadratic programming, etc. In 2015, jointly with Andy Conn and Luis Vicente, she received the Lagrange Prize awarded jointly by SIAM and MOS. In 2019 she was awarded the Farkas Prize by Informs Optimization Society. Katya is currently the editor-in-chief of Mathematics of Operations Research, and a co-editor of Mathematical Programming.

The Webinars will be delivered and recorded via Zoom.  A few days before the webinar we will send you the Zoom-link. If you are interested in participating to the Webinars, please sign up here: