This concise, self-contained volume introduces convex analysis and optimization algorithms, with an emphasis on bridging the two areas. It explores cutting-edge algorithms--such as the proximal gradient, Douglas-Rachford, Peaceman-Rachford, and FISTA--that have applications in machine learning, signal processing, image reconstruction, and other ......
Theory, Algorithms, and Applications with Python and MATLAB
Built on the framework of the successful first edition, this book serves as a modern introduction to the field of optimization. The author's objective is to provide the foundations of theory and algorithms of nonlinear optimization as well as to present a variety of applications from diverse areas of applied sciences. Introduction to Nonlinear ......
Moment and polynomial optimization is an active research field used to solve difficult questions in many areas, including global optimization, tensor computation, saddle points, Nash equilibrium, and bilevel programs, and it has many applications. The author synthesizes current research and applications, providing a systematic introduction to ......
Extremum Seeking through Delays and PDEs, the first book on the topic, expands the scope of applicability of the extremum seeking method, from static and finite-dimensional systems to infinite-dimensional systems. Readers will find: Numerous algorithms for model-free real-time optimization are developed and their convergence guaranteed. ......
Optimization is presented in most multivariable calculus courses as an application of the gradient, and while this treatment makes sense for a calculus course, there is much more to the theory of optimization. Optimization problems are generated constantly, and the theory of optimization has grown and developed in response to the challenges ......
Designed for a proof-based course on linear algebra, this rigorous and concise textbook intentionally introduces vector spaces, inner products, and vector and matrix norms before Gaussian elimination and eigenvalues so students can quickly discover the singular value decomposition (SVD)-arguably the most enlightening and useful of all matrix ......
Composites have been studied for more than 150 years, and interest in their properties has been growing. This classic volume provides the foundations for understanding a broad range of composite properties, including electrical, magnetic, electromagnetic, elastic and viscoelastic, piezoelectric, thermal, fluid flow through porous materials, ......
Adopting a variational approach, this self-contained textbook presents the basic principles of optimal control governed by ODEs. Inside, readers will encounter the fundamental issues of existence of optimal solutions, optimality conditions, and numerical approximation from a variational perspective, academic and real-world examples testing the ......
One of the most popular ways to assess the "effort" needed to solve a problem is to count how many evaluations of the problem functions (and their derivatives) are required. In many cases, this is often the dominating computational cost. Given an optimization problem satisfying reasonable assumptions-and given access to problem-function values and ......