Skip to content

Commit 098ce0c

Browse files
Merge pull request #78 from LearningToOptimize/class02-overview-update
Class 2: update overview.md
2 parents 3e473c8 + c131260 commit 098ce0c

File tree

1 file changed

+8
-58
lines changed

1 file changed

+8
-58
lines changed

class02/overview.md

Lines changed: 8 additions & 58 deletions
Original file line numberDiff line numberDiff line change
@@ -4,39 +4,20 @@
44

55
**Topic:** Numerical optimization for control (gradient/SQP/QP); ALM vs. interior-point vs. penalty methods
66

7-
**Pluto Notebook for all the chapter**: Here is the actual [final chapter](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/class02.html)
8-
97
---
108

119
## Overview
1210

1311
This class covers the fundamental numerical optimization techniques essential for optimal control problems. We explore gradient-based methods, Sequential Quadratic Programming (SQP), and various approaches to handling constraints including Augmented Lagrangian Methods (ALM), interior-point methods, and penalty methods.
1412

15-
## Learning Objectives
16-
17-
By the end of this class, students will be able to:
18-
19-
- Understand the mathematical foundations of gradient-based optimization
20-
- Implement Newton's method for unconstrained minimization
21-
- Apply root-finding techniques for implicit integration schemes
22-
- Solve equality-constrained optimization problems using Lagrange multipliers
23-
- Compare and contrast different constraint handling methods (ALM, interior-point, penalty)
24-
- Implement Sequential Quadratic Programming (SQP) for nonlinear optimization
25-
26-
## Prerequisites
2713

28-
- Solid understanding of linear algebra and calculus
29-
- Familiarity with Julia programming
30-
- Basic knowledge of differential equations
31-
- Understanding of optimization concepts from Class 1
14+
The slides for this lecture can be found here [Lecture Slides (PDF)](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/ISYE_8803___Lecture_2___Slides.pdf)
3215

33-
## Materials
34-
35-
### Interactive Notebooks
36-
37-
The class is structured around four interactive Jupyter notebooks that build upon each other:
16+
The Pluto julia notebook for my final chapter can be found here [final chapter](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/class02.html)
3817

18+
Although the main code for the julia demo's are contained in the Pluto notebook above, the following julia notebooks are the demo's I used in the class recording/presentation.
3919

20+
4021
1. **[Part 1a: Root Finding & Backward Euler](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/part1_root_finding.html)**
4122
- Root-finding algorithms for implicit integration
4223
- Fixed-point iteration vs. Newton's method
@@ -48,49 +29,18 @@ The class is structured around four interactive Jupyter notebooks that build upo
4829
- Unconstrained optimization fundamentals
4930
- Newton's method for minimization
5031
- Hessian matrix and positive definiteness
51-
- Regularization and line search techniques
52-
- Practical implementation with Julia
32+
- Regularization and line search techniques
5333

5434
3. **[Part 2: Equality Constraints](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/part2_eq_constraints.html)**
5535
- Lagrange multiplier theory
5636
- KKT conditions for equality constraints
57-
- Quadratic programming with equality constraints
58-
- Visualization of constrained optimization landscapes
59-
- Practical implementation examples
37+
- Quadratic programming with equality constraints
6038

6139
4. **[Part 3: Interior-Point Methods](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/part3_ipm.html)**
6240
- Inequality constraint handling
6341
- Barrier methods and log-barrier functions
64-
- Interior-point algorithm implementation
65-
- Comparison with penalty methods
66-
- Convergence properties and practical considerations
67-
68-
### Additional Resources
69-
70-
- **[Lecture Slides (PDF)](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/ISYE_8803___Lecture_2___Slides.pdf)** - Complete slide deck from the presentation
71-
- **[Demo Script](https://learningtooptimize.github.io/LearningToControlClass/dev/class02/penalty_barrier_demo.py)** - Python demonstration of penalty vs. barrier methods
72-
73-
## Key Concepts Covered
74-
75-
### Mathematical Foundations
76-
- **Gradient and Hessian**: Understanding first and second derivatives in optimization
77-
- **Newton's Method**: Quadratic convergence and implementation details
78-
- **KKT Conditions**: Necessary and sufficient conditions for optimality
79-
- **Duality Theory**: Lagrange multipliers and dual problems
80-
81-
### Numerical Methods
82-
- **Root Finding**: Fixed-point iteration, Newton-Raphson method
83-
- **Implicit Integration**: Backward Euler for stiff ODEs
84-
- **Sequential Quadratic Programming**: Local quadratic approximations
85-
- **Interior-Point Methods**: Barrier functions and path-following
86-
87-
### Constraint Handling
88-
- **Equality Constraints**: Lagrange multipliers and null-space methods
89-
- **Inequality Constraints**: Active set methods and interior-point approaches
90-
- **Penalty Methods**: Quadratic and exact penalty functions
91-
- **Augmented Lagrangian**: Combining penalty and multiplier methods
92-
93-
42+
- Interior-point algorithm implementation
43+
9444
---
9545

9646
*For questions or clarifications, please reach out to Arnaud Deza at adeza3@gatech.edu*

0 commit comments

Comments
 (0)