一、課程說明(Course Description)

Numerical optimization concerns the computations of the maximum (or the
minimum) of differentiable functions which can have one or several variables,
with or without constraints. Important classes in the numerical optimization
problems include linear programming, unconstrained optimization, and nonlinear
programming. This course will study the numerical algorithms and the
theoretical background for each problem. Applications that motivate the
computation will be mentioned as well.

二、指定用書(Text Books)

J. Nocedal and S. Wright, Numerical Optimization, Springer Verlag 1999

三、參考書籍(References)
1. Stephen G. Nash and Ariela Sofer, Linear and Nonlinear Programming, 1996
2. J. Dennis and R. Schnabel, Numerical Methods for Unconstrained Optimization
and Nonlinear Equations, (republished by) SIAM (Classics in Applied Mathematics
16) 1996

四、教學方式(Teaching Method)
Most of time will be lecturing.
Project and paper presentation will be held if time permit.


五、教學進度(Syllabus)
1. Introduction.
2. Linear programming
2.1. Geometry interpretation and properties
2.2. The simplex method
2.3. Duality, sensitivity, and complexity
2.4. Practical concerns
3. Unconstrained optimization
3.1. Optimality condition
3.2. Newton’s method
3.3. Line search method
3.4. Trust-Region method
3.5. Practical concerns
4. Constrained programming
4.1. Lagrange multiplier and KKT conditions.
4.2. Feasible direction method
4.3. Penalty and Augmented Lagrange method.
4.4. Interior point methods

六、成績考核(Evaluation)
1. Class notes (50)
2. Project (50)

七、可連結之網頁位址
http://www-unix.mcs.anl.gov/otc/Guide/faq/linear-programming-faq.html
http://www-unix.mcs.anl.gov/otc/Guide/faq/nonlinear-programming-faq.html