Hostname: page-component-6bf8c574d5-vmclg Total loading time: 0 Render date: 2025-02-15T17:50:08.264Z Has data issue: false hasContentIssue false
  • English
  • Français

Discrete mechanics and optimal control: An analysis*

Published online by Cambridge University Press:  31 March 2010

Sina Ober-Blöbaum ,
Oliver Junge  and
Jerrold E. Marsden
Sina Ober-Blöbaum
Affiliation:
Department of Mathematics, Faculty of Electrical Engineering, Computer Science and Mathematics, University of Paderborn, 33098 Paderborn, Germany. [email protected]
Oliver Junge
Affiliation:
Zentrum Mathematik, Technische Universität München, 85747 Garching, Germany. [email protected]
Jerrold E. Marsden
Affiliation:
Control and Dynamical Systems, California Institute of Technology 107-81, Pasadena, CA 91125, USA. [email protected]
Get access

Abstract

The optimal control of a mechanical system is of crucial importance in many application areas. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion sequences in robotics and biomechanics. In most cases, some sort of discretization of the original, infinite-dimensional optimization problem has to be performed in order to make the problem amenable to computations. The approach proposed in this paper is to directly discretize the variational description of the system's motion. The resulting optimization algorithm lets the discrete solution directly inherit characteristic structural properties from the continuous one like symmetries and integrals of the motion. We show that the DMOC (Discrete Mechanics and Optimal Control) approach is equivalent to a finite difference discretization of Hamilton's equations by a symplectic partitioned Runge-Kutta scheme and employ this fact in order to give a proof of convergence. The numerical performance of DMOC and its relationship to other existing optimal control methods are investigated.

Keywords

Optimal controldiscrete mechanicsdiscrete variational principleconvergence
Type
Research Article
Information
ESAIM: Control, Optimisation and Calculus of Variations , Volume 17 , Issue 2 , April 2011 , pp. 322 - 352
Copyright
© EDP Sciences, SMAI, 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ascher, U., Christiansen, J. and Russell, R.D., A collocation solver for mixed order systems of boundary value problems. Math. Comput. 33 (1979) 659–679. CrossRef
V. Bär, Ein Kollokationsverfahren zur numerischen Lösung allgemeiner Mehrpunktrandwertaufgaben mit Schalt- und Sprungbedingungen mit Anwendungen in der Optimalen Steuerung und der Parameteridentifizierung. Diploma Thesis, Bonn, Germany (1983).
Betts, J.T., Survey of numerical methods for trajectory optimization. AIAA J. Guid. Control Dyn. 21 (1998) 193–207. CrossRef
Betts, J.T. and Huffmann, W.P., Mesh refinement in direct transcription methods for optimal control. Optim. Control Appl. Meth. 19 (1998) 1–21. 3.0.CO;2-Q>CrossRef
Bobenko, A.I. and Suris, Y.B., Discrete Lagrangian reduction, discrete Euler-Poincaré equations, and semidirect products. Lett. Math. Phys. 49 (1999) 79–93. CrossRef
Bobenko, A.I. and Suris, Y.B., Discrete time Lagrangian mechanics on Lie groups, with an application to the Lagrange top. Comm. Math. Phys. 204 (1999) 147–188. CrossRef
Bock, H.G., Numerical solutions of nonlinear multipoint boundary value problems with applications to optimal control. Z. Angew. Math. Mech. 58 (1978) T407–T409.
H.G. Bock and K.J. Plitt, A multiple shooting algorithm for direct solution of optimal control problems, in 9th IFAC World Congress, Budapest, Hungary, Pergamon Press (1984) 242–247.
Bonnans, J.F. and Laurent-Varin, J., Computation of order conditions for symplectic partitioned Runge-Kutta schemes with application to optimal control. Numer. Math. 103 (2006) 1–10. CrossRef
Bou-Rabee, N. and Owhadi, H., Stochastic variational integrators. IMA J. Numer. Anal. 29 (2008) 421–443. CrossRef
A.E. Bryson and Y.C. Ho, Applied Optimal Control. Hemisphere (1975).
R. Bulirsch, Die Mehrzielmethode zur numerischen Lösung von nichtlinearen Randwertproblemen und Aufgaben der optimalen Steuerung. Report of the Carl-Cranz-Gesellschaft e.V., DLR, Oberpfaffenhofen, Germany (1971).
Büskens, C. and Maurer, H., SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control. J. Comput. Appl. Math. 120 (2000) 85–108. CrossRef
Cadzow, J.A., Discrete calculus of variations. Int. J. Control 11 (1970) 393–407. CrossRef
J.A. Cadzow, Discrete-Time Systems: An Introduction With Interdisciplinary Applications. Prentice-Hall (1973).
Cauchy, A.L., Méthode générale pour la résolution des systèmes d'équations simultanées. C. R. Acad. Sci. 25 (1847) 536–538.
Chernousko, F.L. and Luybushin, A.A., Method of successive approximations for optimal control problems (survey paper). Opt. Control Appl. Meth. 3 (1982) 101–114. CrossRef
Deuflhard, P., A modified Newton method for the solution of ill-conditioned systems of nonlinear equations with application to multiple shooting. Numer. Math. 22 (1974) 289–315. CrossRef
Dickmanns, E.D. and Well, K.H., Approximate solution of optimal control problems using third order hermite polynomial functions. Lect. Notes Comput. Sci. 27 (1975) 158–166. CrossRef
A.L. Dontchev and W.W. Hager, The Euler Approximation in State Constrained Optimal Control, in Mathematics of Computation 70, American Mathematical Society, USA (2001) 173–203.
Dontchev, A.L., Hager, W.W. and Veliov, V.M., Second order Runge-Kutta approximations in control constrained optimal control. SIAM J. Numer. Anal. 38 (2000) 202–226. CrossRef
Fetecau, R.C., Marsden, J.E., Ortiz, M. and West, M., Nonsmooth Lagrangian mechanics and variational collision integrators. SIAM J. Appl. Dyn. Syst. 2 (2003) 381–416. CrossRef
L. Flatto, Advanced calculus. Williams & Wilkins (1976).
L. Fox, Some numerical experiments with eigenvalue problems in ordinary differential equations, in Boundary value problems in differential equations, R.E. Langer Ed. (1960).
Frazzoli, E., Dahleh, M.A. and Feron, E., Maneuver-based motion planning for nonlinear systems with symmetries. IEEE Trans. Robot. 21 (2005) 1077–1091. CrossRef
A. Griewank, Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. SIAM (2000).
W.W. Hager, Convex control and dual approximations, in Constructive Approaches to Mathematical Models, Academic Press, New York, USA (1979) 189–202.
Hager, W.W., Runge-Kutta methods in optimal control and the transformed adjoint system. Numer. Math. 87 (2000) 247–282. CrossRef
W.W. Hager, Numerical analysis in optimal control, in International Series of Numerical Mathematics 139, Birkhäuser Verlag, Basel, Switzerland (2001) 83–93.
E. Hairer, C. Lubich and G. Wanner, Geometric numerical integration. Springer (2002).
Han, S.P., Superlinearly convergent variable-metric algorithms for general nonlinear programming problems. Math. Program. 11 (1976) 263–282. CrossRef
P. Hiltmann, Numerische Lösung von Mehrpunkt-Randwertproblemen und Aufgaben der optimalen Steuerung über endlichdimensionalen Räumen. Ph.D. Thesis, Fakultät für Mathematik und Informatik, Technische Universität München, Germany (1990).
Hwang, C.L. and Fan, L.T., A discrete version of Pontryagin's maximum principle. Oper. Res. 15 (1967) 139–146. CrossRef
Jordan, B.W. and Polak, E., Theory of a class of discrete optimal control systems. J. Elec. Ctrl. 17 (1964) 697–711.
O. Junge and S. Ober-Blöbaum, Optimal reconfiguration of formation flying satellites, in IEEE Conference on Decision and Control and European Control Conference ECC, Seville, Spain (2005).
O. Junge, J.E. Marsden and S. Ober-Blöbaum, Discrete mechanics and optimal control, in 16th IFAC World Congress, Prague, Czech Republic (2005).
O. Junge, J.E. Marsden and S. Ober-Blöbaum, Optimal reconfiguration of formation flying spacecraft - a decentralized approach, in IEEE Conference on Decision and Control and European Control Conference ECC, San Diego, USA (2006) 5210–5215.
Kane, C., Marsden, J.E. and Ortiz, M., Symplectic energy-momentum integrators. Math. Phys. 40 (1999) 3353–3371. CrossRef
Kane, C., Marsden, J.E., Ortiz, M. and West, M., Variational integrators and the Newmark algorithm for conservative and dissipative mechanical systems. Int. J. Numer. Meth. Eng. 49 (2000) 1295–1325. 3.0.CO;2-W>CrossRef
E. Kanso and J.E. Marsden, Optimal motion of an articulated body in a perfect fluid, in IEEE Conference on Decision and Control and European Control Conference ECC, Seville, Spain (2005).
W. Karush, Minima of functions of several variables with inequalities as side constraints. Master's thesis, Department of Mathematics, University of Chicago, USA (1939).
H.B. Keller, Numerical methods for two-point boundary value problems. Blaisdell, Waltham, USA (1968).
Kelley, H.J., Gradient theory of optimal flight paths. Journal of the American Rocket Society 30 (1960) 947–953.
L. Kharevych, P. Mullen, S. Leyendecker, Y. Tong, J.E. Marsden and M. Desbrun, Robust time-adaptive integrators for computer animation (in preparation).
M. Kobilarov, Discrete geometric motion control of autonomous vehicles. Ph.D. Thesis, University of Southern California, USA (2008).
M. Kobilarov and G.S. Sukhatme, Optimal control using nonholonomic integrators, in IEEE International Conference on Robotics and Automation (ICRA), Rome, Italy (2007) 1832–1837.
Kobilarov, M., Desbrun, M., Marsden, J.E. and Sukhatme, G.S., A discrete geometric optimal control framework for systems with symmetries. Robotics: Science and Systems 3 (2007) 1–8.
D. Kraft, On converting optimal control problems into nonlinear programming problems, in Computational Mathematical Programming F15 of NATO ASI series, K. Schittkowsky Ed., Springer (1985) 261–280.
H.W. Kuhn and A.W. Tucker, Nonlinear programming, in Proceedings of the Second Berkeley Symposium on Mathematical Statisics and Probability, J. Neyman Ed., University of California Press, Berkeley, USA (1951).
Lee, T.D., Can time be a discrete dynamical variable? Phys. Lett. B 121 (1983) 217–220. CrossRef
Lee, T.D., Difference equations and conservation laws. J. Stat. Phys. 46 (1987) 843–860. CrossRef
T. Lee, N.H. McClamroch and M. Leok, Attitude maneuvers of a rigid spacecraft in a circular orbit, in American Control Conference, Minneapolis, USA (2006) 1742–1747.
T. Lee, N.H. McClamroch and M. Leok, Optimal control of a rigid body using geometrically exact computations on SE(3), in IEEE CDC and ECC, San Diego, USA (2006) 2710–2715.
D.B. Leineweber, Efficient reduced SQP methods for the optimization of chemical processes described by large sparse DAE models, in Fortschr.-Bericht VDI Reihe 3, Verfahrenstechnik 613, VDI-Verlag (1999).
Lew, A., Marsden, J.E., Ortiz, M. and West, M., Asynchronous variational integrators. Arch. Ration. Mech. Anal. 167 (2003) 85–146. CrossRef
S. Leyendecker, S. Ober-Blöbaum, J.E. Marsden and M. Ortiz, Discrete mechanics and optimal control for constrained multibody dynamics, in 6th International Conference on Multibody Systems, Nonlinear Dynamics, and Control, ASME International Design Engineering Technical Conferences, Las Vegas, USA (2007).
S. Leyendecker, S. Ober-Blöbaum and J.E. Marsden, Discrete mechanics and optimal control for constrained systems. Optim. Contr. Appl. Meth. (2009) DOI: 10.1002/oca.912.
Logan, J.D., First integrals in the discrete calculus of variation. Aequ. Math. 9 (1973) 210–220. CrossRef
R. MacKay, Some aspects of the dynamics of Hamiltonian systems, in The dynamics of numerics and the numerics of dynamics, D.S. Broomhead and A. Iserles Eds., Clarendon Press, Oxford, UK (1992) 137–193.
Maeda, S., Canonical structure and symmetries for discrete systems. Math. Jap. 25 (1980) 405–420.
Maeda, S., Extension of discrete Noether theorem. Math. Jap. 26 (1981) 85–90.
Maeda, S., Lagrangian formulation of discrete systems and concept of difference space. Math. Jap. 27 (1981) 345–356.
Marsden, J.E. and Shkoller, S., Multisymplectic geometry, covariant Hamiltonians, and water waves. Math. Proc. Camb. Phil. Soc. 125 (1999) 553–575. CrossRef
Marsden, J.E. and West, M., Discrete mechanics and variational integrators. Acta Numer. 10 (2001) 357–514. CrossRef
Marsden, J.E., Patrick, G.W. and Shkoller, S., Multisymplectic geometry, variational integrators, and nonlinear PDEs. Commun. Math. Phys. 199 (1998) 351–395. CrossRef
Marsden, J.E., Pekarsky, S. and Shkoller, S., Discrete Euler-Poincaré and Lie Poisson equations. Nonlinearity 12 (1999) 1647-1662. CrossRef
Marsden, J.E., Pekarsky, S. and Shkoller, S., Symmetry reduction of discrete Lagrangian mechanics on Lie groups. Geometry and Physics 36 (1999) 140–151. CrossRef
J. Martin, Discrete mechanics and optimal control. Master's Thesis, Department of Control and Dynamical Systems, California Institute of Technology, USA (2006).
R.I. McLachlan and S. Marsland, Discrete mechanics and optimal control for image registration, in Computational Techniques and Applications Conference (CTAC) (2006).
A. Miele, Gradient algorithms for the optimization of dynamic systems, in Control and Dynamic Systems 60, C.T. Leondes Ed. (1980) 1–52.
S. Ober-Blöbaum, Discrete mechanics and optimal control. Ph.D. Thesis, University of Paderborn, Germany (2008).
Patrick, G.W. and Cuell, C., Error analysis of variational integrators of unconstrained lagrangian systems. Numer. Math. 113 (2009) 243–264. CrossRef
D. Pekarek, A.D. Ames and J.E. Marsden, Discrete mechanics and optimal control applied to the compass gait biped, in IEEE Conference on Decision and Control and European Control Conference ECC, New Orleans, USA (2007).
L.S. Pontryagin, V.G. Boltyanski, R.V. Gamkrelidze and E.F. Miscenko, The mathematical theory of optimal processes. John Wiley & Sons (1962).
M.J.D. Powell, A fast algorithm for nonlinearly constrained optimization calculations, in Numerical Analysis Lecture Notes in Mathematics 630, G.A. Watson Ed., Springer (1978) 261–280.
R. Pytlak, Numerical methods for optimal control problems with state constraints. Springer (1999).
L.B. Rall, Automatic Differentiation: Techniques and Applications, Lect. Notes Comput. Sci. 120. Springer Verlag, Berlin, Germany (1981).
S.D. Ross, Optimal flapping strokes for self-propulsion in a perfect fluid, in American Control Conference, Minneapolis, USA (2006) 4118–4122.
B. Sendov and V.A. Popov, The averaged moduli of smoothness. John Wiley (1988).
Suris, Y.B., Hamiltonian methods of Runge-Kutta type and their variational interpretation. Math. Model. 2 (1990) 78–87.
H. Tolle, Optimization methods. Springer (1975).
O. von Stryk, Numerical solution of optimal control problems by direct collocation, in Optimal Control - Calculus of Variation, Optimal Control Theory and Numerical Methods, R. Bulirsch, A. Miele, J. Stoer and K.H. Well Eds., International Series of Numerical Mathematics 111, Birkhäuser (1993) 129–143.
O. von Stryk, Numerical hybrid optimal control and related topics. Habilitation Thesis, TU München, Germany (2000).
Walther, A., Kowarz, A. and Griewank, A., ADOL-C: a package for the automatic differentiation of algorithms written in C/C++. ACM TOMS 22 (1996) 131–167.
Wendlandt, J.M. and Marsden, J.E., Mechanical integrators derived from a discrete variational principle. Physica D 106 (1997) 223–246. CrossRef
J.M. Wendlandt and J.E. Marsden, Mechanical systems with symmetry, variational principles and integration algorithms, in Current and Future Directions in Applied Mathematics, M. Alber, B. Hu and J. Rosenthal Eds., Birkhäuser (1997) 219–261.
Wengert, R.E., A simple automatic derivative evaluation program. Commun. ACM 7 (1964) 463–464. CrossRef