Higher-order reverse automatic differentiation with emphasis on the third-order

• 成果类型: Article
• 署名作者: Gower, R. M.; Gower, A. L.
• 署名单位: Heriot Watt University; University of Edinburgh; Ollscoil na Gaillimhe-University of Galway
• 刊物名称: MATHEMATICAL PROGRAMMING
• ISSN/ISSBN: 0025-5610
• DOI: 10.1007/s10107-014-0827-4
• 发表日期: 2016
• 页码: 81-103
• 关键词: computation; derivatives

摘要

It is commonly assumed that calculating third order information is too expensive for most applications. But we show that the directional derivative of the Hessian () can be calculated at a cost proportional to that of a state-of-the-art method for calculating the Hessian matrix. We do this by first presenting a simple procedure for designing high order reverse methods and applying it to deduce several methods including a reverse method that calculates . We have implemented this method taking into account symmetry and sparsity, and successfully calculated this derivative for functions with a million variables. These results indicate that the use of third order information in a general nonlinear solver, such as Halley-Chebyshev methods, could be a practical alternative to Newton's method. Furthermore, high-order sensitivity information is used in methods for robust aerodynamic design. An efficient high-order differentiation tool could facilitate the use of similar methods in the design of other mechanical structures.