Back to search

University of North Texas

A Comparative Study of Non Linear Conjugate Gradient Methods

Abstract

dc:description

We study the development of nonlinear conjugate gradient methods, Fletcher Reeves (FR) and Polak Ribiere (PR). FR extends the linear conjugate gradient method to nonlinear functions by incorporating two changes, for the step length αk a line search is performed and replacing the residual, rk (rk=b-Axk) by the gradient of the nonlinear objective function. The PR method is equivalent to FR method for exact line searches and when the underlying quadratic function is strongly convex. The PR method is basically a variant of FR and primarily differs from it in the choice of the parameter βk. On applying the nonlinear Rosenbrock function to the MATLAB code for the FR and the PR algorithms we observe that the performance of PR method (k=29) is far better than the FR method (k=42). But, we observe that when the MATLAB codes are applied to general nonlinear functions, specifically functions whose minimum is a large negative number not close to zero and the iterates too are large values far off from zero the PR algorithm does not perform well. This problem with the PR method persists even if we run the PR algorithm for more iterations or with an initial guess closer to the actual minimum. To improve the PR algorithm we suggest finding a better weighing parameter βk, using better line search method and/or using specific line search for certain functions and identifying specific restart criteria based on the function to be optimized.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2013

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Pathak, Subrat
Contributors dc:contributor
  • Liu, Jianguo
  • Iaia, Joseph
  • Song, Kai-Sheng

Subjects

dc:subject × 4

Rights

dc:rights
Statement dc:rights
  • Public
  • Pathak, Subrat
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
https://digital.library.unt.edu/ark:/67531/metadc283864/
ark: ark:/67531/metadc283864

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Pathak, Subrat. A Comparative Study of Non Linear Conjugate Gradient Methods. University of North Texas, 2013. https://doi.org/10.12794/metadc283864