This book provides a complete discussion of the Gauss-Newton filters, including all necessary theoretical background. This book also covers the expanding and fading memory polynomial filters based on the Legendre and Laguerre orthogonal polynomials, and how these can serve as pre-filters for Gauss-Newton.