A new approach to description, definition of stability, approximation and regularization for a wide class of problems of approximate solutions search is presented. The relationships of the introduced concepts and their relationship with the classical definitions of continuity and regularization are investigated. Methods for constructing regularizing problems are indicated. Much attention is paid to the application of a developed approach to solving a system of inequalities, a mathematical programming problem, maximal problems, and multi-criteria problems.