We study asymptotic stability of the optimal filter with respect to its initial conditions. We show that exponential stability of the nonlinear filter holds for a large class of denumerable Markov chains, including all finite Markov chains, under the assumption that the observation function is one-to-one and the observation noise is sufficiently small. Ergodicity of the signal process is not assumed.