Abstract: We conduct a simple asymptotic analysis of penalized likelihood regression for the analysis of data from exponential families. The convergence rates in terms of the integrated symmetrized Kullback-Leibler distance and a related mean square error are obtained.
Key words and phrases: Penalized likelihood, rate of convergence, smoothness, symmetrized Kullback-Leibler distance.