Consider the partly linear regression model , where y i ’s are responses, are known and nonrandom design points, is a compact set in the real line , β = (β 1, ··· , β p )' is an unknown parameter vector, g(·) is an unknown function and {ε i } is a linear process, i.e., , where e j are i.i.d. random variables with zero mean and variance . Drawing upon B-spline estimation of g(·) and least squares estimation of β, we construct estimators of the autocovariances of {ε i }. The uniform strong convergence rate of these estimators to their true values is then established. These results not only are a compensation for those of [23], but also have some application in modeling error structure. When the errors {ε i } are an ARMA process, our result can be used to develop a consistent procedure for determining the order of the ARMA process and identifying the non-zero coeffcients of the process. Moreover, our result can be used to construct the asymptotically effcient estimators for parameters in the ARMA error process.