Suchergebnisse

AbstractWe consider the problem of tracking an unknown time varying parameter that characterizes the probabilistic evolution of a sequence of independent observations. To this aim, we propose a stochastic gradient descent-based recursive scheme in which the log-likelihood of the observations acts as time varying gain function. We prove convergence in mean-square error in a suitable neighbourhood of the unknown time varying parameter and illustrate the details of our findings in the case where data are generated from distributions belonging to the exponential family.

The restricted maximum likelihood is preferred by many to the full maximum likelihood for estimation with variance component and other random coefficient models, because the variance estimator is unbiased. It is shown that this unbiasedness is accompanied in some balanced designs by an inflation of the mean squared error. An estimator of the cluster‐level variance that is uniformly more efficient than the full maximum likelihood is derived. Estimators of the variance ratio are also studied.

386 393 30 7 ; S ; Maximum likelihood principal component analysis (MLPCA) was originally proposed to incorporate measurement error variance information in principal component analysis (PCA) models. MLPCA can be used to fit PCA models in the presence of missing data, simply by assigning very large variances to the non-measured values. An assessment of maximum likelihood missing data imputation is performed in this paper, analysing the algorithm of MLPCA and adapting several methods for PCA model building with missing data to its maximum likelihood version. In this way, known data regression (KDR), KDR with principal component regression (PCR), KDR with partial least squares regression (PLS) and trimmed scores regression (TSR) methods are implemented within the MLPCA method to work as different imputation steps. Six data sets are analysed using several percentages of missing data, comparing the performance of the original algorithm, and its adapted regression-based methods, with other state-of-the-art methods. Research in this study was partially supported by the Spanish Ministry of Science and Innovation and FEDER funds from the European Union through grant DPI2011-28112-C04-02 and DPI2014-55276-C5-1R, and the Spanish Ministry of Economy and Competitiveness through grant ECO2013-43353-R. Folch Fortuny, A.; Arteaga Moreno, FJ.; Ferrer, A. (2016). Assessment of maximum likelihood PCA missing data imputation. Journal of Chemometrics. 30(7):386-393. https://doi.org/10.1002/cem.2804

"For the Atomic Energy Commission under U.S. government contract No. W7405 eng 26."--Cover. ; "Date of issue: May 19, 1965 ; Report Number: K-1633 ; Subject category: Mathematics and Computers ; TID-4500 (39th Ed.)." ; Includes bibliographical references (p. 17). ; Mode of access: Internet.

For a balanced two‐way mixed model, the maximum likelihood (ML) and restricted ML (REML) estimators of the variance components were obtained and compared under the non‐negativity requirements of the variance components by Lee and Kapadia (1984). In this note, for a mixed (random blocks) incomplete block model, explicit forms for the REML estimators of variance components are obtained. They are always non‐negative and have smaller mean squared error (MSE) than the analysis of variance (AOV) estimators. The asymptotic sampling variances of the maximum likelihood (ML) estimators and the REML estimators are compared and the balanced incomplete block design (BIBD) is considered as a special case. The ML estimators are shown to have smaller asymptotic variances than the REML estimators, but a numerical result in the randomized complete block design (RCBD) demonstrated that the performances of the REML and ML estimators are not much different in the MSE sense.

AbstractIn this article, a Stein-type weighted limited information maximum likelihood (LIML) estimator is proposed. It is based on a weighted average of the ordinary least squares (OLS) and LIML estimators, with weights inversely proportional to the Hausman test statistic. The asymptotic distribution of the proposed estimator is derived by means of local-to-exogenous asymptotic theory. In addition, the asymptotic risk of the Stein-type LIML estimator is calculated, and it is shown that the risk is strictly smaller than the risk of the LIML under certain conditions. A Monte Carlo simulation and an empirical application of a green patent dataset from Nordic countries are used to demonstrate the superiority of the Stein-type LIML estimator to the OLS, two-stage least squares, LIML and combined estimators when the number of instruments is large.

Balancing problems in national accounts and similar applications may be addressed by optimization methods that aim to maximize preservation of specific characteristics of the unadjusted data, for example, levels or time‐series movements. However, published methods do not always indicate the assumptions that underpin these methods, making it hard to identify when those assumptions might be violated or how to generalize them to complex cases. Previous authors have observed that least‐squares estimation methods correspond to maximum likelihood estimation (MLE) under normality assumptions. This paper explores this relationship in the context of published "movement preservation"/"level preservation" methods, showing how the MLE interpretation identifies implicit assumptions made by these methods and, hence, helps inform decisions about their use. It also notes a case where the MLE and "preservation" approaches diverge, and gives a framework for generalizing MLE approaches to complex scenarios.