Evaluating the Standard Error Estimation of the Local Structural-After-Measurement (LSAM) Approach in Structural Equation Modeling
Structural equation modeling (SEM) is extensively used in the social and behavioral sciences to explore relationships between latent variables (Bollen, 1989). SEM typically comprises of a measurement part, which connects latent variables to observable indicators, and a structural part, which captures the hypothesized relationships among these latent variables. While parameter estimation in SEM has been well-studied across various contexts (e.g., normal vs. nonnormal data, correct vs. misspecified models, different estimators), the standard errors (SEs) of these estimates have received relatively less attention (Deng et al., 2018). Since SEM typically relies on sample data to estimate parameters, it is essential to account for sampling variability, as samples rather than entire populations are used. SEs reflect this variability, indicating the precision of parameter estimates: smaller SEs suggest greater precision, while larger SEs indicate more uncertainty. SEs also play a crucial role in computing test statistics, such as -scores or -scores, which help determine whether estimated parameters significantly differ from zero or other specified values. Accurate estimation of SEs not only strengthens the reliability of research conclusions but also ensures that population inferences are robust and well-supported (Yuan & Hayashi, 2006).
In SEM, parameters can be estimated in two ways: through the standard estimation approach, which uses a joint or “system-wide” estimation procedure, and the structural-after-measurement (SAM) approach, which divides the estimation process into two parts.1 Recent simulation evidence by Dhaene and Rosseel (2023) indicates that LSAM yields more accurate point estimates than joint SEM — particularly in small to moderate samples — demonstrating its efficiency and stability. While this work provides valuable insights into point estimation accuracy, no studies have investigated the behavior of SEs within this framework. This study addresses this gap by systematically evaluating SE estimation under varying conditions within the LSAM approach to SEM, focusing specifically on continuous (and complete) data.
The rest of the paper is organized as follows. First, we discuss the standard estimation approach in SEM, highlighting key features and challenges. We then introduce the SAM approach, focusing on the local SAM variant, and review methods for SE calculation. Following this, we present the design, methodology, and results of our simulation studies. Finally, we discuss the results and offer insights into future research directions and limitations.
The Standard Estimation Approach in SEM
Parameter estimation in SEM involves a search for parameter values in order to make the model-implied covariance matrix as close as possible to the observed covariance matrix by minimizing a discrepancy function between the two. Various methods exist to define this discrepancy function, leading to different approaches to parameter estimation. Since the early 1970s (Jöreskog, 1973; Keesling, 1972; Wiley, 1973), ML has become the dominant estimator in SEM. This dominance, coupled with its widespread use as the default estimator in SEM packages such as LISREL (Jöreskog & Sörbom, 1996), EQS (Bentler, 2004), Mplus (Muthén & Muthén, 2010), OpenMx (Neale et al., 2016), and lavaan (Rosseel, 2012), led Rosseel and Loh (2024) to refer to ML as the ‘standard’ estimation approach in the SEM framework. In this paper, we similarly refer to SEM ML as the standard estimation approach.
Three key aspects characterize the standard ML estimator in SEM: First, it relies on iterative optimization procedures; second, it achieves optimal statistical properties only when all assumptions are met (i.e., independent and identically distributed observations, normal distribution, and correctly specified model) and the sample size is sufficiently large; and third, all parameters — both in the measurement and structural parts — are estimated simultaneously, a process referred to as system-wide estimation by Bollen (1996). These aspects, however, can lead to several issues, particularly when the sample size is not sufficiently large. One significant problem is nonconvergence, where the iterative optimization procedure fails to find a solution that minimizes the discrepancy function (Anderson & Gerbing, 1984; Boomsma, 1985; De Jonckere & Rosseel, 2022, 2023; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). Even when solutions are found, they might be improper, with parameters estimated beyond their expected range, such as negative variances or correlations greater than one (Chen et al., 2001; Gerbing & Anderson, 1987; van Driel, 1978).
While the simultaneous estimation of all parameters in both the measurement and structural parts is a defining characteristic of standard estimation, this system-wide approach can be effective only when both parts are correctly specified. However, Bollen (1989) points out that the assumption of a correctly specified model rarely holds, given the approximate nature of statistical models. When misspecification occurs in any part of the model — such as a missing cross-loading or error covariance — this can lead to bias across all parameters, including those in correctly specified parts (Bollen, 1996; Kaplan, 1988). In addition, Burt (1973, 1976) identified interpretational confounding as another issue associated with system-wide estimation. In this context, factor loadings for a latent variable, which are expected to remain consistent across models, may vary depending on the structural model applied. This variation can cause the empirical meaning of the latent variable to deviate from its intended meaning, potentially leading to ambiguous inferences across the models. It should be noted that, this concern is specific to system-wide estimators such as ML, where the measurement and structural components are estimated jointly, making parameter estimates in the measurement model susceptible to model misspecification in the structural part. Despite these drawbacks, the ML estimator remains powerful under optimal conditions — such as large sample sizes, normally distributed data, and a correctly specified model — and is widely used in applied settings.
Local Structural-After-Measurement (LSAM) Approach
Challenges associated with system-wide estimation in SEM have led researchers to revisit earlier methodologies within the SEM framework. One such approach, introduced by Burt (1976), involved a two-stage estimation procedure. This method independently fits measurement models before estimating the remaining parameters in the full model to address these challenges. Burt’s work laid the foundation for multi-stage procedures, which were later expanded upon by scholars such as Hunter and Gerbing (1982) and Lance et al. (1988). More recently, Rosseel and Loh (2024) coined the term ‘Structural-after-measurement’ (SAM) to describe this two-stage or two-step approach.
The key advantage of SAM lies in its ability to separate the estimation of measurement models from structural models, thereby preventing one from influencing the other. Building on this rationale, recent advancements include Bakk and Kuha (2018)’s multi-step approach for latent class models, Kuha and Bakk (2023)’s application to latent trait/item response theory models, and Levy (2023)’s Bayesian multi-step approach. Of these methods, the local SAM (LSAM) approach proposed by Rosseel and Loh (2024) stands out as a notable approach within the SEM framework, expanding on previous work in bias-corrected factor score regression (Croon, 2002; Devlieger et al., 2016; Wall & Amemiya, 2000). For a comprehensive discussion of related approaches and their relevance within the SAM framework, see Rosseel and Loh (2024).
LSAM operates in two steps: (1) estimating parameters of the measurement model, and (2) estimating parameters of the structural model. For latent factors () measured via observed variables, LSAM uses sample summary statistics (the sample mean vector, , and the sample variance-covariance matrix, ), along with estimated measurement parameters, to estimate the mean vector and the variance-covariance matrix of the latent variables. In Step 1, LSAM estimates the free elements of the measurement model, including intercepts (), factor loadings (), and residual variances (). To ensure proper mapping from observed to latent variables, LSAM employs a mapping matrix () that satisfies , where is the identity matrix. Using the ML discrepancy function, is computed as follows2,3:
1
The estimated mapping matrix () is used to compute the latent variable central moments:
2
3
In Step 2, LSAM uses and to estimate the structural model parameters, including intercepts (), regression coefficients (), and the variance-covariance matrix of the disturbances (). The choice of estimator in this step depends on the model’s complexity: Ordinary Least Squares (OLS) is appropriate for recursive models, Two-Stage Least Squares (2SLS) is suitable for non-recursive models, and Maximum Likelihood (ML) or Generalized Least Squares (GLS) can be employed for more complex path models.
The LSAM approach offers several distinct advantages over standard estimation in SEM (Rosseel & Loh, 2024). One key benefit is that splitting the measurement and structural parts allows for the implementation of more complex models (e.g., multi-group mixture models; Perez Alonso et al., 2024) that cannot be accommodated in a joint estimation framework. The second advantage is the solution to interpretational confounding, where factor loadings can vary depending on the structural model applied, as mentioned earlier. Another notable advantage is the flexibility of LSAM in allowing different estimators to be used in the measurement and structural parts. For instance, noniterative estimators can be employed for the measurement part, which are often faster and more stable (Dhaene & Rosseel, 2023). Overall, these advantages highlight LSAM as a flexible and efficient estimation strategy, particularly for more complex models that pose challenges for standard estimation approaches.
Different Approaches to Compute SEs
Various methods exist for computing SEs in standard SEM with continuous data. The process of obtaining so-called “standard” (i.e., non-robust) SEs first involves calculating the unit information matrix, which can typically be either observed or expected (Savalei, 2010). Within SEM, these two matrices are typically not equivalent (Yuan & Hayashi, 2006), and most SEM software, including lavaan (Rosseel, 2012), defaults to the expected information matrix for SE calculation. This information matrix is then inverted and divided by the sample size (N) to derive the variance-covariance matrix of the model parameters. Finally, SEs are obtained by taking the square root of the diagonal elements of this matrix.
It is widely acknowledged that when large-sample theory is used to derive analytic expressions for SEs, their performance can suffer in many practical settings due to violations of the underlying assumptions (Yuan & Hayashi, 2006). Robust SEs are often recommended within the ML framework to protect against deviations from normality and correct structural specification (Arminger & Schoenberg, 1989; Satorra & Bentler, 1994; Savalei & Rosseel, 2022). Research on SE performance in SEM is limited, focusing primarily on nonnormality and model misspecifications within the joint SEM approach (Maydeu-Olivares, 2017; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). However, the performance of SEs in the SAM approach, despite its advantages over standard SEM, remains unexplored.
Unlike the standard SEM approach, LSAM separates the estimation of SEs into components related to the measurement and structural parts. SEs for the measurement part can be computed using standard approaches. For the structural part, however, the two-step procedure introduces an additional source of variability. Specifically, the SEs for the structural model must account for the uncertainty carried over from the measurement model estimation. Failing to consider this source of uncertainty results in biased SE estimates (Bakk et al., 2017). Using the analytic procedure below, a joint information matrix is computed for all parameters in the full model, arranged as a partitioned matrix so that the first rows and columns correspond to the parameters of the measurement part:
4
In this matrix, the subscript “1” refers to the measurement part of the model, while “2” denotes the structural part. The two-step corrected variance-covariance matrix for the structural parameters () is then computed as follows:
5
In the presence of nonnormality, it is critical to use robust standard errors to avoid biased inference. While two-step corrected SEs account for uncertainty carried over from the measurement model, they still rely on the assumptions of correct model specification and multivariate normality. To address this limitation, Yuan and Chan (2002) proposed a robust version of the two-step correction. For technical details, see their Equations (4a) and (4b). A brief description of how ‘robust’ two-step standard errors are computed in the sam() function in lavaan (version 0.6-20 or higher) is included in the Appendix.
The two-step corrected SEs adjust only for the additional variability introduced by separate estimation of the measurement model and are appropriate under normality but not robust to distributional violations. In our study, we implemented both versions to compare their performance under normal and nonnormal conditions within the LSAM framework.
An alternative to analytic expressions for SEs is the resampling approach. A widely used method is bootstrapping (Efron, 1979; Efron & Tibshirani, 1993), where new samples are generated either by resampling with replacement from the original data (i.e., nonparametric bootstrapping) or, in the parametric bootstrapping case, by assuming a specific distribution (e.g., a multivariate normal distribution). For both methods, parameter estimates are calculated for each bootstrap sample, and the standard deviation across all samples is used to approximate the SE for each model parameter.
In SEM, bootstrapping has been widely adopted for obtaining accurate SEs (Bollen & Stine, 1990, 1992; Boomsma, 1986; Hancock & Liu, 2012; Ievers-Landis et al., 2011; Nevitt & Hancock, 2001). Boomsma (1986) showed that bootstrap SEs in covariance structure analysis tend to be larger than ML SEs under skewed data conditions. Subsequent studies expanded bootstrapping to estimate SEs for standardized coefficients, as well as direct, indirect, and total effects (Bollen & Stine, 1990; Stine, 1989). Empirical research further validated its effectiveness in real data settings (Yung & Bentler, 1996). Nevitt and Hancock (2001) highlighted the advantages of bootstrapping over ML under nonnormality, showing that bootstrap SEs performed better in terms of bias and variability for sample sizes . Yuan and Hayashi (2006) demonstrated that in addition to robust SEs, bootstrap SEs remained consistent under model misspecifications, unlike non-robust SEs derived from information matrices, which proved unreliable when assumptions of normality and correct structural specification were violated.
While prior studies have primarily focused on nonparametric bootstrapping, we incorporate both parametric and nonparametric methods in our SE estimation to evaluate their relative performance. Parametric bootstrapping, by assuming a specified distribution, has the potential to provide more stable and accurate SE estimates, particularly in small sample sizes where empirical data may fall short in capturing the sampling distribution (Hesterberg, 2015).
In contrast to nonparametric bootstrapping, which resamples the original dataset with replacement, parametric bootstrapping simulates new datasets from a fully specified model. In SEM, this typically involves generating data from the model-implied covariance matrix and mean vector, assuming a multivariate normal distribution. Parameter estimates are obtained from the original sample, and multiple bootstrap datasets are drawn from a -dimensional multivariate normal distribution with mean vector and covariance matrix , where are the fitted model parameters.
The parametric approach offers several advantages when model assumptions are approximately valid. In particular, generating resamples from the model-implied distribution — rather than relying on the empirical distribution — can reduce sampling variability and yield more accurate standard error estimates. These advantages are especially relevant in small sample contexts, where the empirical distribution may inadequately represent the underlying population structure (Hesterberg, 2015).
To our knowledge, no studies have investigated the estimation of SEs within the LSAM approach, nor have they explored both nonparametric and parametric bootstrapping in the LSAM framework. Therefore, this study aims to assess the performance of both analytic and resampling-based SEs in the LSAM approach. We consider correctly specified and misspecified models across varying sample sizes, using both normal and nonnormal distributions. Additionally, standard and robust SEs from system-wide ML were included, with the aim of illustrating the potential extent of bias that may arise when the standard approach is used under the conditions of our simulation design.
Method
To evaluate SE estimation under varying conditions, two simulation studies were conducted, differing primarily in the models employed. In Study 1, data were generated from a simple structural equation model in which a latent variable predicts another latent variable , as illustrated in Figure 1. Each latent variable was measured by three continuous indicators. The model and population values were based on those described by Rosseel and Devlieger (2018). In Study 2, the model retained the two latent factors ( and ) with their continuous three indicators from Study 1. To increase complexity and better reflect real-world SEM applications, the model was expanded to include two exogenous observed variables (X and Y) and one endogenous observed variable (Z), thereby incorporating relationships among observed and latent variables. The second model is illustrated in Figure 2, with the population values specified to ensure that the explained variance in Z was determined to be 40%.
Figure 1
The Model and Unstandardized Population Values Used in the Simulations for Study 1
Note. Residual covariances (dashed double-headed arrows) are included in the population model but omitted in the analysis model under the misspecified condition. For scaling purposes, the first factor loading of each latent variable is fixed to 1 (denoted by 1* in the figure).
Figure 2
The Model and Unstandardized Population Values Used in the Simulations for Study 2
Note. For scaling purposes, the first factor loading of each latent variable is fixed to 1 (denoted by 1* in the figure).
A few characteristics were common to both studies: (i) the methods being evaluated, (ii) the outcome measures of interest (i.e., SE and coverage rate), and (iii) manipulations of sample size. However, normality and misspecification were varied differently in each study. In Study 1, the misspecification condition was introduced by omitting two residual covariances between the second and third indicators within each latent variable from the analysis model, which were specified as in the population model. In contrast, Study 2 introduced misspecification in the structural part by removing the path from to . For normality, Study 1 focused on nonnormal latent scores with skewness of and excess kurtosis of , while Study 2 extended nonnormality to include exogenous variables, disturbances, and residuals.
In Study 2, nonnormal exogenous variables were generated with skewness of and excess kurtosis of , consistent with Study 1. Nonnormal disturbances ( and ) were generated using centered exponential distributions, with rate and variances set to and , respectively. For the normally distributed data, disturbances were drawn from normal distributions with the same variances. These disturbances were added to the latent variables ( and ) to introduce variability according to the specified distribution type. Similarly, measurement errors () were generated either from multivariate normal distributions (for normal conditions) or from centered exponential distributions (for nonnormal conditions), scaled to match the diagonal elements of the specified measurement error covariance matrix (). Under nonnormal conditions, residuals were generated independently for each indicator, resulting in uncorrelated errors. The centering of exponential distributions was accomplished by subtracting from each draw, where corresponds to the mean of an exponential distribution with as the specified rate parameter. The exogenous variables X and Y were generated with a target population correlation of 0.4, as specified in the population covariance matrix . Thus, the second study moved the misspecification from the measurement to the structural part and enhanced nonnormality, expanding it from latent scores to three layers of nonnormality.
For the standard estimation approach, standard SEs were computed using the conventional ML estimator (se = ”standard” in lavaan). Robust SEs were obtained using the sandwich estimator (se = ”sandwich”), which corresponds to the MLR method Yuan and Bentler (2000). In the LSAM approach, SEs were computed using: (a) two-step standard errors, (b) robust two-step standard errors following Yuan and Chan (2002)’s correction for nonnormality, (c) nonparametric bootstrap, and (d) parametric bootstrap. The bootstrap methods were implemented via the sam() function in the lavaan package. For nonparametric bootstrapping, we set se = ”bootstrap” and specified bootstrap.type = ”ordinary”, which resamples with replacement from the empirical data; for parametric bootstrapping, we set se = ”bootstrap” with bootstrap.type = ”parametric”, generating datasets from the model-implied multivariate normal distribution defined by the estimated parameter values. For both procedures, 1000 bootstrap resamples were drawn per dataset. The standard deviation of the bootstrap parameter estimates was used as the estimated SE.
To evaluate the accuracy of SE estimates, we computed both empirical and model-based SEs. Empirical SEs were calculated as the standard deviation of point estimates across replications: 10,000 replications were used for non-resampling methods (e.g., standard and two-step approaches), and 1,000 for resampling-based methods (i.e., nonparametric and parametric bootstrap). Model-based SEs were obtained by averaging the SE estimates provided by each method across these replications. Bias was assessed by calculating the ratio of the model-based SE to the empirical SE for each method, with a ratio of indicating unbiased SE estimates, and ratios greater or less than reflecting over- or underestimation, respectively. To provide a more comprehensive assessment of standard error accuracy, we also calculated coverage rates for each parameter of interest based on confidence intervals obtained from each estimation method. Coverage was defined as the proportion of replications in which the model-based 90% confidence interval contained the corresponding population value.
To evaluate the effect of sample size on the performance of the estimation methods, five sample sizes ( and ) were selected to represent a range from small to large samples. This range allowed for a comprehensive assessment of SE accuracy across varying data sizes.
All simulations were conducted in R (R Core Team, 2024) using the lavaan package (Version 0.6–16; Rosseel, 2012). Nonnormal data for latent scores were generated using the rIG function from the covsim package (Version 1.0.0; Grønneberg et al., 2022). Data generation was performed using custom R functions designed to simulate datasets based on specified SEM models and population parameters. The option bounds = TRUE (De Jonckere & Rosseel, 2022) was incorporated within these custom R functions when using the sem() function, ensuring improved convergence and enabling for a fair evaluation across all conditions. The full R code, including simulation details and population values, is available in our OSF repository via Can and Rosseel (2025).
Results
Convergence
No non-convergent solutions were observed in either Study 1 or Study 2: the local SAM approach consistently achieved convergence across all iterations. While convergence failures are often expected for smaller sample sizes in joint SEM ML, the application of bounds successfully mitigated this issue. As a result, no convergence problems were encountered for the SEM approach across all conditions.
Study 1
Standard Error Bias
Figure 3 and Table 1 present results for SE Bias across various sample sizes and estimation methods. Results are shown under both correctly specified and misspecified models, with normal and nonnormal data. The results begin with a comparison of LSAM methods across conditions, followed by an analysis of standard and robust SEs under the SEM approach, to illustrate the extent of potential SE bias associated with standard estimation.
Figure 3
Bias in SEs Across Various Sample Sizes and SE Methods Under Different Conditions in Study 1
Note. Dashed and dotted horizontal lines indicate reference thresholds at 1.0, 1.1, and 0.9, respectively.
Table 1
Bias Values for SE Methods Across Sample Sizes and Conditions in Study 1
| SEM Approach | LSAM Approach | ||||||
|---|---|---|---|---|---|---|---|
| Condition | Sample Size | Standard | Robust | Two-step standard | Two-step robust | Nonparametric | Parametric |
| Normal/Correct | 50 | 0.81 | 1.18 | 1.05 | 1.04 | 1.06 | 0.95 |
| 100 | 0.88 | 1.01 | 0.99 | 1.00 | 1.07 | 1.01 | |
| 200 | 0.96 | 1.02 | 1.01 | 1.02 | 1.07 | 0.99 | |
| 500 | 0.98 | 1.00 | 0.99 | 1.01 | 0.97 | 0.98 | |
| 1000 | 0.98 | 0.99 | 0.99 | 1.01 | 1.04 | 1.01 | |
| Normal/Misspecified | 50 | 0.82 | 1.14 | 1.03 | 0.98 | 1.09 | 1.02 |
| 100 | 0.87 | 1.00 | 0.96 | 0.95 | 1.07 | 0.99 | |
| 200 | 0.94 | 1.01 | 0.98 | 0.97 | 1.03 | 0.99 | |
| 500 | 0.95 | 1.00 | 0.97 | 0.96 | 1.00 | 0.95 | |
| 1000 | 0.95 | 0.99 | 0.96 | 0.95 | 1.03 | 0.98 | |
| Nonnormal/Correct | 50 | 0.67 | 1.07 | 0.99 | 1.06 | 1.02 | 0.91 |
| 100 | 0.79 | 1.08 | 0.90 | 0.96 | 0.98 | 0.89 | |
| 200 | 0.81 | 0.95 | 0.86 | 0.96 | 0.97 | 0.90 | |
| 500 | 0.85 | 0.98 | 0.87 | 1.01 | 0.98 | 0.87 | |
| 1000 | 0.86 | 0.99 | 0.86 | 1.02 | 1.00 | 0.88 | |
| Nonnormal/Misspecified | 50 | 0.66 | 1.06 | 0.99 | 1.00 | 1.00 | 0.96 |
| 100 | 0.75 | 1.01 | 0.85 | 0.87 | 0.97 | 0.87 | |
| 200 | 0.77 | 0.95 | 0.82 | 0.86 | 1.06 | 0.83 | |
| 500 | 0.81 | 0.98 | 0.83 | 0.88 | 1.02 | 0.87 | |
| 1000 | 0.80 | 0.97 | 0.81 | 0.87 | 0.96 | 0.82 | |
Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.
The analytic two-step method for LSAM (“SAM Two-step”) produced SE estimates close to the unbiased ratio of 1 under normal conditions, irrespective of model specification. Under nonnormal conditions, however, it exhibited increasing bias, with underestimation reaching up to 19% (bias = 0.81), particularly in misspecified models. A similar pattern was observed for the robust LSAM (“SAM Robust”) under normal conditions. However, under the nonnormal/correct condition, it produced nearly unbiased SE values as the sample size increased. In contrast, under the nonnormal/misspecified condition, it tended to underestimate SEs (e.g., bias = 0.87 at ). The nonparametric bootstrap method (“SAM Nonparametric”) demonstrated strong performance, especially under nonnormal conditions, yielding nearly unbiased SEs (e.g., bias = 1.00 at in the nonnormal/misspecified condition). Under normal conditions, it slightly overestimated SEs in smaller samples, with bias decreasing from 9% (bias = 1.09) to 3% (bias = 1.03) as N increased. The parametric bootstrap method (“SAM Parametric”) provided accurate SE estimates under normal conditions, with minimal bias ranging from 5% underestimation (bias = 0.95) to near-unbiased values (bias = 1.01). However, under nonnormal conditions, it showed greater underestimation, with bias ranging from 4% to 18% (bias = 0.96–0.82), especially under model misspecification.
For the standard SEM estimation approach, the classic method based on the expected information matrix (“SEM Standard”) consistently underestimated SEs across all conditions. The largest underestimations occurred under nonnormality and misspecification, with bias ranging from 20% to 34% (bias = 0.80–0.66). Under normal conditions, bias improved with larger sample sizes, ranging from 19% underestimation (bias = 0.81) at to 2% (bias = 0.98) at . The robust SEM method (“SEM Robust”) exhibited overestimation of SEs in small samples under normality (e.g., bias = 1.18 at ), with accuracy improving as sample size increased (bias = 0.99 at ). In nonnormal conditions, it outperformed SEM Standard, producing SE bias values generally closer to 1.
Coverage Rates
Table 2 presents results for coverage rates and bias of point estimates across various sample sizes and estimation methods.
Table 2
Coverage Rates and Bias of Point Estimates for SE Methods Across Sample Sizes and Conditions in Study 1
| SEM Approach | LSAM Approach | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Standard | Robust | Two-Step Standard | Two-Step Robust | Nonparametric | Parametric | ||||||||
| Condition | Sample Size | Coverage | Bias | Coverage | Bias | Coverage | Bias | Coverage | Bias | Coverage | Bias | Coverage | Bias |
| Normal/Correct | 50 | 0.84 | 0.02 | 0.88 | 0.02 | 0.87 | −0.03 | 0.86 | −0.03 | 0.90 | −0.03 | 0.89 | −0.02 |
| 100 | 0.86 | 0.01 | 0.90 | 0.01 | 0.88 | −0.02 | 0.87 | −0.02 | 0.90 | −0.02 | 0.89 | −0.02 | |
| 200 | 0.89 | 0.00 | 0.91 | 0.00 | 0.89 | −0.01 | 0.89 | −0.01 | 0.91 | −0.01 | 0.90 | −0.01 | |
| 500 | 0.89 | 0.00 | 0.90 | 0.00 | 0.89 | 0.00 | 0.89 | 0.00 | 0.89 | 0.00 | 0.88 | −0.01 | |
| 1000 | 0.90 | 0.00 | 0.90 | 0.00 | 0.90 | 0.00 | 0.90 | 0.00 | 0.91 | 0.00 | 0.90 | 0.00 | |
| Normal/Misspecified | 50 | 0.72 | −0.08 | 0.78 | −0.08 | 0.71 | −0.11 | 0.69 | −0.11 | 0.77 | −0.11 | 0.77 | −0.11 |
| 100 | 0.67 | −0.09 | 0.72 | −0.09 | 0.64 | −0.11 | 0.63 | −0.11 | 0.68 | −0.11 | 0.65 | −0.11 | |
| 200 | 0.59 | −0.10 | 0.62 | −0.10 | 0.55 | −0.11 | 0.54 | −0.11 | 0.56 | −0.11 | 0.55 | −0.11 | |
| 500 | 0.36 | −0.10 | 0.39 | −0.10 | 0.33 | −0.10 | 0.32 | −0.10 | 0.35 | −0.10 | 0.34 | −0.11 | |
| 1000 | 0.15 | −0.10 | 0.16 | −0.10 | 0.12 | −0.10 | 0.12 | −0.10 | 0.14 | −0.10 | 0.11 | −0.10 | |
| Nonnormal/Correct | 50 | 0.79 | 0.02 | 0.83 | 0.02 | 0.84 | −0.01 | 0.82 | −0.01 | 0.91 | 0.00 | 0.89 | −0.01 |
| 100 | 0.82 | 0.02 | 0.87 | 0.02 | 0.84 | −0.01 | 0.85 | −0.01 | 0.90 | 0.00 | 0.84 | −0.02 | |
| 200 | 0.83 | 0.01 | 0.88 | 0.01 | 0.84 | 0.00 | 0.87 | 0.00 | 0.89 | 0.00 | 0.87 | 0.00 | |
| 500 | 0.84 | 0.01 | 0.89 | 0.01 | 0.85 | 0.00 | 0.89 | 0.00 | 0.89 | 0.00 | 0.84 | 0.00 | |
| 1000 | 0.84 | 0.00 | 0.89 | 0.00 | 0.84 | 0.00 | 0.90 | 0.00 | 0.89 | 0.00 | 0.84 | 0.00 | |
| Nonnormal/Misspecified | 50 | 0.70 | −0.04 | 0.76 | −0.04 | 0.67 | −0.09 | 0.66 | −0.09 | 0.77 | −0.09 | 0.74 | −0.09 |
| 100 | 0.65 | −0.07 | 0.71 | −0.07 | 0.62 | −0.10 | 0.62 | −0.10 | 0.68 | −0.09 | 0.58 | −0.11 | |
| 200 | 0.56 | −0.09 | 0.64 | −0.09 | 0.53 | −0.10 | 0.55 | −0.10 | 0.61 | −0.10 | 0.54 | −0.10 | |
| 500 | 0.37 | −0.10 | 0.47 | −0.10 | 0.34 | −0.10 | 0.38 | −0.10 | 0.42 | −0.10 | 0.38 | −0.10 | |
| 1000 | 0.19 | −0.10 | 0.27 | −0.10 | 0.17 | −0.10 | 0.20 | −0.10 | 0.26 | −0.10 | 0.17 | −0.10 | |
Note. Bolded values indicate coverage rates of 0.80 or lower.
Coverage rates were generally close to 0.90 under correctly specified models, especially as sample size increased. For example, under the Normal/Correct condition, SAM Two-step yielded a coverage rate that increased from 0.87 at to 0.90 at . SAM Two-step and SAM Robust consistently achieved coverage rates close to 0.90 across distributional conditions. SAM Nonparametric also showed similar performance under correct model specification and normal data. SAM Parametric yielded slightly improved coverage in small samples compared to SAM Two-step and SAM Robust, particularly in nonnormal/correct conditions, and converged to values near 0.90 with larger sample sizes. Although all LSAM methods demonstrated coverage rates close to 0.90 under correct model specification, SAM Parametric tended to yield slightly more accurate coverage in normal data conditions, whereas SAM Nonparametric demonstrated slightly higher coverage in nonnormal data conditions.
In contrast, under misspecified models, coverage rates decreased substantially across all methods, exhibiting similarly low coverage levels across sample sizes under misspecification. Among LSAM methods, bootstrap approaches showed slightly better performance at smaller sample sizes in the normal/misspecified condition (e.g., coverage = 0.77 at for SAM Nonparametric). SEM Robust followed a similar trend to the LSAM methods and consistently outperformed SEM Standard across all misspecified conditions.
Coverage rates under model misspecification can be interpreted by considering the role of point estimate bias. When the true parameter value was 0.25, point estimates consistently underestimated this value by approximately 0.10 across estimation methods, corresponding to a 40% relative underestimation. Despite reasonably accurate SE estimates from the LSAM approach, the resulting confidence intervals were centered on biased estimates. This decline in coverage rates may be primarily attributed to biased point estimates rather than inaccuracies in SE estimation. Even when SEs appropriately reflected the variability of estimates, confidence intervals may have failed to include the true parameter value because they were centered on systematically underestimated point estimates. This shift in location — rather than width — offers a plausible explanation for the reduced coverage rates observed under misspecification. In contrast, under correctly specified models, point estimates were nearly unbiased across all methods, and coverage rates consistently approached 0.90. These results suggest that low coverage under misspecification is largely driven by point estimate bias rather than SE bias.
Study 2
Standard Error Bias
Table 3 presents SE bias for regression coefficients under correctly specified models with normal and nonnormal data across various sample sizes and estimation methods.
Table 3
Bias Values for SE Methods Across Sample Sizes and Conditions for Correctly Specified Models in Study 2
| Normal/Correct | Nonnormal/Correct | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SE Method | Sample Size | ||||||||||
| LSAM Approach | |||||||||||
| Two-step standard | 50 | 0.96 | 0.95 | 0.96 | 0.95 | 0.96 | 0.95 | 0.93 | 0.92 | 0.95 | 0.95 |
| 100 | 0.97 | 0.97 | 0.97 | 0.97 | 0.98 | 0.96 | 0.97 | 0.96 | 0.97 | 0.98 | |
| 200 | 1.00 | 0.99 | 0.98 | 0.98 | 1.00 | 0.99 | 0.98 | 0.98 | 0.98 | 0.98 | |
| 500 | 0.99 | 0.99 | 1.00 | 0.99 | 0.99 | 0.99 | 0.98 | 0.99 | 1.00 | 1.00 | |
| 1000 | 1.00 | 1.00 | 1.00 | 1.00 | 1.01 | 0.99 | 0.99 | 0.99 | 0.99 | 1.00 | |
| Two-step robust | 50 | 0.97 | 0.94 | 0.96 | 0.96 | 0.94 | 0.91 | 0.87 | 0.90 | 0.93 | 0.91 |
| 100 | 0.97 | 0.96 | 0.96 | 0.97 | 0.96 | 0.92 | 0.93 | 0.94 | 0.96 | 0.95 | |
| 200 | 0.99 | 0.98 | 0.98 | 0.98 | 0.97 | 0.96 | 0.96 | 0.97 | 0.97 | 0.95 | |
| 500 | 0.99 | 0.99 | 1.00 | 0.99 | 0.97 | 0.98 | 0.97 | 0.99 | 0.99 | 0.98 | |
| 1000 | 1.00 | 0.99 | 1.00 | 1.00 | 0.98 | 0.98 | 0.98 | 0.99 | 0.98 | 0.98 | |
| Nonparametric | 50 | 0.98 | 1.01 | 0.97 | 1.06 | 1.02 | 0.99 | 1.02 | 1.02 | 1.09 | 1.01 |
| 100 | 1.03 | 1.04 | 1.02 | 1.02 | 1.00 | 0.98 | 0.99 | 1.02 | 0.98 | 0.96 | |
| 200 | 0.98 | 1.02 | 0.98 | 1.02 | 0.98 | 0.96 | 1.07 | 0.96 | 0.99 | 1.03 | |
| 500 | 1.02 | 1.03 | 1.00 | 1.02 | 1.03 | 1.01 | 0.97 | 0.97 | 1.01 | 0.99 | |
| 1000 | 0.99 | 0.98 | 1.00 | 1.00 | 1.01 | 1.01 | 0.97 | 1.02 | 0.99 | 1.01 | |
| Parametric | 50 | 0.94 | 0.98 | 1.00 | 1.00 | 1.03 | 0.96 | 0.97 | 0.99 | 1.05 | 1.00 |
| 100 | 1.01 | 1.01 | 0.99 | 0.99 | 1.02 | 0.96 | 0.97 | 0.98 | 0.97 | 1.00 | |
| 200 | 0.97 | 0.97 | 1.01 | 1.03 | 1.00 | 0.99 | 1.00 | 1.00 | 1.03 | 1.01 | |
| 500 | 1.00 | 0.98 | 1.01 | 1.00 | 0.98 | 0.97 | 1.01 | 1.01 | 0.98 | 0.97 | |
| 1000 | 0.99 | 0.96 | 0.95 | 0.99 | 1.02 | 1.01 | 0.97 | 1.00 | 1.01 | 1.03 | |
| SEM Approach | |||||||||||
| Standard | 50 | 1.04 | 0.96 | 0.94 | 0.94 | 0.94 | 1.26 | 1.29 | 0.91 | 0.95 | 0.96 |
| 100 | 0.99 | 0.98 | 0.96 | 0.96 | 0.97 | 0.98 | 0.97 | 0.96 | 0.97 | 0.97 | |
| 200 | 1.01 | 0.99 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 | 0.97 | 0.98 | 0.98 | |
| 500 | 0.99 | 0.99 | 1.00 | 0.99 | 0.99 | 1.01 | 0.99 | 0.99 | 1.00 | 1.00 | |
| 1000 | 1.00 | 1.00 | 1.00 | 1.00 | 1.01 | 0.99 | 1.00 | 0.99 | 0.99 | 1.00 | |
| Robust | 50 | 0.95 | 0.94 | 0.96 | 0.94 | 0.94 | 0.90 | 0.87 | 0.89 | 0.90 | 0.90 |
| 100 | 0.96 | 0.97 | 0.96 | 0.96 | 0.97 | 0.92 | 0.93 | 0.94 | 0.95 | 0.95 | |
| 200 | 0.99 | 0.99 | 0.98 | 0.98 | 0.99 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | |
| 500 | 0.99 | 0.99 | 1.00 | 0.99 | 0.99 | 0.98 | 0.97 | 0.98 | 0.99 | 0.99 | |
| 1000 | 1.00 | 1.00 | 1.00 | 1.00 | 1.01 | 0.98 | 0.99 | 0.98 | 0.98 | 0.99 | |
Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.
Under normal data, all LSAM methods produced bias values close to 1 across regression coefficients and sample sizes. Bias values for SAM Two-step and SAM Robust tended to slightly underestimate SEs in small samples (e.g., bias = 0.94–0.97 at ) converging to near-unbiased values as sample size increased. SAM Nonparametric and SAM Parametric were generally close to 1 (ranging from 0.94 to 1.06).
Under the nonnormal condition, SAM Nonparametric delivered near-unbiased SE estimates across regression coefficients. SAM Two-step and SAM Parametric exhibited slightly more variability, with bias levels depending on the specific parameter and sample size. SAM Robust showed the greatest variability among the LSAM methods, particularly at smaller sample sizes (e.g., for and ) (see Figure 4).
Figure 4
Bias in SEs Across Structural Coefficients for Sample Sizes and SE Methods Under Nonnormally Distributed Data With a Correct Model in Study 2
For SEM methods, SEM Standard showed minor underestimation in small samples under normality (e.g., 0.94 at ) but converged toward unbiased estimates at larger sample sizes. SEM Robust maintained stable SE bias across all coefficients and sample sizes, with estimates showing approximately 6% underestimation to 1% overestimation (bias values ranging from 0.94 to 1.01). Under nonnormal data, SEM Robust outperformed SEM Standard, which showed more variability, particularly for and in small samples.
For misspecified models (see Table 4), all LSAM methods produced values close to 1 for the and regression coefficients under normally distributed data. However, differences emerged for regression coefficients involving the endogenous observed variable Z. For and , SAM Nonparametric performed best, producing the most accurate SE estimates across sample sizes. In contrast, all other LSAM methods displayed underestimation, ranging from 19% to 10% (SE bias values from 0.81 to 0.90). SEM Standard exhibited higher bias values, particularly for smaller sample sizes in the coefficient. SEM Robust outperformed SEM Standard, yielding lower bias across all regression coefficients and sample sizes.
Table 4
Bias Values for SE Methods Across Sample Sizes and Conditions for Misspecified Models in Study 2
| Normal/Misspecified | Nonnormal/Misspecified | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SE Method | Sample Size | ||||||||
| LSAM Approach | |||||||||
| Two-step standard | 50 | 0.97 | 0.96 | 0.83 | 0.85 | 0.96 | 0.93 | 0.82 | 0.83 |
| 100 | 0.97 | 0.98 | 0.85 | 0.87 | 0.96 | 0.96 | 0.85 | 0.86 | |
| 200 | 1.00 | 0.99 | 0.87 | 0.88 | 0.99 | 0.98 | 0.86 | 0.86 | |
| 500 | 0.99 | 1.00 | 0.87 | 0.88 | 0.99 | 0.98 | 0.88 | 0.88 | |
| 1000 | 1.00 | 0.99 | 0.88 | 0.89 | 0.99 | 0.99 | 0.87 | 0.88 | |
| Two-step robust | 50 | 0.97 | 0.95 | 0.83 | 0.81 | 0.91 | 0.89 | 0.79 | 0.77 |
| 100 | 0.97 | 0.97 | 0.84 | 0.83 | 0.93 | 0.93 | 0.82 | 0.81 | |
| 200 | 1.00 | 0.98 | 0.85 | 0.84 | 0.96 | 0.97 | 0.84 | 0.82 | |
| 500 | 0.99 | 1.00 | 0.86 | 0.84 | 0.98 | 0.97 | 0.86 | 0.85 | |
| 1000 | 1.00 | 0.99 | 0.87 | 0.85 | 0.98 | 0.99 | 0.85 | 0.85 | |
| Nonparametric | 50 | 0.95 | 0.96 | 1.05 | 1.02 | 0.99 | 1.01 | 1.09 | 1.01 |
| 100 | 0.97 | 1.01 | 1.02 | 1.01 | 0.98 | 0.99 | 0.98 | 0.96 | |
| 200 | 1.02 | 1.00 | 0.97 | 0.98 | 0.96 | 1.03 | 0.99 | 1.03 | |
| 500 | 0.98 | 1.00 | 1.04 | 1.03 | 1.01 | 0.97 | 1.01 | 0.99 | |
| 1000 | 0.98 | 1.01 | 1.00 | 1.02 | 1.01 | 0.94 | 0.99 | 1.01 | |
| Parametric | 50 | 0.97 | 0.99 | 0.89 | 0.88 | 0.96 | 0.95 | 0.91 | 0.87 |
| 100 | 1.02 | 0.99 | 0.86 | 0.90 | 0.96 | 0.94 | 0.84 | 0.88 | |
| 200 | 1.01 | 0.96 | 0.90 | 0.87 | 0.99 | 0.99 | 0.91 | 0.90 | |
| 500 | 0.98 | 1.01 | 0.90 | 0.90 | 0.97 | 0.97 | 0.87 | 0.86 | |
| 1000 | 0.99 | 1.02 | 0.88 | 0.90 | 1.01 | 0.96 | 0.89 | 0.91 | |
| SEM Approach | |||||||||
| Standard | 50 | 1.04 | 0.98 | 0.86 | 0.87 | 1.25 | 1.31 | 0.87 | 0.88 |
| 100 | 0.99 | 0.99 | 0.89 | 0.90 | 0.98 | 0.96 | 0.89 | 0.89 | |
| 200 | 1.00 | 0.99 | 0.90 | 0.92 | 0.99 | 0.98 | 0.90 | 0.90 | |
| 500 | 0.99 | 1.00 | 0.91 | 0.91 | 1.01 | 0.99 | 0.92 | 0.92 | |
| 1000 | 1.00 | 0.99 | 0.92 | 0.93 | 0.99 | 1.00 | 0.91 | 0.92 | |
| Robust | 50 | 0.95 | 0.94 | 0.94 | 0.94 | 0.89 | 0.88 | 0.90 | 0.90 |
| 100 | 0.96 | 0.97 | 0.96 | 0.98 | 0.91 | 0.93 | 0.95 | 0.95 | |
| 200 | 0.99 | 0.99 | 0.98 | 0.99 | 0.96 | 0.96 | 0.96 | 0.96 | |
| 500 | 0.99 | 1.00 | 0.99 | 0.99 | 0.98 | 0.97 | 0.99 | 0.99 | |
| 1000 | 1.00 | 0.99 | 1.00 | 1.01 | 0.98 | 1.00 | 0.98 | 0.99 | |
Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.
Under nonnormal data with the misspecified model (see Figure 5), SAM Nonparametric delivered nearly unbiased SEs for and , followed closely by SAM Parametric. SAM Two-step showed higher bias in smaller sample sizes, with underestimation around 7%. SAM Robust displayed slightly more bias in smaller samples for these coefficients (e.g., 0.91 and 0.89 at ), but approached values near 1 as sample size increased (e.g., 0.98 and 0.99 at ). SEM Standard exhibited the largest biases for smaller sample sizes, with 25% and 31% overestimation for and , respectively. SEM Robust performed better but still slightly underestimated these coefficients by about 10% in the smallest sample size. Bias values for both standard and robust SEs decreased with increasing sample sizes.
Figure 5
Bias in SEs Across Structural Coefficients for Sample Sizes and SE Methods Under Nonnormally Distributed Data With a Misspecified Model in Study 2
Among LSAM methods, for regression coefficients involving Z, SAM Nonparametric again performed best, providing accurate SE estimates. SEM Standard and SEM Robust both exhibited underestimation for in the smallest sample size, with underestimation of 13% and 10%, respectively, but the values improved as sample size increased.
Coverage Rates
Table 5 presents results for coverage rates in correctly specified models across various sample sizes and estimation methods.
Table 5
Coverage Rates for SE Methods Across Sample Sizes and Conditions for Correctly Specified Models in Study 2
| Normal/Correct | Nonnormal/Correct | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SE Method | Sample Size | ||||||||||
| LSAM Approach | |||||||||||
| Two-step standard | 50 | 0.88 | 0.88 | 0.88 | 0.89 | 0.89 | 0.89 | 0.88 | 0.88 | 0.89 | 0.89 |
| 100 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.90 | 0.90 | |
| 200 | 0.90 | 0.90 | 0.89 | 0.89 | 0.90 | 0.90 | 0.89 | 0.89 | 0.89 | 0.89 | |
| 500 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | |
| 1000 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | |
| Two-step robust | 50 | 0.88 | 0.87 | 0.87 | 0.88 | 0.87 | 0.86 | 0.84 | 0.86 | 0.87 | 0.86 |
| 100 | 0.88 | 0.88 | 0.88 | 0.89 | 0.88 | 0.87 | 0.87 | 0.87 | 0.89 | 0.88 | |
| 200 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.88 | 0.89 | 0.89 | 0.88 | |
| 500 | 0.90 | 0.89 | 0.90 | 0.90 | 0.89 | 0.89 | 0.89 | 0.89 | 0.90 | 0.89 | |
| 1000 | 0.90 | 0.90 | 0.90 | 0.90 | 0.89 | 0.89 | 0.89 | 0.90 | 0.89 | 0.89 | |
| Nonparametric | 50 | 0.89 | 0.90 | 0.88 | 0.91 | 0.91 | 0.89 | 0.92 | 0.91 | 0.93 | 0.90 |
| 100 | 0.91 | 0.91 | 0.90 | 0.90 | 0.91 | 0.89 | 0.89 | 0.91 | 0.91 | 0.88 | |
| 200 | 0.89 | 0.90 | 0.90 | 0.92 | 0.88 | 0.89 | 0.92 | 0.88 | 0.89 | 0.90 | |
| 500 | 0.90 | 0.91 | 0.90 | 0.91 | 0.90 | 0.90 | 0.89 | 0.90 | 0.90 | 0.90 | |
| 1000 | 0.91 | 0.90 | 0.89 | 0.91 | 0.91 | 0.90 | 0.89 | 0.91 | 0.90 | 0.90 | |
| Parametric | 50 | 0.89 | 0.90 | 0.90 | 0.91 | 0.91 | 0.90 | 0.89 | 0.89 | 0.93 | 0.92 |
| 100 | 0.90 | 0.91 | 0.92 | 0.90 | 0.91 | 0.89 | 0.88 | 0.90 | 0.89 | 0.91 | |
| 200 | 0.90 | 0.90 | 0.90 | 0.91 | 0.91 | 0.90 | 0.90 | 0.90 | 0.92 | 0.90 | |
| 500 | 0.90 | 0.89 | 0.90 | 0.90 | 0.90 | 0.89 | 0.90 | 0.90 | 0.89 | 0.88 | |
| 1000 | 0.90 | 0.89 | 0.88 | 0.90 | 0.91 | 0.91 | 0.89 | 0.90 | 0.90 | 0.91 | |
| SEM Approach | |||||||||||
| Standard | 50 | 0.91 | 0.88 | 0.88 | 0.88 | 0.89 | 0.96 | 0.96 | 0.88 | 0.89 | 0.90 |
| 100 | 0.90 | 0.90 | 0.89 | 0.89 | 0.89 | 0.90 | 0.89 | 0.89 | 0.90 | 0.90 | |
| 200 | 0.90 | 0.89 | 0.89 | 0.89 | 0.90 | 0.90 | 0.90 | 0.89 | 0.89 | 0.90 | |
| 500 | 0.90 | 0.90 | 0.90 | 0.89 | 0.90 | 0.91 | 0.90 | 0.90 | 0.90 | 0.90 | |
| 1000 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | |
| Robust | 50 | 0.87 | 0.87 | 0.88 | 0.87 | 0.88 | 0.86 | 0.85 | 0.86 | 0.87 | 0.87 |
| 100 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.87 | 0.87 | 0.87 | 0.88 | 0.88 | |
| 200 | 0.89 | 0.89 | 0.89 | 0.89 | 0.90 | 0.88 | 0.88 | 0.88 | 0.89 | 0.88 | |
| 500 | 0.90 | 0.90 | 0.90 | 0.89 | 0.90 | 0.89 | 0.89 | 0.89 | 0.90 | 0.90 | |
| 1000 | 0.90 | 0.90 | 0.90 | 0.90 | 0.90 | 0.89 | 0.89 | 0.90 | 0.89 | 0.90 | |
Note. Bolded values indicate coverage rates of 0.80 or lower.
For correctly specified models, SAM Nonparametric and SAM Parametric consistently yielded the most accurate coverage rates, with values close to 0.90 across all regression coefficients, sample sizes, and distributional conditions. SAM Two-step also performed adequately, although slight undercoverage was observed for some coefficients at smaller sample sizes (e.g., values around 0.87–0.89 at ). SAM Robust showed similar pattern in small samples, particularly under nonnormal conditions, with values declining to approximately 0.84–0.86 for the and parameters. Its performance improved as sample size increased.
Among the SEM approaches, SEM Standard provided acceptable coverage under normal conditions but demonstrated overcoverage for the and parameters in the smallest sample size under nonnormality. SEM Robust showed similar performance to SEM Standard under normal conditions, yielding more stable coverage overall. However, it exhibited slight undercoverage for the and parameters (e.g., 0.86–0.85 at ), which improved as sample size increased.
For misspecified models (see Table 6), across both normal and nonnormal data, SAM Nonparametric consistently outperformed the other LSAM methods, particularly for regression coefficients involving the endogenous variable Z. For and , SAM Nonparametric maintained coverage rates between 0.90 and 0.92 across all sample sizes. For the exogenous coefficient , all LSAM methods showed reasonably high coverage across conditions (typically ranging from 0.87 to 0.90). However, performance for was less stable, with low coverage rates observed across all estimation methods—particularly as sample size increased. These coverage issues may stem from biased point estimates rather than from inaccuracies in SE estimation, consistent with the findings from Study 1.
Table 6
Coverage Rates for SE Methods Across Sample Sizes and Conditions for Misspecified Models in Study 2
| Normal/Misspecified | Nonnormal/Misspecified | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Method | Sample Size | ||||||||
| LSAM Approach | |||||||||
| Two-step standard | 50 | 0.88 | 0.87 | 0.83 | 0.84 | 0.89 | 0.86 | 0.83 | 0.84 |
| 100 | 0.89 | 0.86 | 0.85 | 0.85 | 0.89 | 0.85 | 0.85 | 0.85 | |
| 200 | 0.90 | 0.82 | 0.84 | 0.85 | 0.90 | 0.82 | 0.85 | 0.84 | |
| 500 | 0.90 | 0.72 | 0.85 | 0.85 | 0.90 | 0.70 | 0.85 | 0.86 | |
| 1000 | 0.90 | 0.54 | 0.85 | 0.86 | 0.90 | 0.54 | 0.85 | 0.86 | |
| Two-step robust | 50 | 0.88 | 0.85 | 0.82 | 0.81 | 0.86 | 0.82 | 0.80 | 0.79 |
| 100 | 0.88 | 0.85 | 0.84 | 0.82 | 0.87 | 0.81 | 0.82 | 0.82 | |
| 200 | 0.90 | 0.82 | 0.84 | 0.83 | 0.89 | 0.79 | 0.83 | 0.82 | |
| 500 | 0.90 | 0.72 | 0.84 | 0.83 | 0.89 | 0.68 | 0.84 | 0.84 | |
| 1000 | 0.90 | 0.54 | 0.85 | 0.84 | 0.89 | 0.53 | 0.84 | 0.84 | |
| Nonparametric | 50 | 0.87 | 0.86 | 0.92 | 0.91 | 0.89 | 0.88 | 0.93 | 0.90 |
| 100 | 0.89 | 0.87 | 0.91 | 0.90 | 0.89 | 0.82 | 0.91 | 0.88 | |
| 200 | 0.90 | 0.82 | 0.90 | 0.88 | 0.89 | 0.80 | 0.89 | 0.90 | |
| 500 | 0.89 | 0.68 | 0.92 | 0.90 | 0.90 | 0.68 | 0.90 | 0.90 | |
| 1000 | 0.89 | 0.56 | 0.91 | 0.91 | 0.90 | 0.53 | 0.90 | 0.90 | |
| Parametric | 50 | 0.89 | 0.88 | 0.85 | 0.87 | 0.90 | 0.89 | 0.87 | 0.86 |
| 100 | 0.91 | 0.87 | 0.85 | 0.86 | 0.90 | 0.85 | 0.83 | 0.86 | |
| 200 | 0.90 | 0.81 | 0.86 | 0.85 | 0.90 | 0.83 | 0.87 | 0.85 | |
| 500 | 0.90 | 0.71 | 0.86 | 0.86 | 0.89 | 0.71 | 0.85 | 0.85 | |
| 1000 | 0.90 | 0.53 | 0.85 | 0.86 | 0.91 | 0.53 | 0.86 | 0.87 | |
| SEM Approach | |||||||||
| Standard | 50 | 0.91 | 0.87 | 0.84 | 0.85 | 0.96 | 0.96 | 0.85 | 0.86 |
| 100 | 0.90 | 0.86 | 0.85 | 0.86 | 0.90 | 0.85 | 0.86 | 0.87 | |
| 200 | 0.90 | 0.82 | 0.85 | 0.87 | 0.90 | 0.82 | 0.84 | 0.86 | |
| 500 | 0.90 | 0.72 | 0.82 | 0.87 | 0.90 | 0.70 | 0.82 | 0.87 | |
| 1000 | 0.90 | 0.55 | 0.78 | 0.87 | 0.90 | 0.54 | 0.78 | 0.87 | |
| Robust | 50 | 0.87 | 0.85 | 0.87 | 0.88 | 0.85 | 0.81 | 0.87 | 0.87 |
| 100 | 0.88 | 0.85 | 0.88 | 0.88 | 0.87 | 0.80 | 0.88 | 0.88 | |
| 200 | 0.89 | 0.82 | 0.88 | 0.90 | 0.88 | 0.79 | 0.88 | 0.88 | |
| 500 | 0.90 | 0.72 | 0.85 | 0.89 | 0.89 | 0.68 | 0.87 | 0.90 | |
| 1000 | 0.90 | 0.55 | 0.82 | 0.90 | 0.89 | 0.54 | 0.83 | 0.90 | |
Note. Bolded values indicate coverage rates of 0.80 or lower.
For the SEM methods, coverage for the exogenous coefficient remained relatively high across conditions for both SEM Standard and SEM Robust. SEM Standard produced slightly inflated coverage in small samples under nonnormality (e.g., 0.96 at ), but values remained close to or slightly below 0.90 as sample size increased. For coefficients involving the endogenous variable Z, both SEM methods demonstrated consistent undercoverage. For instance, coverage for in SEM Standard decreased from 0.85 to 0.78 with increasing sample size. SEM Robust provided slightly better coverage rates for these parameters, though coverage rates for remained low in larger samples, consistent with SEM Standard.
Discussion
Previous research has shown little or no interest in the estimation of SEs within the SAM approach. This study aimed to evaluate SEs for structural coefficients in two SEM models using the LSAM framework, which includes four distinct methods: analytic two-step, robust two-step, nonparametric bootstrap, and parametric bootstrap. The performance of these SE methods was compared under varying conditions of sample size, data distribution, and model specification. Additionally, we included standard and robust SEs derived from joint ML to assess how traditional methods performed under identical conditions.
With this aim, we conducted two studies. In Study 1, a two-factor structural model was tested, with misspecification applied to the measurement part. In Study 2, we expanded the initial model to a more complex one, better reflecting real-world applications. Additionally, misspecification was introduced within the structural part. While nonnormality was limited to latent scores in Study 1, Study 2 extended nonnormality to exogenous variables, disturbances, and residuals. Thus, in Study 2, we not only introduced misspecification in the structural part and added multiple sources of nonnormality, but also tested a more complex structural model, offering a more comprehensive assessment of LSAM’s performance for SE estimation under varying conditions.
Similar to the findings of Rosseel and Loh (2024) and Dhaene and Rosseel (2023), the LSAM approach demonstrated robust performance, achieving convergence in all iterations. In the standard estimation approach, convergence issues are frequently encountered, particularly with smaller sample sizes (Anderson & Gerbing, 1984; Boomsma, 1985; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). These challenges, however, were effectively addressed by employing bounded estimation (De Jonckere & Rosseel, 2022), which ensured successful convergence across all conditions, including those involving small sample sizes, for the SEM approach.
Among SE methods, SAM Nonparametric excelled under nonnormal conditions, delivering near-unbiased SE estimates regardless of model specification. SAM Parametric consistently produced minimal bias under normal conditions across all sample sizes in correct models. The SAM Two-step method performed well under normal conditions for both correctly specified but showed greater variability under nonnormal data, especially in smaller sample sizes and misspecified models. Compared to SAM Two-step, the robust variant performed better in larger samples under nonnormality with correct models. Although prior studies primarily focused on point estimates (e.g., MSE values), our findings expand on the work of Rosseel and Loh (2024) and Dhaene and Rosseel (2023) by examining SEs within the LSAM framework. While these studies confirmed robustness for point estimates, our results demonstrate that SEs are also robust under varying conditions. In this sense, the LSAM approach is strengthened — not only are the point estimates accurate, but the SEs are as well. This is important because accurate SEs are central to evaluating the significance of regression coefficients.
Coverage rates in Study 1 and Study 2 exhibited consistent performance patterns across estimation methods within each study. In both studies coverage rates approached 0.90 under correctly specified models across all estimation methods. Under model misspecification, some parameters exhibited very low coverage rates (for all estimation methods), but that is solely due to the fact that the point estimates for these parameters were severely biased in these settings.
Previous research in joint SEM has shown that nonparametric bootstrapping is well capable of estimating SEs. In this study, we set out to evaluate whether similar conclusions can be drawn for the structural coefficients in our two models when adopting the LSAM approach. Our findings align with research in joint ML SEM that highlights the effectiveness of nonparametric bootstrapping for SE estimation (Bollen & Stine, 1990, 1992; Nevitt & Hancock, 2001). For instance, Nevitt and Hancock (2001) showed that bootstrap SEs outperform ML SEs in terms of bias and variability under nonnormality, particularly for sample sizes . Our study extends these conclusions to the LSAM framework, demonstrating that SAM Nonparametric maintains robust performance across varying sample sizes and model specifications, even in smaller sample conditions. Additionally, Yuan and Hayashi (2006) emphasized the consistency of bootstrap SEs under model misspecification — a finding echoed in our results, where SAM Nonparametric delivered near-unbiased estimates despite structural misspecification in Study 2. By evaluating these methods across two models of increasing complexity, our results confirm and expand upon the utility of bootstrapping methods for SE estimation under both normal and nonnormal conditions within the LSAM framework.
Importantly, our study seems to be the first to incorporate parametric bootstrapping within the SEM framework, alongside nonparametric methods. By assuming a specified distribution, parametric bootstrapping demonstrated its potential to provide stable and accurate SE estimates, particularly in smaller sample sizes (Hesterberg, 2015) and when the assumed data distribution, such as normality, closely approximates the true distribution. Our results indicate its effectiveness under normal conditions, even in the presence of model misspecification, and its consistent performance across varying sample sizes. However, it should be noted that a notable drawback of both parametric and nonparametric bootstrapping methods is that they require considerable computational time (Deng et al., 2018).
We acknowledge several limitations in this study. First, the findings are specific to the conditions manipulated in our simulations. Additionally, Study 1 examined a simple two-factor SEM, while Study 2 extended the model by incorporating observed exogenous and endogenous variables. Expanding the scope to include more latent variables or exploring complex models, such as latent growth models, could improve the generalizability of these findings and provide greater support to applied researchers.
Regarding two-step SE estimation in LSAM, the current approach relies on returning to the global model to compute the joint information matrix, which is somewhat incompatible with local SAM. Since a local approach has not (yet) been developed, we opted for this approach. Importantly, we extended this framework to include the robust two-step correction proposed by Yuan and Chan (2002), allowing SEs to be adjusted for nonnormality. This still requires reliance on the global approach, and future research should focus on developing a method that eliminates the need to switch back to a global perspective.
A notable appealing advantage of SAM is its flexibility in expanding the range of possible estimators. By separating the estimation of the measurement model (Step 1) from the structural model (Step 2), SAM enables the use of non-iterative methods from factor-analytic literature in the first step (see Dhaene & Rosseel, 2023). Once estimates for the measurement part are obtained — either iteratively or through closed-form expressions — structural coefficients can also be estimated via closed-form expressions. While this study employed standard iterative estimators for SE estimation, future research could explore the potential advantages of non-iterative estimators. To date, no analytic method exists for obtaining SEs in non-iterative LSAM. Bootstrapping remains the only available procedure, but developing analytic approaches for SE computation would further leverage the flexibility of the LSAM approach.
We conclude that LSAM SE methods offer significant advantages in research settings prone to smaller sample sizes, misspecification, and nonnormality, providing accurate SE estimates under these challenging conditions.
This is an open access article distributed under the terms of the Creative Commons Attribution License (