Original Article

Evaluating the Standard Error Estimation of the Local Structural-After-Measurement (LSAM) Approach in Structural Equation Modeling

Seda Can1 , Yves Rosseel2

Methodology, 2025, Vol. 21(4), 249–285,
https://doi.org/10.5964/meth.16517

Received: 2025-01-14. Accepted: 2025-09-16. Published (VoR): 2025-12-18.

Handling Editor: Eduardo Estrada, Autonomous University of Madrid, Madrid, Spain

Corresponding Author: Seda Can, Department of Psychology, İzmir University of Economics, Sakarya Cd. No:156, 35330 Balçova/İzmir, Türkiye. E-mail: seda.can@ieu.edu.tr

Open Code Badge
Supplementary Materials: Code [see Index of Supplementary Materials]

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Accurate estimation of standard errors (SEs) is essential in SEM as they quantify the uncertainty of parameter estimates, are fundamental to computing test statistics, and ensure robust population inferences. This study evaluated SEs within the Local Structural-After-Measurement (LSAM) framework, a two-step approach to SEM. Two simulation studies examined analytic and resampling-based SE methods under varying conditions, including normal and nonnormal data, different sample sizes, and both correct and misspecified models. The nonparametric bootstrap yielded near-unbiased SEs under nonnormality, even when models were misspecified, while the parametric bootstrap performed well under normal conditions with correct model specification. The analytic two-step method performed well under normal conditions but showed increased bias with nonnormal data and smaller samples. The robust two-step method reduced this bias in larger samples, though some underestimation remained in small-sample and misspecified conditions. To complement SE bias results, 90% coverage rates were assessed. Findings confirm LSAM’s capability for accurate SE estimation in challenging research contexts.

Keywords: standard errors (SEs), local structural-after-measurement (LSAM) approach, two-step estimation, nonparametric bootstrapping, parametric bootstrapping

Evaluating the Standard Error Estimation of the Local Structural-After-Measurement (LSAM) Approach in Structural Equation Modeling

Structural equation modeling (SEM) is extensively used in the social and behavioral sciences to explore relationships between latent variables (Bollen, 1989). SEM typically comprises of a measurement part, which connects latent variables to observable indicators, and a structural part, which captures the hypothesized relationships among these latent variables. While parameter estimation in SEM has been well-studied across various contexts (e.g., normal vs. nonnormal data, correct vs. misspecified models, different estimators), the standard errors (SEs) of these estimates have received relatively less attention (Deng et al., 2018). Since SEM typically relies on sample data to estimate parameters, it is essential to account for sampling variability, as samples rather than entire populations are used. SEs reflect this variability, indicating the precision of parameter estimates: smaller SEs suggest greater precision, while larger SEs indicate more uncertainty. SEs also play a crucial role in computing test statistics, such as z-scores or t-scores, which help determine whether estimated parameters significantly differ from zero or other specified values. Accurate estimation of SEs not only strengthens the reliability of research conclusions but also ensures that population inferences are robust and well-supported (Yuan & Hayashi, 2006).

In SEM, parameters can be estimated in two ways: through the standard estimation approach, which uses a joint or “system-wide” estimation procedure, and the structural-after-measurement (SAM) approach, which divides the estimation process into two parts.1 Recent simulation evidence by Dhaene and Rosseel (2023) indicates that LSAM yields more accurate point estimates than joint SEM — particularly in small to moderate samples — demonstrating its efficiency and stability. While this work provides valuable insights into point estimation accuracy, no studies have investigated the behavior of SEs within this framework. This study addresses this gap by systematically evaluating SE estimation under varying conditions within the LSAM approach to SEM, focusing specifically on continuous (and complete) data.

The rest of the paper is organized as follows. First, we discuss the standard estimation approach in SEM, highlighting key features and challenges. We then introduce the SAM approach, focusing on the local SAM variant, and review methods for SE calculation. Following this, we present the design, methodology, and results of our simulation studies. Finally, we discuss the results and offer insights into future research directions and limitations.

The Standard Estimation Approach in SEM

Parameter estimation in SEM involves a search for parameter values in order to make the model-implied covariance matrix as close as possible to the observed covariance matrix by minimizing a discrepancy function between the two. Various methods exist to define this discrepancy function, leading to different approaches to parameter estimation. Since the early 1970s (Jöreskog, 1973; Keesling, 1972; Wiley, 1973), ML has become the dominant estimator in SEM. This dominance, coupled with its widespread use as the default estimator in SEM packages such as LISREL (Jöreskog & Sörbom, 1996), EQS (Bentler, 2004), Mplus (Muthén & Muthén, 2010), OpenMx (Neale et al., 2016), and lavaan (Rosseel, 2012), led Rosseel and Loh (2024) to refer to ML as the ‘standard’ estimation approach in the SEM framework. In this paper, we similarly refer to SEM ML as the standard estimation approach.

Three key aspects characterize the standard ML estimator in SEM: First, it relies on iterative optimization procedures; second, it achieves optimal statistical properties only when all assumptions are met (i.e., independent and identically distributed observations, normal distribution, and correctly specified model) and the sample size is sufficiently large; and third, all parameters — both in the measurement and structural parts — are estimated simultaneously, a process referred to as system-wide estimation by Bollen (1996). These aspects, however, can lead to several issues, particularly when the sample size is not sufficiently large. One significant problem is nonconvergence, where the iterative optimization procedure fails to find a solution that minimizes the discrepancy function (Anderson & Gerbing, 1984; Boomsma, 1985; De Jonckere & Rosseel, 2022, 2023; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). Even when solutions are found, they might be improper, with parameters estimated beyond their expected range, such as negative variances or correlations greater than one (Chen et al., 2001; Gerbing & Anderson, 1987; van Driel, 1978).

While the simultaneous estimation of all parameters in both the measurement and structural parts is a defining characteristic of standard estimation, this system-wide approach can be effective only when both parts are correctly specified. However, Bollen (1989) points out that the assumption of a correctly specified model rarely holds, given the approximate nature of statistical models. When misspecification occurs in any part of the model — such as a missing cross-loading or error covariance — this can lead to bias across all parameters, including those in correctly specified parts (Bollen, 1996; Kaplan, 1988). In addition, Burt (1973, 1976) identified interpretational confounding as another issue associated with system-wide estimation. In this context, factor loadings for a latent variable, which are expected to remain consistent across models, may vary depending on the structural model applied. This variation can cause the empirical meaning of the latent variable to deviate from its intended meaning, potentially leading to ambiguous inferences across the models. It should be noted that, this concern is specific to system-wide estimators such as ML, where the measurement and structural components are estimated jointly, making parameter estimates in the measurement model susceptible to model misspecification in the structural part. Despite these drawbacks, the ML estimator remains powerful under optimal conditions — such as large sample sizes, normally distributed data, and a correctly specified model — and is widely used in applied settings.

Local Structural-After-Measurement (LSAM) Approach

Challenges associated with system-wide estimation in SEM have led researchers to revisit earlier methodologies within the SEM framework. One such approach, introduced by Burt (1976), involved a two-stage estimation procedure. This method independently fits measurement models before estimating the remaining parameters in the full model to address these challenges. Burt’s work laid the foundation for multi-stage procedures, which were later expanded upon by scholars such as Hunter and Gerbing (1982) and Lance et al. (1988). More recently, Rosseel and Loh (2024) coined the term ‘Structural-after-measurement’ (SAM) to describe this two-stage or two-step approach.

The key advantage of SAM lies in its ability to separate the estimation of measurement models from structural models, thereby preventing one from influencing the other. Building on this rationale, recent advancements include Bakk and Kuha (2018)’s multi-step approach for latent class models, Kuha and Bakk (2023)’s application to latent trait/item response theory models, and Levy (2023)’s Bayesian multi-step approach. Of these methods, the local SAM (LSAM) approach proposed by Rosseel and Loh (2024) stands out as a notable approach within the SEM framework, expanding on previous work in bias-corrected factor score regression (Croon, 2002; Devlieger et al., 2016; Wall & Amemiya, 2000). For a comprehensive discussion of related approaches and their relevance within the SAM framework, see Rosseel and Loh (2024).

LSAM operates in two steps: (1) estimating parameters of the measurement model, and (2) estimating parameters of the structural model. For m latent factors (η) measured via p observed variables, LSAM uses sample summary statistics (the sample mean vector, y¯, and the sample variance-covariance matrix, S), along with estimated measurement parameters, to estimate the mean vector E(η) and the variance-covariance matrix Var(η) of the latent variables. In Step 1, LSAM estimates the free elements of the measurement model, including intercepts (ν), factor loadings (Λ), and residual variances (Θ). To ensure proper mapping from observed to latent variables, LSAM employs a mapping matrix (M) that satisfies MΛ=Im, where Im is the identity matrix. Using the ML discrepancy function, M is computed as follows2,3:

1
M=(ΛΘ1Λ)1ΛΘ1.

The estimated mapping matrix (M^) is used to compute the latent variable central moments:

2
E^(η)=M^[y¯ν^]
3
Var^(η)=M^[SΘ^]M^.

In Step 2, LSAM uses E^(η) and Var^(η) to estimate the structural model parameters, including intercepts (a), regression coefficients (β), and the variance-covariance matrix of the disturbances (Ψ). The choice of estimator in this step depends on the model’s complexity: Ordinary Least Squares (OLS) is appropriate for recursive models, Two-Stage Least Squares (2SLS) is suitable for non-recursive models, and Maximum Likelihood (ML) or Generalized Least Squares (GLS) can be employed for more complex path models.

The LSAM approach offers several distinct advantages over standard estimation in SEM (Rosseel & Loh, 2024). One key benefit is that splitting the measurement and structural parts allows for the implementation of more complex models (e.g., multi-group mixture models; Perez Alonso et al., 2024) that cannot be accommodated in a joint estimation framework. The second advantage is the solution to interpretational confounding, where factor loadings can vary depending on the structural model applied, as mentioned earlier. Another notable advantage is the flexibility of LSAM in allowing different estimators to be used in the measurement and structural parts. For instance, noniterative estimators can be employed for the measurement part, which are often faster and more stable (Dhaene & Rosseel, 2023). Overall, these advantages highlight LSAM as a flexible and efficient estimation strategy, particularly for more complex models that pose challenges for standard estimation approaches.

Different Approaches to Compute SEs

Various methods exist for computing SEs in standard SEM with continuous data. The process of obtaining so-called “standard” (i.e., non-robust) SEs first involves calculating the unit information matrix, which can typically be either observed or expected (Savalei, 2010). Within SEM, these two matrices are typically not equivalent (Yuan & Hayashi, 2006), and most SEM software, including lavaan (Rosseel, 2012), defaults to the expected information matrix for SE calculation. This information matrix is then inverted and divided by the sample size (N) to derive the variance-covariance matrix of the model parameters. Finally, SEs are obtained by taking the square root of the diagonal elements of this matrix.

It is widely acknowledged that when large-sample theory is used to derive analytic expressions for SEs, their performance can suffer in many practical settings due to violations of the underlying assumptions (Yuan & Hayashi, 2006). Robust SEs are often recommended within the ML framework to protect against deviations from normality and correct structural specification (Arminger & Schoenberg, 1989; Satorra & Bentler, 1994; Savalei & Rosseel, 2022). Research on SE performance in SEM is limited, focusing primarily on nonnormality and model misspecifications within the joint SEM approach (Maydeu-Olivares, 2017; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). However, the performance of SEs in the SAM approach, despite its advantages over standard SEM, remains unexplored.

Unlike the standard SEM approach, LSAM separates the estimation of SEs into components related to the measurement and structural parts. SEs for the measurement part can be computed using standard approaches. For the structural part, however, the two-step procedure introduces an additional source of variability. Specifically, the SEs for the structural model must account for the uncertainty carried over from the measurement model estimation. Failing to consider this source of uncertainty results in biased SE estimates (Bakk et al., 2017). Using the analytic procedure below, a joint information matrix is computed for all parameters in the full model, arranged as a partitioned matrix so that the first rows and columns correspond to the parameters of the measurement part:

4
I=[I11I12I21I22].

In this matrix, the subscript “1” refers to the measurement part of the model, while “2” denotes the structural part. The two-step corrected variance-covariance matrix for the structural parameters (Σ2(1)) is then computed as follows:

5
Σ2(1)=I221+I221I21Σ11I12I221,
where Σ11 represents the variance-covariance matrix derived in Step 1. This procedure follows the method outlined in Equation (17) from Bakk et al. (2017), building on the work of Gong and Samaniego (1981) and refined further by Parke (1986). For further details on obtaining these two-step corrected SEs, we refer the reader to Appendix D in Rosseel and Loh (2024).

In the presence of nonnormality, it is critical to use robust standard errors to avoid biased inference. While two-step corrected SEs account for uncertainty carried over from the measurement model, they still rely on the assumptions of correct model specification and multivariate normality. To address this limitation, Yuan and Chan (2002) proposed a robust version of the two-step correction. For technical details, see their Equations (4a) and (4b). A brief description of how ‘robust’ two-step standard errors are computed in the sam() function in lavaan (version 0.6-20 or higher) is included in the Appendix.

The two-step corrected SEs adjust only for the additional variability introduced by separate estimation of the measurement model and are appropriate under normality but not robust to distributional violations. In our study, we implemented both versions to compare their performance under normal and nonnormal conditions within the LSAM framework.

An alternative to analytic expressions for SEs is the resampling approach. A widely used method is bootstrapping (Efron, 1979; Efron & Tibshirani, 1993), where new samples are generated either by resampling with replacement from the original data (i.e., nonparametric bootstrapping) or, in the parametric bootstrapping case, by assuming a specific distribution (e.g., a multivariate normal distribution). For both methods, parameter estimates are calculated for each bootstrap sample, and the standard deviation across all samples is used to approximate the SE for each model parameter.

In SEM, bootstrapping has been widely adopted for obtaining accurate SEs (Bollen & Stine, 1990, 1992; Boomsma, 1986; Hancock & Liu, 2012; Ievers-Landis et al., 2011; Nevitt & Hancock, 2001). Boomsma (1986) showed that bootstrap SEs in covariance structure analysis tend to be larger than ML SEs under skewed data conditions. Subsequent studies expanded bootstrapping to estimate SEs for standardized coefficients, as well as direct, indirect, and total effects (Bollen & Stine, 1990; Stine, 1989). Empirical research further validated its effectiveness in real data settings (Yung & Bentler, 1996). Nevitt and Hancock (2001) highlighted the advantages of bootstrapping over ML under nonnormality, showing that bootstrap SEs performed better in terms of bias and variability for sample sizes n200. Yuan and Hayashi (2006) demonstrated that in addition to robust SEs, bootstrap SEs remained consistent under model misspecifications, unlike non-robust SEs derived from information matrices, which proved unreliable when assumptions of normality and correct structural specification were violated.

While prior studies have primarily focused on nonparametric bootstrapping, we incorporate both parametric and nonparametric methods in our SE estimation to evaluate their relative performance. Parametric bootstrapping, by assuming a specified distribution, has the potential to provide more stable and accurate SE estimates, particularly in small sample sizes where empirical data may fall short in capturing the sampling distribution (Hesterberg, 2015).

In contrast to nonparametric bootstrapping, which resamples the original dataset with replacement, parametric bootstrapping simulates new datasets from a fully specified model. In SEM, this typically involves generating data from the model-implied covariance matrix and mean vector, assuming a multivariate normal distribution. Parameter estimates are obtained from the original sample, and multiple bootstrap datasets are drawn from a p-dimensional multivariate normal distribution with mean vector μ(θ) and covariance matrix Σ(θ), where θ are the fitted model parameters.

The parametric approach offers several advantages when model assumptions are approximately valid. In particular, generating resamples from the model-implied distribution — rather than relying on the empirical distribution — can reduce sampling variability and yield more accurate standard error estimates. These advantages are especially relevant in small sample contexts, where the empirical distribution may inadequately represent the underlying population structure (Hesterberg, 2015).

To our knowledge, no studies have investigated the estimation of SEs within the LSAM approach, nor have they explored both nonparametric and parametric bootstrapping in the LSAM framework. Therefore, this study aims to assess the performance of both analytic and resampling-based SEs in the LSAM approach. We consider correctly specified and misspecified models across varying sample sizes, using both normal and nonnormal distributions. Additionally, standard and robust SEs from system-wide ML were included, with the aim of illustrating the potential extent of bias that may arise when the standard approach is used under the conditions of our simulation design.

Method

To evaluate SE estimation under varying conditions, two simulation studies were conducted, differing primarily in the models employed. In Study 1, data were generated from a simple structural equation model in which a latent variable f1 predicts another latent variable f2, as illustrated in Figure 1. Each latent variable was measured by three continuous indicators. The model and population values were based on those described by Rosseel and Devlieger (2018). In Study 2, the model retained the two latent factors (f1 and f2) with their continuous three indicators from Study 1. To increase complexity and better reflect real-world SEM applications, the model was expanded to include two exogenous observed variables (X and Y) and one endogenous observed variable (Z), thereby incorporating relationships among observed and latent variables. The second model is illustrated in Figure 2, with the population values specified to ensure that the explained variance in Z was determined to be 40%.

Click to enlarge
meth.16517-f1.png
Figure 1

The Model and Unstandardized Population Values Used in the Simulations for Study 1

Note. Residual covariances (dashed double-headed arrows) are included in the population model but omitted in the analysis model under the misspecified condition. For scaling purposes, the first factor loading of each latent variable is fixed to 1 (denoted by 1* in the figure).

Click to enlarge
meth.16517-f2.png
Figure 2

The Model and Unstandardized Population Values Used in the Simulations for Study 2

Note. For scaling purposes, the first factor loading of each latent variable is fixed to 1 (denoted by 1* in the figure).

A few characteristics were common to both studies: (i) the methods being evaluated, (ii) the outcome measures of interest (i.e., SE and coverage rate), and (iii) manipulations of sample size. However, normality and misspecification were varied differently in each study. In Study 1, the misspecification condition was introduced by omitting two residual covariances between the second and third indicators within each latent variable from the analysis model, which were specified as 0.40 in the population model. In contrast, Study 2 introduced misspecification in the structural part by removing the path from f1 to f2. For normality, Study 1 focused on nonnormal latent scores with skewness of - 2 and excess kurtosis of 8, while Study 2 extended nonnormality to include exogenous variables, disturbances, and residuals.

In Study 2, nonnormal exogenous variables were generated with skewness of - 2 and excess kurtosis of 8, consistent with Study 1. Nonnormal disturbances (ζ1 and ζ2) were generated using centered exponential distributions, with rate 1 and variances set to 0.91 and 0.71, respectively. For the normally distributed data, disturbances were drawn from normal distributions with the same variances. These disturbances were added to the latent variables (f1 and f2) to introduce variability according to the specified distribution type. Similarly, measurement errors (ϵ) were generated either from multivariate normal distributions (for normal conditions) or from centered exponential distributions (for nonnormal conditions), scaled to match the diagonal elements of the specified measurement error covariance matrix (Θ). Under nonnormal conditions, residuals were generated independently for each indicator, resulting in uncorrelated errors. The centering of exponential distributions was accomplished by subtracting 1/λ from each draw, where 1/λ corresponds to the mean of an exponential distribution with λ as the specified rate parameter. The exogenous variables X and Y were generated with a target population correlation of 0.4, as specified in the population covariance matrix Φ. Thus, the second study moved the misspecification from the measurement to the structural part and enhanced nonnormality, expanding it from latent scores to three layers of nonnormality.

For the standard estimation approach, standard SEs were computed using the conventional ML estimator (se = ”standard” in lavaan). Robust SEs were obtained using the sandwich estimator (se = ”sandwich”), which corresponds to the MLR method Yuan and Bentler (2000). In the LSAM approach, SEs were computed using: (a) two-step standard errors, (b) robust two-step standard errors following Yuan and Chan (2002)’s correction for nonnormality, (c) nonparametric bootstrap, and (d) parametric bootstrap. The bootstrap methods were implemented via the sam() function in the lavaan package. For nonparametric bootstrapping, we set se = ”bootstrap” and specified bootstrap.type = ”ordinary”, which resamples with replacement from the empirical data; for parametric bootstrapping, we set se = ”bootstrap” with bootstrap.type = ”parametric”, generating datasets from the model-implied multivariate normal distribution defined by the estimated parameter values. For both procedures, 1000 bootstrap resamples were drawn per dataset. The standard deviation of the bootstrap parameter estimates was used as the estimated SE.

To evaluate the accuracy of SE estimates, we computed both empirical and model-based SEs. Empirical SEs were calculated as the standard deviation of point estimates across replications: 10,000 replications were used for non-resampling methods (e.g., standard and two-step approaches), and 1,000 for resampling-based methods (i.e., nonparametric and parametric bootstrap). Model-based SEs were obtained by averaging the SE estimates provided by each method across these replications. Bias was assessed by calculating the ratio of the model-based SE to the empirical SE for each method, with a ratio of 1 indicating unbiased SE estimates, and ratios greater or less than 1 reflecting over- or underestimation, respectively. To provide a more comprehensive assessment of standard error accuracy, we also calculated coverage rates for each parameter of interest based on confidence intervals obtained from each estimation method. Coverage was defined as the proportion of replications in which the model-based 90% confidence interval contained the corresponding population value.

To evaluate the effect of sample size on the performance of the estimation methods, five sample sizes (50,100,200,500, and 1000) were selected to represent a range from small to large samples. This range allowed for a comprehensive assessment of SE accuracy across varying data sizes.

All simulations were conducted in R (R Core Team, 2024) using the lavaan package (Version 0.6–16; Rosseel, 2012). Nonnormal data for latent scores were generated using the rIG function from the covsim package (Version 1.0.0; Grønneberg et al., 2022). Data generation was performed using custom R functions designed to simulate datasets based on specified SEM models and population parameters. The option bounds = TRUE (De Jonckere & Rosseel, 2022) was incorporated within these custom R functions when using the sem() function, ensuring improved convergence and enabling for a fair evaluation across all conditions. The full R code, including simulation details and population values, is available in our OSF repository via Can and Rosseel (2025).

Results

Convergence

No non-convergent solutions were observed in either Study 1 or Study 2: the local SAM approach consistently achieved convergence across all iterations. While convergence failures are often expected for smaller sample sizes in joint SEM ML, the application of bounds successfully mitigated this issue. As a result, no convergence problems were encountered for the SEM approach across all conditions.

Study 1

Standard Error Bias

Figure 3 and Table 1 present results for SE Bias across various sample sizes and estimation methods. Results are shown under both correctly specified and misspecified models, with normal and nonnormal data. The results begin with a comparison of LSAM methods across conditions, followed by an analysis of standard and robust SEs under the SEM approach, to illustrate the extent of potential SE bias associated with standard estimation.

Click to enlarge
meth.16517-f3.png
Figure 3

Bias in SEs Across Various Sample Sizes and SE Methods Under Different Conditions in Study 1

Note. Dashed and dotted horizontal lines indicate reference thresholds at 1.0, 1.1, and 0.9, respectively.

Table 1

Bias Values for SE Methods Across Sample Sizes and Conditions in Study 1

SEM Approach
LSAM Approach
ConditionSample SizeStandardRobustTwo-step standardTwo-step robustNonparametricParametric
Normal/Correct500.811.181.051.041.060.95
1000.881.010.991.001.071.01
2000.961.021.011.021.070.99
5000.981.000.991.010.970.98
10000.980.990.991.011.041.01
Normal/Misspecified500.821.141.030.981.091.02
1000.871.000.960.951.070.99
2000.941.010.980.971.030.99
5000.951.000.970.961.000.95
10000.950.990.960.951.030.98
Nonnormal/Correct500.671.070.991.061.020.91
1000.791.080.900.960.980.89
2000.810.950.860.960.970.90
5000.850.980.871.010.980.87
10000.860.990.861.021.000.88
Nonnormal/Misspecified500.661.060.991.001.000.96
1000.751.010.850.870.970.87
2000.770.950.820.861.060.83
5000.810.980.830.881.020.87
10000.800.970.810.870.960.82

Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.

The analytic two-step method for LSAM (“SAM Two-step”) produced SE estimates close to the unbiased ratio of 1 under normal conditions, irrespective of model specification. Under nonnormal conditions, however, it exhibited increasing bias, with underestimation reaching up to 19% (bias = 0.81), particularly in misspecified models. A similar pattern was observed for the robust LSAM (“SAM Robust”) under normal conditions. However, under the nonnormal/correct condition, it produced nearly unbiased SE values as the sample size increased. In contrast, under the nonnormal/misspecified condition, it tended to underestimate SEs (e.g., bias = 0.87 at N=100). The nonparametric bootstrap method (“SAM Nonparametric”) demonstrated strong performance, especially under nonnormal conditions, yielding nearly unbiased SEs (e.g., bias = 1.00 at N=50 in the nonnormal/misspecified condition). Under normal conditions, it slightly overestimated SEs in smaller samples, with bias decreasing from 9% (bias = 1.09) to 3% (bias = 1.03) as N increased. The parametric bootstrap method (“SAM Parametric”) provided accurate SE estimates under normal conditions, with minimal bias ranging from 5% underestimation (bias = 0.95) to near-unbiased values (bias = 1.01). However, under nonnormal conditions, it showed greater underestimation, with bias ranging from 4% to 18% (bias = 0.96–0.82), especially under model misspecification.

For the standard SEM estimation approach, the classic method based on the expected information matrix (“SEM Standard”) consistently underestimated SEs across all conditions. The largest underestimations occurred under nonnormality and misspecification, with bias ranging from 20% to 34% (bias = 0.80–0.66). Under normal conditions, bias improved with larger sample sizes, ranging from 19% underestimation (bias = 0.81) at N=50 to 2% (bias = 0.98) at N=1000. The robust SEM method (“SEM Robust”) exhibited overestimation of SEs in small samples under normality (e.g., bias = 1.18 at N=50), with accuracy improving as sample size increased (bias = 0.99 at N=1000). In nonnormal conditions, it outperformed SEM Standard, producing SE bias values generally closer to 1.

Coverage Rates

Table 2 presents results for coverage rates and bias of point estimates across various sample sizes and estimation methods.

Table 2

Coverage Rates and Bias of Point Estimates for SE Methods Across Sample Sizes and Conditions in Study 1

SEM Approach
LSAM Approach
Standard
Robust
Two-Step Standard
Two-Step Robust
Nonparametric
Parametric
ConditionSample SizeCoverageBiasCoverageBiasCoverageBiasCoverageBiasCoverageBiasCoverageBias
Normal/Correct500.840.020.880.020.87−0.030.86−0.030.90−0.030.89−0.02
1000.860.010.900.010.88−0.020.87−0.020.90−0.020.89−0.02
2000.890.000.910.000.89−0.010.89−0.010.91−0.010.90−0.01
5000.890.000.900.000.890.000.890.000.890.000.88−0.01
10000.900.000.900.000.900.000.900.000.910.000.900.00
Normal/Misspecified500.72−0.080.78−0.080.71−0.110.69−0.110.77−0.110.77−0.11
1000.67−0.090.72−0.090.64−0.110.63−0.110.68−0.110.65−0.11
2000.59−0.100.62−0.100.55−0.110.54−0.110.56−0.110.55−0.11
5000.36−0.100.39−0.100.33−0.100.32−0.100.35−0.100.34−0.11
10000.15−0.100.16−0.100.12−0.100.12−0.100.14−0.100.11−0.10
Nonnormal/Correct500.790.020.830.020.84−0.010.82−0.010.910.000.89−0.01
1000.820.020.870.020.84−0.010.85−0.010.900.000.84−0.02
2000.830.010.880.010.840.000.870.000.890.000.870.00
5000.840.010.890.010.850.000.890.000.890.000.840.00
10000.840.000.890.000.840.000.900.000.890.000.840.00
Nonnormal/Misspecified500.70−0.040.76−0.040.67−0.090.66−0.090.77−0.090.74−0.09
1000.65−0.070.71−0.070.62−0.100.62−0.100.68−0.090.58−0.11
2000.56−0.090.64−0.090.53−0.100.55−0.100.61−0.100.54−0.10
5000.37−0.100.47−0.100.34−0.100.38−0.100.42−0.100.38−0.10
10000.19−0.100.27−0.100.17−0.100.20−0.100.26−0.100.17−0.10

Note. Bolded values indicate coverage rates of 0.80 or lower.

Coverage rates were generally close to 0.90 under correctly specified models, especially as sample size increased. For example, under the Normal/Correct condition, SAM Two-step yielded a coverage rate that increased from 0.87 at N=50 to 0.90 at N=1000. SAM Two-step and SAM Robust consistently achieved coverage rates close to 0.90 across distributional conditions. SAM Nonparametric also showed similar performance under correct model specification and normal data. SAM Parametric yielded slightly improved coverage in small samples compared to SAM Two-step and SAM Robust, particularly in nonnormal/correct conditions, and converged to values near 0.90 with larger sample sizes. Although all LSAM methods demonstrated coverage rates close to 0.90 under correct model specification, SAM Parametric tended to yield slightly more accurate coverage in normal data conditions, whereas SAM Nonparametric demonstrated slightly higher coverage in nonnormal data conditions.

In contrast, under misspecified models, coverage rates decreased substantially across all methods, exhibiting similarly low coverage levels across sample sizes under misspecification. Among LSAM methods, bootstrap approaches showed slightly better performance at smaller sample sizes in the normal/misspecified condition (e.g., coverage = 0.77 at N=50 for SAM Nonparametric). SEM Robust followed a similar trend to the LSAM methods and consistently outperformed SEM Standard across all misspecified conditions.

Coverage rates under model misspecification can be interpreted by considering the role of point estimate bias. When the true parameter value was 0.25, point estimates consistently underestimated this value by approximately 0.10 across estimation methods, corresponding to a 40% relative underestimation. Despite reasonably accurate SE estimates from the LSAM approach, the resulting confidence intervals were centered on biased estimates. This decline in coverage rates may be primarily attributed to biased point estimates rather than inaccuracies in SE estimation. Even when SEs appropriately reflected the variability of estimates, confidence intervals may have failed to include the true parameter value because they were centered on systematically underestimated point estimates. This shift in location — rather than width — offers a plausible explanation for the reduced coverage rates observed under misspecification. In contrast, under correctly specified models, point estimates were nearly unbiased across all methods, and coverage rates consistently approached 0.90. These results suggest that low coverage under misspecification is largely driven by point estimate bias rather than SE bias.

Study 2

Standard Error Bias

Table 3 presents SE bias for regression coefficients under correctly specified models with normal and nonnormal data across various sample sizes and estimation methods.

Table 3

Bias Values for SE Methods Across Sample Sizes and Conditions for Correctly Specified Models in Study 2

Normal/Correct
Nonnormal/Correct
SE MethodSample Sizef1Xf2Yf2f1Zf1Zf2f1Xf2Yf2f1Zf1Zf2
LSAM Approach
Two-step standard500.960.950.960.950.960.950.930.920.950.95
1000.970.970.970.970.980.960.970.960.970.98
2001.000.990.980.981.000.990.980.980.980.98
5000.990.991.000.990.990.990.980.991.001.00
10001.001.001.001.001.010.990.990.990.991.00
Two-step robust500.970.940.960.960.940.910.870.900.930.91
1000.970.960.960.970.960.920.930.940.960.95
2000.990.980.980.980.970.960.960.970.970.95
5000.990.991.000.990.970.980.970.990.990.98
10001.000.991.001.000.980.980.980.990.980.98
Nonparametric500.981.010.971.061.020.991.021.021.091.01
1001.031.041.021.021.000.980.991.020.980.96
2000.981.020.981.020.980.961.070.960.991.03
5001.021.031.001.021.031.010.970.971.010.99
10000.990.981.001.001.011.010.971.020.991.01
Parametric500.940.981.001.001.030.960.970.991.051.00
1001.011.010.990.991.020.960.970.980.971.00
2000.970.971.011.031.000.991.001.001.031.01
5001.000.981.011.000.980.971.011.010.980.97
10000.990.960.950.991.021.010.971.001.011.03
SEM Approach
Standard501.040.960.940.940.941.261.290.910.950.96
1000.990.980.960.960.970.980.970.960.970.97
2001.010.990.980.980.990.990.990.970.980.98
5000.990.991.000.990.991.010.990.991.001.00
10001.001.001.001.001.010.991.000.990.991.00
Robust500.950.940.960.940.940.900.870.890.900.90
1000.960.970.960.960.970.920.930.940.950.95
2000.990.990.980.980.990.960.960.960.960.96
5000.990.991.000.990.990.980.970.980.990.99
10001.001.001.001.001.010.980.990.980.980.99

Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.

Under normal data, all LSAM methods produced bias values close to 1 across regression coefficients and sample sizes. Bias values for SAM Two-step and SAM Robust tended to slightly underestimate SEs in small samples (e.g., bias = 0.94–0.97 at N=50) converging to near-unbiased values as sample size increased. SAM Nonparametric and SAM Parametric were generally close to 1 (ranging from 0.94 to 1.06).

Under the nonnormal condition, SAM Nonparametric delivered near-unbiased SE estimates across regression coefficients. SAM Two-step and SAM Parametric exhibited slightly more variability, with bias levels depending on the specific parameter and sample size. SAM Robust showed the greatest variability among the LSAM methods, particularly at smaller sample sizes (e.g., for f1X and f2Y) (see Figure 4).

Click to enlarge
meth.16517-f4.png
Figure 4

Bias in SEs Across Structural Coefficients for Sample Sizes and SE Methods Under Nonnormally Distributed Data With a Correct Model in Study 2

For SEM methods, SEM Standard showed minor underestimation in small samples under normality (e.g., 0.94 at N=50) but converged toward unbiased estimates at larger sample sizes. SEM Robust maintained stable SE bias across all coefficients and sample sizes, with estimates showing approximately 6% underestimation to 1% overestimation (bias values ranging from 0.94 to 1.01). Under nonnormal data, SEM Robust outperformed SEM Standard, which showed more variability, particularly for f1X and f2Y in small samples.

For misspecified models (see Table 4), all LSAM methods produced values close to 1 for the f1X and f2Y regression coefficients under normally distributed data. However, differences emerged for regression coefficients involving the endogenous observed variable Z. For Zf1 and Zf2, SAM Nonparametric performed best, producing the most accurate SE estimates across sample sizes. In contrast, all other LSAM methods displayed underestimation, ranging from 19% to 10% (SE bias values from 0.81 to 0.90). SEM Standard exhibited higher bias values, particularly for smaller sample sizes in the Zf1 coefficient. SEM Robust outperformed SEM Standard, yielding lower bias across all regression coefficients and sample sizes.

Table 4

Bias Values for SE Methods Across Sample Sizes and Conditions for Misspecified Models in Study 2

Normal/Misspecified
Nonnormal/Misspecified
SE MethodSample Sizef1Xf2YZf1Zf2f1Xf2YZf1Zf2
LSAM Approach
Two-step standard500.970.960.830.850.960.930.820.83
1000.970.980.850.870.960.960.850.86
2001.000.990.870.880.990.980.860.86
5000.991.000.870.880.990.980.880.88
10001.000.990.880.890.990.990.870.88
Two-step robust500.970.950.830.810.910.890.790.77
1000.970.970.840.830.930.930.820.81
2001.000.980.850.840.960.970.840.82
5000.991.000.860.840.980.970.860.85
10001.000.990.870.850.980.990.850.85
Nonparametric500.950.961.051.020.991.011.091.01
1000.971.011.021.010.980.990.980.96
2001.021.000.970.980.961.030.991.03
5000.981.001.041.031.010.971.010.99
10000.981.011.001.021.010.940.991.01
Parametric500.970.990.890.880.960.950.910.87
1001.020.990.860.900.960.940.840.88
2001.010.960.900.870.990.990.910.90
5000.981.010.900.900.970.970.870.86
10000.991.020.880.901.010.960.890.91
SEM Approach
Standard501.040.980.860.871.251.310.870.88
1000.990.990.890.900.980.960.890.89
2001.000.990.900.920.990.980.900.90
5000.991.000.910.911.010.990.920.92
10001.000.990.920.930.991.000.910.92
Robust500.950.940.940.940.890.880.900.90
1000.960.970.960.980.910.930.950.95
2000.990.990.980.990.960.960.960.96
5000.991.000.990.990.980.970.990.99
10001.000.991.001.010.981.000.980.99

Note. Standard error bias values less than 0.90 or greater than 1.10 are bolded to indicate deviation from the unbiased value of 1.00.

Under nonnormal data with the misspecified model (see Figure 5), SAM Nonparametric delivered nearly unbiased SEs for f1X and f2Y, followed closely by SAM Parametric. SAM Two-step showed higher bias in smaller sample sizes, with underestimation around 7%. SAM Robust displayed slightly more bias in smaller samples for these coefficients (e.g., 0.91 and 0.89 at N=50), but approached values near 1 as sample size increased (e.g., 0.98 and 0.99 at N=1000). SEM Standard exhibited the largest biases for smaller sample sizes, with 25% and 31% overestimation for f1X and f2Y, respectively. SEM Robust performed better but still slightly underestimated these coefficients by about 10% in the smallest sample size. Bias values for both standard and robust SEs decreased with increasing sample sizes.

Click to enlarge
meth.16517-f5.png
Figure 5

Bias in SEs Across Structural Coefficients for Sample Sizes and SE Methods Under Nonnormally Distributed Data With a Misspecified Model in Study 2

Among LSAM methods, for regression coefficients involving Z, SAM Nonparametric again performed best, providing accurate SE estimates. SEM Standard and SEM Robust both exhibited underestimation for Zf1 in the smallest sample size, with underestimation of 13% and 10%, respectively, but the values improved as sample size increased.

Coverage Rates

Table 5 presents results for coverage rates in correctly specified models across various sample sizes and estimation methods.

Table 5

Coverage Rates for SE Methods Across Sample Sizes and Conditions for Correctly Specified Models in Study 2

Normal/Correct
Nonnormal/Correct
SE MethodSample Sizef1Xf2Yf2f1Zf1Zf2f1Xf2Yf2f1Zf1Zf2
LSAM Approach
Two-step standard500.880.880.880.890.890.890.880.880.890.89
1000.890.890.890.890.890.890.890.890.900.90
2000.900.900.890.890.900.900.890.890.890.89
5000.900.900.900.900.900.900.900.900.900.90
10000.900.900.900.900.900.900.900.900.900.90
Two-step robust500.880.870.870.880.870.860.840.860.870.86
1000.880.880.880.890.880.870.870.870.890.88
2000.890.890.890.890.890.890.880.890.890.88
5000.900.890.900.900.890.890.890.890.900.89
10000.900.900.900.900.890.890.890.900.890.89
Nonparametric500.890.900.880.910.910.890.920.910.930.90
1000.910.910.900.900.910.890.890.910.910.88
2000.890.900.900.920.880.890.920.880.890.90
5000.900.910.900.910.900.900.890.900.900.90
10000.910.900.890.910.910.900.890.910.900.90
Parametric500.890.900.900.910.910.900.890.890.930.92
1000.900.910.920.900.910.890.880.900.890.91
2000.900.900.900.910.910.900.900.900.920.90
5000.900.890.900.900.900.890.900.900.890.88
10000.900.890.880.900.910.910.890.900.900.91
SEM Approach
Standard500.910.880.880.880.890.960.960.880.890.90
1000.900.900.890.890.890.900.890.890.900.90
2000.900.890.890.890.900.900.900.890.890.90
5000.900.900.900.890.900.910.900.900.900.90
10000.900.900.900.900.900.900.900.900.900.90
Robust500.870.870.880.870.880.860.850.860.870.87
1000.880.880.880.880.880.870.870.870.880.88
2000.890.890.890.890.900.880.880.880.890.88
5000.900.900.900.890.900.890.890.890.900.90
10000.900.900.900.900.900.890.890.900.890.90

Note. Bolded values indicate coverage rates of 0.80 or lower.

For correctly specified models, SAM Nonparametric and SAM Parametric consistently yielded the most accurate coverage rates, with values close to 0.90 across all regression coefficients, sample sizes, and distributional conditions. SAM Two-step also performed adequately, although slight undercoverage was observed for some coefficients at smaller sample sizes (e.g., values around 0.87–0.89 at N=50). SAM Robust showed similar pattern in small samples, particularly under nonnormal conditions, with values declining to approximately 0.84–0.86 for the f2Y and f2f1 parameters. Its performance improved as sample size increased.

Among the SEM approaches, SEM Standard provided acceptable coverage under normal conditions but demonstrated overcoverage for the f1X and f2Y parameters in the smallest sample size under nonnormality. SEM Robust showed similar performance to SEM Standard under normal conditions, yielding more stable coverage overall. However, it exhibited slight undercoverage for the f1X and f2Y parameters (e.g., 0.86–0.85 at N=50), which improved as sample size increased.

For misspecified models (see Table 6), across both normal and nonnormal data, SAM Nonparametric consistently outperformed the other LSAM methods, particularly for regression coefficients involving the endogenous variable Z. For Zf1 and Zf2, SAM Nonparametric maintained coverage rates between 0.90 and 0.92 across all sample sizes. For the exogenous coefficient f1X, all LSAM methods showed reasonably high coverage across conditions (typically ranging from 0.87 to 0.90). However, performance for f2Y was less stable, with low coverage rates observed across all estimation methods—particularly as sample size increased. These coverage issues may stem from biased point estimates rather than from inaccuracies in SE estimation, consistent with the findings from Study 1.

Table 6

Coverage Rates for SE Methods Across Sample Sizes and Conditions for Misspecified Models in Study 2

Normal/Misspecified
Nonnormal/Misspecified
MethodSample Sizef1Xf2YZf1Zf2f1Xf2YZf1Zf2
LSAM Approach
Two-step standard500.880.870.830.840.890.860.830.84
1000.890.860.850.850.890.850.850.85
2000.900.820.840.850.900.820.850.84
5000.900.720.850.850.900.700.850.86
10000.900.540.850.860.900.540.850.86
Two-step robust500.880.850.820.810.860.820.800.79
1000.880.850.840.820.870.810.820.82
2000.900.820.840.830.890.790.830.82
5000.900.720.840.830.890.680.840.84
10000.900.540.850.840.890.530.840.84
Nonparametric500.870.860.920.910.890.880.930.90
1000.890.870.910.900.890.820.910.88
2000.900.820.900.880.890.800.890.90
5000.890.680.920.900.900.680.900.90
10000.890.560.910.910.900.530.900.90
Parametric500.890.880.850.870.900.890.870.86
1000.910.870.850.860.900.850.830.86
2000.900.810.860.850.900.830.870.85
5000.900.710.860.860.890.710.850.85
10000.900.530.850.860.910.530.860.87
SEM Approach
Standard500.910.870.840.850.960.960.850.86
1000.900.860.850.860.900.850.860.87
2000.900.820.850.870.900.820.840.86
5000.900.720.820.870.900.700.820.87
10000.900.550.780.870.900.540.780.87
Robust500.870.850.870.880.850.810.870.87
1000.880.850.880.880.870.800.880.88
2000.890.820.880.900.880.790.880.88
5000.900.720.850.890.890.680.870.90
10000.900.550.820.900.890.540.830.90

Note. Bolded values indicate coverage rates of 0.80 or lower.

For the SEM methods, coverage for the exogenous coefficient f1X remained relatively high across conditions for both SEM Standard and SEM Robust. SEM Standard produced slightly inflated coverage in small samples under nonnormality (e.g., 0.96 at N=50), but values remained close to or slightly below 0.90 as sample size increased. For coefficients involving the endogenous variable Z, both SEM methods demonstrated consistent undercoverage. For instance, coverage for Zf1 in SEM Standard decreased from 0.85 to 0.78 with increasing sample size. SEM Robust provided slightly better coverage rates for these parameters, though coverage rates for Zf1 remained low in larger samples, consistent with SEM Standard.

Discussion

Previous research has shown little or no interest in the estimation of SEs within the SAM approach. This study aimed to evaluate SEs for structural coefficients in two SEM models using the LSAM framework, which includes four distinct methods: analytic two-step, robust two-step, nonparametric bootstrap, and parametric bootstrap. The performance of these SE methods was compared under varying conditions of sample size, data distribution, and model specification. Additionally, we included standard and robust SEs derived from joint ML to assess how traditional methods performed under identical conditions.

With this aim, we conducted two studies. In Study 1, a two-factor structural model was tested, with misspecification applied to the measurement part. In Study 2, we expanded the initial model to a more complex one, better reflecting real-world applications. Additionally, misspecification was introduced within the structural part. While nonnormality was limited to latent scores in Study 1, Study 2 extended nonnormality to exogenous variables, disturbances, and residuals. Thus, in Study 2, we not only introduced misspecification in the structural part and added multiple sources of nonnormality, but also tested a more complex structural model, offering a more comprehensive assessment of LSAM’s performance for SE estimation under varying conditions.

Similar to the findings of Rosseel and Loh (2024) and Dhaene and Rosseel (2023), the LSAM approach demonstrated robust performance, achieving convergence in all iterations. In the standard estimation approach, convergence issues are frequently encountered, particularly with smaller sample sizes (Anderson & Gerbing, 1984; Boomsma, 1985; Nevitt & Hancock, 2004; Yuan & Bentler, 1997). These challenges, however, were effectively addressed by employing bounded estimation (De Jonckere & Rosseel, 2022), which ensured successful convergence across all conditions, including those involving small sample sizes, for the SEM approach.

Among SE methods, SAM Nonparametric excelled under nonnormal conditions, delivering near-unbiased SE estimates regardless of model specification. SAM Parametric consistently produced minimal bias under normal conditions across all sample sizes in correct models. The SAM Two-step method performed well under normal conditions for both correctly specified but showed greater variability under nonnormal data, especially in smaller sample sizes and misspecified models. Compared to SAM Two-step, the robust variant performed better in larger samples under nonnormality with correct models. Although prior studies primarily focused on point estimates (e.g., MSE values), our findings expand on the work of Rosseel and Loh (2024) and Dhaene and Rosseel (2023) by examining SEs within the LSAM framework. While these studies confirmed robustness for point estimates, our results demonstrate that SEs are also robust under varying conditions. In this sense, the LSAM approach is strengthened — not only are the point estimates accurate, but the SEs are as well. This is important because accurate SEs are central to evaluating the significance of regression coefficients.

Coverage rates in Study 1 and Study 2 exhibited consistent performance patterns across estimation methods within each study. In both studies coverage rates approached 0.90 under correctly specified models across all estimation methods. Under model misspecification, some parameters exhibited very low coverage rates (for all estimation methods), but that is solely due to the fact that the point estimates for these parameters were severely biased in these settings.

Previous research in joint SEM has shown that nonparametric bootstrapping is well capable of estimating SEs. In this study, we set out to evaluate whether similar conclusions can be drawn for the structural coefficients in our two models when adopting the LSAM approach. Our findings align with research in joint ML SEM that highlights the effectiveness of nonparametric bootstrapping for SE estimation (Bollen & Stine, 1990, 1992; Nevitt & Hancock, 2001). For instance, Nevitt and Hancock (2001) showed that bootstrap SEs outperform ML SEs in terms of bias and variability under nonnormality, particularly for sample sizes n200. Our study extends these conclusions to the LSAM framework, demonstrating that SAM Nonparametric maintains robust performance across varying sample sizes and model specifications, even in smaller sample conditions. Additionally, Yuan and Hayashi (2006) emphasized the consistency of bootstrap SEs under model misspecification — a finding echoed in our results, where SAM Nonparametric delivered near-unbiased estimates despite structural misspecification in Study 2. By evaluating these methods across two models of increasing complexity, our results confirm and expand upon the utility of bootstrapping methods for SE estimation under both normal and nonnormal conditions within the LSAM framework.

Importantly, our study seems to be the first to incorporate parametric bootstrapping within the SEM framework, alongside nonparametric methods. By assuming a specified distribution, parametric bootstrapping demonstrated its potential to provide stable and accurate SE estimates, particularly in smaller sample sizes (Hesterberg, 2015) and when the assumed data distribution, such as normality, closely approximates the true distribution. Our results indicate its effectiveness under normal conditions, even in the presence of model misspecification, and its consistent performance across varying sample sizes. However, it should be noted that a notable drawback of both parametric and nonparametric bootstrapping methods is that they require considerable computational time (Deng et al., 2018).

We acknowledge several limitations in this study. First, the findings are specific to the conditions manipulated in our simulations. Additionally, Study 1 examined a simple two-factor SEM, while Study 2 extended the model by incorporating observed exogenous and endogenous variables. Expanding the scope to include more latent variables or exploring complex models, such as latent growth models, could improve the generalizability of these findings and provide greater support to applied researchers.

Regarding two-step SE estimation in LSAM, the current approach relies on returning to the global model to compute the joint information matrix, which is somewhat incompatible with local SAM. Since a local approach has not (yet) been developed, we opted for this approach. Importantly, we extended this framework to include the robust two-step correction proposed by Yuan and Chan (2002), allowing SEs to be adjusted for nonnormality. This still requires reliance on the global approach, and future research should focus on developing a method that eliminates the need to switch back to a global perspective.

A notable appealing advantage of SAM is its flexibility in expanding the range of possible estimators. By separating the estimation of the measurement model (Step 1) from the structural model (Step 2), SAM enables the use of non-iterative methods from factor-analytic literature in the first step (see Dhaene & Rosseel, 2023). Once estimates for the measurement part are obtained — either iteratively or through closed-form expressions — structural coefficients can also be estimated via closed-form expressions. While this study employed standard iterative estimators for SE estimation, future research could explore the potential advantages of non-iterative estimators. To date, no analytic method exists for obtaining SEs in non-iterative LSAM. Bootstrapping remains the only available procedure, but developing analytic approaches for SE computation would further leverage the flexibility of the LSAM approach.

We conclude that LSAM SE methods offer significant advantages in research settings prone to smaller sample sizes, misspecification, and nonnormality, providing accurate SE estimates under these challenging conditions.

Notes

1) It could be argued that equation-by-equation approaches, such as the model-implied instrumental variable two-stage least squares (MIIV-2SLS) estimator (Bollen, 1996), or the James–Stein estimator (Burghgraeve et al., 2021), constitute a third approach, but they are not considered in this paper.

2) Note that this expression may look familiar, as it corresponds to Bartlett’s factor score matrix used for computing factor scores (Bartlett, 1937, 1938). Moreover, factor score regression (FSR) with Croon’s correction (Croon, 2002) represents a special case of LSAM, utilizing the mapping matrix from this equation.

3) Rosseel and Loh (2024) present alternative formulations of the mapping matrix M derived from different discrepancy functions (e.g., ML, GLS, ULS).

Funding

The authors have no funding to report.

Acknowledgments

The first author acknowledges the support provided by the Scientific and Technological Research Council of Turkey (TUBITAK).

Competing Interests

The authors have declared that no competing interests exist.

Supplementary Materials

Type of supplementary materialsAvailability/Access
Data
No study data is available.
Code
Code R - including simulation details and population values.Can and Rosseel (2025)
Material
No study materials are available.
Study/Analysis preregistration
The study was not preregistered.
Other
No other material to report.

References

  • Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49(2), 155-173. https://doi.org/10.1007/BF02294170

  • Arminger, G., & Schoenberg, R. J. (1989). Pseudo maximum likelihood estimation and a test for misspecification in mean and covariance structure models. Psychometrika, 54(3), 409-425. https://doi.org/10.1007/BF02294626

  • Bakk, Z., & Kuha, J. (2018). Two-step estimation of models between latent classes and external variables. Psychometrika, 83(4), 871-892. https://doi.org/10.1007/s11336-017-9592-7

  • Bakk, Z., Oberski, D. L., & Vermunt, J. K. (2017). Relating latent class assignments to external variables: Standard errors for correct inference. Political Analysis, 22(4), 520-540. https://doi.org/10.1093/pan/mpu003

  • Bartlett, M. S. (1937). The statistical conception of mental factors. British Journal of Psychology, 28, 97-104.

  • Bartlett, M. S. (1938). Methods of estimating mental factors. Nature, 141, 609-610.

  • Bentler, P. M. (2004). EQS 6 structural equations program book [Computer software manual]. Multivariate Software..

  • Bollen, K. A. (1989). Structural equations with latent variables. John Wiley & Sons.

  • Bollen, K. A. (1996). An alternative two stage least squares (2sls) estimator for latent variable equations. Psychometrika, 61(1), 109-121. https://doi.org/10.1007/BF02296961

  • Bollen, K. A., & Stine, R. A. (1990). Direct and indirect effects: Classical and bootstrap estimates of variability. In C. C. Clogg (Ed.), Sociological methodology, (pp. 115–140). Blackwell.

  • Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21(2), 205-229. https://doi.org/10.1177/0049124192021002004

  • Boomsma, A. (1985). Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation. Psychometrika, 50(2), 229-242. https://doi.org/10.1007/BF02294248

  • Boomsma, A. (1986). On the use of bootstrap and jackknife in covariance structure analysis. In N. L. F. De Antoni & A. Rizzi (Eds.), Compstat 1986: Proceedings in computational statistics, (pp. 205–210). Physica.

  • Burghgraeve, E., Neve, J. D., & Rosseel, Y. (2021). Estimating structural equation models using James–Stein type shrinkage estimators. Psychometrika, 86(2), 668-668. https://doi.org/10.1007/s11336-021-09766-1

  • Burt, R. S. (1973). Confirmatory factor-analytic structures and the theory construction process. Sociological Methods & Research, 2(2), 131-190. https://doi.org/10.1177/004912417300200201

  • Burt, R. S. (1976). Interpretational confounding of unobserved variables in structural equation models. Sociological Methods & Research, 5(1), 3-52. https://doi.org/10.1177/004912417600500101

  • Can, S., & Rosseel, Y. (2025). Evaluating the standard error estimation of Local Structural-After-Measurement (LSAM) approach in structural equation modeling [OSF project page containing study code]. Open Science Framework. https://osf.io/ygte5/overview

  • Chen, F., Bollen, K. A., Paxton, P., Curran, P. J., & Kirby, J. B. (2001). Improper solutions in structural equation models: Causes, consequences, and strategies. Sociological Methods & Research, 29(4), 468-508. https://doi.org/10.1177/0049124101029004003

  • Croon, M. (2002). Using predicted latent scores in general latent structure models. In G. Marcoulides & I. Moustaki (Eds.), Latent variable and latent structure models, (pp.195–223). Lawrence Erlbaum.

  • De Jonckere, J., & Rosseel, Y. (2022). Using bounded estimation to avoid nonconvergence in small sample structural equation modeling. Structural Equation Modeling, 29(3), 412-427. https://doi.org/10.1080/10705511.2021.1982716

  • De Jonckere, J., & Rosseel, Y. (2023). A model-based shrinkage target to avoid non-convergence in small sample SEM. Structural Equation Modeling, 30(6), 941-955. https://doi.org/10.1080/10705511.2023.2171420

  • Deng, L., Yang, M., & Marcoulides, K. M. (2018). Structural equation modeling with many variables: A systematic review of issues and developments. Frontiers in Psychology, 9, Article 580. https://doi.org/10.3389/fpsyg.2018.00580

  • Devlieger, I., Mayer, A., & Rosseel, Y. (2016). Hypothesis testing using factor score regression: A comparison of four methods. Educational and Psychological Measurement, 76(5), 741-770. https://doi.org/10.1177/0013164415607618

  • Dhaene, S., & Rosseel, Y. (2023). An evaluation of non-iterative estimators in the Structural After Measurement (SAM) approach to Structural Equation Modeling (SEM). Structural Equation Modeling, 30(6), 926-940. https://doi.org/10.1080/10705511.2023.2220135

  • Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7(1), 1-26. https://doi.org/10.1214/aos/117634455

  • Efron, B., & Tibshirani, T. J. (1993). An introduction to the bootstrap. Chapman & Hall.

  • Gerbing, D. W., & Anderson, J. C. (1987). Improper solutions in the analysis of covariance structures: Their interpretability and a comparison of alternate respecifications. Psychometrika, 52(1), 99-111. https://doi.org/10.1007/BF02293958

  • Gong, G., & Samaniego, F. J. (1981). Pseudo maximum likelihood estimation: Theory and applications. Annals of Statistics, 9(4), 861-869.

  • Grønneberg, S., Foldnes, N., & Marcoulides, K. M. (2022). Covsim: An R package for simulating non-normal data for structural equation models using copulas. Journal of Statistical Software, 102(3), 1-45. https://doi.org/10.18637/jss.v102.i03

  • Hancock, G. R., & Liu, M. (2012). Bootstrapping standard errors and data-model fit statistics in structural equation modeling. In R. H. Hoyle (Ed.), Handbook of structural equation modeling, (pp. 296–306). Guilford Press.

  • Hesterberg, T. C. (2015). What teachers should know about the bootstrap: Resampling in the undergraduate statistics curriculum. American Statistician, 69(4), 371-386. https://doi.org/10.1080/00031305.2015.1089789

  • Hunter, J. E., & Gerbing, D. W. (1982). Unidimensional measurement, second order factor analysis, and causal models. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 4, pp. 267–320). JAI Press.

  • Ievers-Landis, C. E., Burant, C. J., & Hazen, R. (2011). The concept of bootstrapping of structural equation models with smaller samples: An illustration using mealtime rituals in diabetes management. Journal of Developmental and Behavioral Pediatrics, 32(8), 619-626. https://doi.org/10.1097/DBP.0b013e31822bc74f

  • Jöreskog, K. G. (1973). A general method for estimating a linear structural equation system. In A. S. Duncan (Ed.), Structural equation models in the social sciences, (pp. 85–112). Seminar Press.

  • Jöreskog, K. G., & Sörbom, D. (1996). Lisrel 8: User’s reference guide [Computer software manual]. Scientific Software International.

  • Kaplan, D. (1988). The impact of specification error on the estimation, testing, and improvement of structural equation models. Multivariate Behavioral Research, 23(1), 69-86. https://doi.org/10.1207/s15327906mbr2301_4

  • Keesling, J. W. (1972). Maximum likelihood approaches to causal flow analysis [Unpublished doctoral dissertation]. University of Chicago.

  • Kuha, J., & Bakk, Z. (2023). Two-step estimation of latent trait models. arXiv preprint, arXiv:2303.16101.

  • Lance, C. E., Cornwell, J. M., & Mulaik, S. A. (1988). Limited information parameter estimates for latent or mixed manifest and latent variable models. Multivariate Behavioral Research, 23(2), 171-187. https://doi.org/10.1207/s15327906mbr2302_3

  • Levy, R. (2023). Precluding interpretational confounding in factor analysis with a covariate or outcome via measurement and uncertainty preserving parametric modeling. Structural Equation Modeling, 30(5), 719-736. https://doi.org/10.1080/10705511.2022.2154214

  • Maydeu-Olivares, A. (2017). Maximum likelihood estimation of structural equation models for continuous data: Standard errors and goodness of fit. Structural Equation Modeling, 24(3), 383-394. https://doi.org/10.1080/10705511.2016.1269606

  • Muthén, L. K., & Muthén, B. O. (2010). Mplus user’s guide (6th ed.) [Computer software manual]. Muthén & Muthén.

  • Neale, M. C., Hunter, M. D., Pritikin, J. N., Zahery, M., Brick, T. R., Kirkpatrick, R. M., Estabrook, R., Bates, T. C., Maes, H. H., & Boker, S. M. (2016). Openmx 2.0: Extended structural equation and statistical modeling. Psychometrika, 81(2), 535-549. https://doi.org/10.1007/s11336-014-9435-8

  • Nevitt, J., & Hancock, G. R. (2001). Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Structural Equation Modeling, 8(3), 353-377. https://doi.org/10.1207/S15328007SEM0803_2

  • Nevitt, J., & Hancock, G. R. (2004). Evaluating small sample approaches for model test statistics in structural equation modeling. Multivariate Behavioral Research, 39(3), 439-478. https://doi.org/10.1207/S15327906MBR3903_3

  • Parke, W. R. (1986). Pseudo maximum likelihood estimation: The asymptotic distribution. Annals of Statistics, 14(1), 355-357.

  • Perez Alonso, A. F., Rosseel, Y., Vermunt, J. K., & De Roover, K. (2024). Mixture multigroup structural equation modeling: A novel method for comparing structural relations across many groups [Advance online publication]. Psychological Methods. https://doi.org/10.1037/met0000667

  • R Core Team. (2024). R: A language and environment for statistical computing [Computer software manual]. R Foundation for Statistical Computing. https://www.R-project.org/

  • Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1-36. https://doi.org/10.18637/jss.v048.i02

  • Rosseel, Y., & Devlieger, I. (2018). Why we may not need SEM after all [Conference presentation]. SEM Working Group Meeting, Amsterdam, the Netherlands.

  • Rosseel, Y., & Loh, W. W. (2024). A structural after measurement approach to structural equation modeling. Psychological Methods, 29(3), 561-588. https://doi.org/10.1037/met0000503

  • Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variables analysis: Applications for developmental research, (pp. 399–419). SAGE Publications.

  • Savalei, V. (2010). Expected versus observed information in SEM with incomplete normal and nonnormal data. Psychological Methods, 15(4), 352-367. https://doi.org/10.1037/a0020143

  • Savalei, V., & Rosseel, Y. (2022). Computational options for standard errors and test statistics with incomplete normal and nonnormal data in SEM. Structural Equation Modeling, 29(2), 163-181. https://doi.org/10.1080/10705511.2021.1877548

  • Stine, R. A. (1989). An introduction to bootstrap methods: Examples and ideas. Sociological Methods and Research, 18(2–3), 243-291. https://doi.org/10.1177/0049124189018002003

  • van Driel, O. P. (1978). On various causes of improper solutions in maximum likelihood factor analysis. Psychometrika, 43(2), 225-243. https://doi.org/10.1007/BF02293865

  • Wall, M. M., & Amemiya, Y. (2000). Estimation for polynomial structural equation models. Journal of the American Statistical Association, 95(451), 929-940. https://doi.org/10.2307/2669475

  • Wiley, D. E (1973). The identification problem for structural equation models with unmeasured variables. In A. S. Duncan (Ed.), Structural equation models in the social sciences (pp. 69–83). Seminar Press.

  • Yuan, K.-H., & Bentler, P. M. (1997). Improving parameter tests in covariance structure analysis. Computational Statistical Data Analysis, 26(4), 177-198. https://doi.org/10.1016/S0167-9473(97)00025-X

  • Yuan, K.-H., & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30(1), 165-200. https://doi.org/10.1111/0081-1750.00078

  • Yuan, K.-H., & Chan, W. (2002). Fitting structural equation models using estimating equations: A model segregation approach. British Journal of Mathematical and Statistical Psychology, 55(1), 41-62. https://doi.org/10.1348/000711002159699

  • Yuan, K.-H., & Hayashi, K. (2006). Standard errors in covariance structure models: Asymptotics versus bootstrap. British Journal of Mathematical and Statistical Psychology, 59(2), 397-417. https://doi.org/10.1348/000711005X85896

  • Yung, Y.-F., & Bentler, P. M. (1996). Bootstrapping techniques in analysis of mean and covariance structures. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 195–226). Lawrence Erlbaum Associates.

Appendix

Robust Two-Step Corrected Standard Errors

This section provides a brief description of how ‘robust’ two-step corrected standard errors are computed in the sam() function in lavaan (Version 0.6-20 or higher). The formulas are based on (Yuan & Chan, 2002).

For simplicity, we only assume a covariance structure Σ(ϑ) without a meanstructure. We will also assume that normaly theory maximum likelihood (ML) estimation is used in both steps, although the formulas can easily be adapted for other estimators like normal theory GLS, or WLS/ADF. The sample covariance matrix is denoted by S. Let s=vech(S) be the vector of nonredundant elements in S by stacking the lower-triangular columns (including the diagonal) into a single vector. Similarly, we write σ=vech(Σ) and σ(ϑ)=vech(Σ(ϑ)).

In local SAM, the T1 parameters ϑ1 related to the measurement part of the model are estimated in a first step (possibly in parts), while the T2 parameters ϑ2 related to the structural part of the model are estimated in a second step.

For the first step, we can write ϑ^1=h1(s) where h1() is an implicit function that maps s to ϑ^1. Let Γ denote (N times) the asymptotic variance matrix of the sample statistics s. Then, by using the Delta method, we find that an estimate of (N times) the covariance matrix of ϑ^1 can be written as

A1
NACOV(ϑ^1)=PΓ^PT
where P is the jacobian of the implicit function h1(), evaluated at σ^=vech(Σ(ϑ1^)). There are multiple ways to express P, but if we use the normal theory ML discrepancy function, then a common way to express P is as follows:
A2
P=(σ˙1TW1σ˙1)1σ˙1TW1
where σ˙1 is the jacobian of σ(ϑ1), and W1=12DT(Σ(ϑ1) - 1Σ(ϑ1) - 1)D, and D is the duplication matrix. To accomodate for B measurement blocks, we can partition P in B parts: P1, P2, …, PB. A measurement block typically only needs a subset sb of the data, and we can write sb=Lbs, where Lb is a selection matrix. Similarly, a measurement block only produces estimates for a subset ϑ1b of ϑ1, and we can write ϑ1b=Hbϑ1 where Hb is again a selection matrix. For each measurement block, we have
A3
Pb=Hb(σ˙1bTW1bσ˙1b)1σ˙1bTW1bLb.

In the second step, we estimate ϑ2 as a function of ϑ^1 and the data. At this point, we switch back to the global model, and we fill all the estimated parameters into the model matrices of the full model. Based on the model-implied covariance matrix Σ(ϑ1,ϑ2), we can compute a joint T×T information matrix for all the parameters in the full model. We can partition the information matrix as follows:

A4
I=(I11I12I21I22),
where the 1–index corresponds to the measurement part, and the 2–index corresponds to the structural part. The formula for this joint information matrix can be written as
I=σ˙TWσ˙
where σ˙ is the jacobian of σ(ϑ1,ϑ2), and W=12DT(Σ(ϑ1,ϑ2) - 1Σ(ϑ1,ϑ2) - 1)D. Note that in general W1W, unless the structural model is saturated. Using this notation, let I22=(σ˙ϑ2TWσ˙ϑ2), I2f=(σ˙ϑ2TW), If2=(Wσ˙ϑ2), and I21=(σ˙ϑ2TWσ˙ϑ1). The ‘robust’ corrected T2×T2 variance–covariance matrix of the structural parameters (Σ2(1)) can then be expressed as follows:
A5
Σ2(1)=1NI221[I2fΓIf2+I21PΓIf2+I2fΓPTI12+I21PΓPTI12]I221.