16. Extended BIC (EBIC) Scoreο
16.1. Summaryο
The Extended BIC (EBIC) Score is a generalization of BIC intended for high-dimensional settings. It adds an extra penalty term that depends on the number of possible edges, favoring sparser graphs more strongly than standard BIC.
16.2. When to useο
Number of variables is large relative to the sample size.
You want stronger sparsity encouragement than standard BIC provides.
You are using score-based methods (FGES, BOSS, GRaSP) in high-dimensional regimes.
16.3. Model classο
Typically applied to linear Gaussian or discrete DAGs, but the EBIC form is generic.
16.4. Score form (conceptual)ο
A common EBIC form is:
EBIC = 2 * logL β k * ln(N) β 2 * Ξ³ * ln(choose(p, k_edges))
where Ξ³ is a parameter in [0, 1], p is the number of variables, and
k_edges is the number of edges.
16.5. Parametersο
Parameter (camelCase) |
Description |
|---|---|
|
Double in [0, 1]. The gamma parameter for Extended BIC (EBIC). Values closer to 0 reduce EBIC to ordinary BIC; values closer to 1 add a strong extra penalty for models with many predictors (useful in high-dimensional settings). Default is 0.8. |
|
Boolean. If |
|
Double. Handles singular or nearly singular covariance matrices. If |
|
Double > 0, or |
16.6. Strengthsο
More conservative than BIC, tending to select sparser graphs in high- dimensional settings.
Supported by theory in some sparse regression and graphical model contexts.
16.7. Limitationsο
Choice of Ξ³ is somewhat problem-dependent.
May penalize edges too strongly when N is not extremely small compared to p.
16.8. Referencesο
Chen, J., & Chen, Z. (2008). Extended Bayesian information criteria for model selection with large model spaces. Biometrika, 95(3), 759β771.