Ranking
Cross-Validation: k-fold hold-out validation of MCDM decision consistency
Stone, M. · 1974
Overview
Robustness wrapper: k-fold cross-validation for MCDM stability. Output typically robustness_score (higher value = preferred).
Strengths
- •Method-specific: Robustness wrapper: k-fold cross-validation for MCDM stability
Limitations
- •Assumes: A base ranking method is selected
- •Assumes: Computational budget for repeated runs
Method assistant
Grounded explanations: it explains the method, it does not compute.
Assumptions to verify
- •A base ranking method is selected
- •Computational budget for repeated runs
When not to use
- •Quick analysis needed → defer robustness check
Edge cases
- •See F.steps and D.parameters for CROSS-VALIDATION-specific edge handling. recommendation_metadata.assumptions_to_verify also lists boundary conditions.
Common pitfalls
- •Hatalı: 'CROSS-VALIDATION bu varsayımı kontrol etmeden uygulamak'. Doğrusu: A base ranking method is selected
- •Hatalı: 'CROSS-VALIDATION bu varsayımı kontrol etmeden uygulamak'. Doğrusu: Computational budget for repeated runs
- •Hatalı: CROSS-VALIDATION'yi 'Quick analysis needed → defer robustness check' durumunda kullanmak: recommendation_metadata.not_recommended_when alternatif öneriyor.
Worked example
- 1.Adım 1 (F1): Validate inputs for cross-validation. Formül: \text{CV error}=\frac{1}{k}\sum_{f=1}^k\text{err}_f;\quad\text{err}_f=\frac{1}{|\text{fold}_f|}\sum_{i\in\text{fold}_f}|\hat{r}_i-r_i| Anchor: Stone 1974, (pending PDF page verification)
How to cite
Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society Series B. https://doi.org/10.1111/j.2517-6161.1974.tb00994.x