Extension card · Classical
Bayesian BWM (Mohammadi and Rezaei, 2020)
Bayesian BWM is the form of BWM that combines the best-to-others and others-to-worst comparisons given by multiple decision-makers into a single hierarchical probability model and converts them into weights. The output is still a weight vector, but each weight now comes with a confidence interval and a probability table showing how certain the superiority between criteria actually is.
Base method
BWM →
Philosophy, mechanics, strengths and weaknesses are on the base method card; this card describes only the difference.
Data type (family)
Classical →
What this data type is, when to use it, how to write it in a cell: the family's full account is here.
What Changes from the Base Method?
Three things change; the best-to-others and others-to-worst comparison logic does not.
Cells and the number of decision-makers. Crisp BWM expects a single best/worst choice and two comparison vectors from one decision-maker. Here multiple decision-makers (k of them) evaluate the same criteria, each with their own best/worst choice and their own comparison vectors. Every decision-maker's figures are, as in crisp BWM, whole numbers on a 1–9 scale; what changes is how many people they come from.
Combining the weights. Where crisp BWM has more than one decision-maker, the simplest route is to solve each decision-maker's weights separately and then average them. Bayesian BWM does not do this. Instead, it builds a three-layer hierarchy that assumes the decision-makers' weights are drawn from a shared "group" distribution. Each decision-maker's weight vector is distributed around a group mean, and that group mean is in turn distributed around a higher-level reference distribution. The best/worst comparisons the decision-makers give are treated as observations feeding this hierarchy. The model finds the probability distribution (the posterior) that best fits these observations by sampling (adaptive block Metropolis). DecisionMind runs this sampling with a fixed starting seed and convergence checks (R-hat, effective sample size, acceptance rate); if any of these checks fails, it stops before producing a result.
Outcome and defuzzification. Crisp BWM derives a single weight vector and one consistency indicator (ξ*) from a single linear model. Here, three things are derived from the thousands of possible weight vectors the sampling produces: each criterion's average weight (the posterior mean), a 95 per cent confidence interval for each criterion, and the probability that one criterion's weight exceeds another's (a credal, or probabilistic, ranking matrix). Crisp BWM's ξ* consistency indicator does not exist here; its place is taken by the sampling's convergence checks. These answer a different question: ξ* asks "are the comparisons consistent with one another," while the convergence checks ask "is this numerical solution reliable."
DecisionMind fixes, for this extension, the mathematical form of the hierarchy (the Dirichlet-Gamma hierarchy published by Mohammadi and Rezaei) and the confidence threshold used for the probabilistic ranking (95 per cent, adjustable by the user).
How to Read the Output
The average weight, as in crisp BWM, shows a criterion's relative importance against the others within this particular set of comparisons. Here, though, it is not a single number but the summary of a distribution. The confidence interval shows how wide that distribution is; the probabilistic ranking table shows how robust the superiority between two criteria actually is.
This distinction matters: even where two criteria's average weights appear in a given order, the probability of that order can fall below the declared threshold (95 per cent, say). In that case the averages may suggest an order, but that order cannot be treated as statistically settled.
Thus instead of writing:
"The posterior means put C2 ahead of C3, so C2 is more important"
the report should read:
"The posterior means put C2 ahead, but if the probability of this superiority falls below the declared 95 per cent threshold, the order cannot be treated as statistically settled"
When to Prefer This over the Base Method
Use Bayesian BWM when several decision-makers will weight the criteria, and you want any disagreement between them reported openly rather than masked by a simple average. With a single decision-maker this hierarchy contributes nothing; crisp BWM is sufficient and runs faster.
Crisp BWM's exit condition applies here too: decision-makers must be able to choose the best and worst criterion with confidence. In addition, if the sampling fails to converge (R-hat above threshold, insufficient effective sample size), DecisionMind stops before producing a result; the number of iterations should then be increased, or the decision-makers' comparisons reviewed.
Mistakes Specific to This Extension
Confusing the order of posterior means with the probabilistic ranking. Even where two criteria's average weights appear in a given order, the probability of that order can fall below the threshold; declaring a "definite" order from the averages alone is wrong.
Leaving the sample size too small. Too few iterations produce an unstable posterior; DecisionMind catches this with its R-hat and effective-sample-size checks, but that protection weakens if the threshold is set too loosely.
Letting one severely inconsistent decision-maker dominate the group. If one decision-maker's comparisons conflict sharply with the others (the kind that would give a high ξ* in crisp BWM), that decision-maker can single-handedly pull the group posterior; decision-maker reliability should be assessed separately.
Presenting only the average without reporting the confidence interval at all. This hides the method's main contribution, which is keeping uncertainty visible.
The governing principle is this:
Bayesian BWM weights summarise a distribution that arises from multiple decision-makers' comparisons. The average may suggest an order; how robust that order actually is can only be read from the probabilistic ranking table and the declared confidence threshold.
Cases
The first case is DecisionMind's validation example. The three-decision-maker, three-criterion table in the manifest is an illustrative construction designed to sample the hierarchical model published by Mohammadi and Rezaei (2020); it is not the paper's own numerical application. The second case is an illustrative construction.
1. Illustrative example (DecisionMind's validation example): Three decision-makers weighting three criteria
A team will weight three criteria: C1, C2, C3. All three decision-makers (DM1, DM2, DM3) chose C1 as the most important criterion and C3 as the least important, but the numerical comparisons they gave, from best to others and from others to worst, differ slightly from one another.
| Decision-maker | Best-to-others (C1,C2,C3) | Others-to-worst (C1,C2,C3) |
|---|---|---|
| DM1 | 1, 3, 7 | 7, 2, 1 |
| DM2 | 1, 4, 8 | 8, 3, 1 |
| DM3 | 1, 3, 6 | 6, 2, 1 |
The method feeds these three decision-makers' comparisons as observations into a hierarchical probability model and produces the posterior by adaptive block Metropolis sampling. It then applies the convergence checks (R-hat, effective sample size, acceptance rate).
| Criterion | Posterior mean weight | 95% confidence interval |
|---|---|---|
| C1 | 0.6622 | [0.489 ; 0.806] |
| C2 | 0.2261 | [0.115 ; 0.363] |
| C3 | 0.1116 | [0.048 ; 0.210] |
The result reads as follows. C1 receives by far the highest average weight, and its confidence interval does not overlap with either C2's or C3's; this superiority is robust. The probability of C1's superiority over C2 and over C3 is close to 99.7 per cent and 100 per cent respectively. But the probability of C2's superiority over C3 is only 94.9 per cent, just below the 95 per cent threshold the manifest declares.
The team's hesitation: one of the three decision-makers, DM2, gave the most extreme comparisons (1,4,8 and 8,3,1). When this decision-maker is removed from the panel and the model rerun independently with the remaining two, the average weights shift to C1≈0.646, C2≈0.232, C3≈0.122, and the probability of C2's superiority over C3 drops to 87.1 per cent. In other words, once the panel is reduced to two decision-makers, this order, already below threshold, weakens further. C1's superiority, by contrast, stays above 99 per cent in both cases and does not change.
In the report: "The three decision-makers' posterior mean weights show the order C1 (0.662), C2 (0.226), C3 (0.112). C1's superiority is robust (probability above 99 per cent); however, C2's superiority over C3 falls below the declared 95 per cent threshold (94.9 per cent) and weakens further once one decision-maker is removed from the panel (87.1 per cent)."
Source: DecisionMind's Bayesian BWM validation example; it stays faithful to the hierarchical Dirichlet-Gamma model and adaptive sampling logic published by Mohammadi and Rezaei (2020) in Omega. The posterior means, confidence intervals and the scenario of removing one decision-maker from the panel were verified with an independent Python computation (same hierarchy, same seed).
2. Early childhood education: Weighting the criteria for opening a new nursery
A municipality's early childhood education unit will weight three criteria before opening a new nursery: the density of children in the neighbourhood, the suitability of the building's safety, and the availability of staff. The unit has had three different assessors, a city planner, a safety engineer and an education inspector, compare these three criteria using their own best/worst choices.
The method feeds the three assessors' comparisons as observations into the hierarchical model, samples the posterior, and applies the convergence checks. Suppose the suitability of the building's safety receives the highest average weight, and the probability of this superiority comes out above the declared threshold.
The unit's hesitation: the average weights for staff availability and for the density of children come out close to one another, and the probability of superiority between these two criteria falls below the threshold. One assessor (the education inspector) gave these two criteria markedly different importance from the others; the robustness of the order cannot be known until this single assessor is removed from the panel.
In the report: "The suitability of the building's safety receives the highest average weight, and this superiority is robust. The order between staff availability and the density of children falls below the declared confidence threshold; no definite priority should be claimed between these two criteria."
3. What Not to Do
The first error, in the illustrative example, is looking only at the posterior means (0.662 / 0.226 / 0.112) and declaring "C2 is definitely more important than C3"; the probability of this superiority (94.9 per cent) falls below the declared 95 per cent threshold. The second error is reporting the result without ever checking the sampling's convergence indicators (R-hat, effective sample size); the average of a sampling that has not converged is not reliable. The third error is accepting the weights as final without testing how far a single decision-maker giving the most extreme comparisons (such as DM2) has pulled the group result.
Sources
For the formulas behind each step, the intermediate tables and citation formats, see the DecisionMind method page: decisionmind.app/library/bwm-bayesian
Mohammadi, M., & Rezaei, J. (2020). Bayesian best-worst method: A probabilistic group decision making model. Omega, 96, 102075. DOI: 10.1016/j.omega.2019.06.001
Rezaei, J. (2015). Best-worst multi-criteria decision-making method. Omega, 53, 49–57. DOI: 10.1016/j.omega.2014.11.009
Rezaei, J. (2016). Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega, 64, 126–130. DOI: 10.1016/j.omega.2015.12.001
Liang, F., Brunelli, M., & Rezaei, J. (2020). Consistency issues in the best worst method: Measurements and thresholds. Omega, 96, 102175. DOI: 10.1016/j.omega.2019.102175