Methods · Aggregation and voting
Bonferroni Mean (BM)
The Bonferroni mean pairs up criteria two at a time and averages the product of each pair, so that a weakness on one criterion overlapping with a weakness on another is penalised more heavily than a weakness standing alone.
Base method's data type: Classical
What Is the Method?
The Bonferroni mean is an aggregation building block that treats criteria in pairs rather than one at a time. It is not a stand-alone decision method like WAM; it is an aggregation step that replaces WAM when criteria are assumed to interact, that is, when a weakness on one criterion combines with a weakness on another to make matters worse. The product of every possible pair of criteria is taken, these products are averaged, and the root of the result is taken. Its output is a single number on the same scale as the inputs.
The method's name comes from the Italian mathematician Carlo Bonferroni, who defined sums of pairwise products in 1950; at the time there was no decision-analysis application, only a pure inequality. The paper that carried this definition into multi-criteria decision-making and set out its weighted form is Beliakov and colleagues' 2010 article; shortly afterwards Xu and Yager extended the operator to intuitionistic fuzzy numbers.
The Philosophy Behind It
The philosophy of the Bonferroni mean is to capture situations where criteria are not independent of one another. WAM sums each criterion oblivious to the others; one criterion being weak and another strong does not change the result, because the contributions simply add up. The Bonferroni mean, by contrast, pairs every criterion with every other criterion and multiplies them; if two criteria are weak at the same time, that pair yields a low product and drags the average down. Where only a single criterion is weak while the others are strong, this effect is more limited, because that weak criterion only affects the pairs that include it.
This places the Bonferroni mean within a view of decision-making that says "risk spreads between criteria." When assessing a system's security, for instance, a single weak point is a concern, but two weak points existing at the same time is a far greater risk; the Bonferroni mean captures this kind of contagion assumption numerically. WAM cannot see this contagion, because it treats criteria as independent of one another.
How It Works
The Bonferroni mean requires four inputs: criterion scores, two parameters (p and q), and optional weights.
First, validate the inputs. Check that there are at least two criteria, that p and q are non-negative, and that, if weights are used, they sum to 1.
Second, take the unweighted Bonferroni mean. For every ordered pair of criteria (every pairwise combination in which a criterion is not paired with itself), one criterion's p-th power is multiplied by the other's q-th power. These products are averaged, and then the (p plus q)-th root of that average is taken.
Third, move to the weighted form. Where criteria carry different importance, a weighted average, using the product of each pair's weights, replaces the simple average in the second step.
Fourth, rank. This procedure is repeated for every alternative, and the alternatives are ranked from the highest resulting score to the lowest.
The formula behind this step, the intermediate tables and the citation formats are given on the DecisionMind method page; this card carries no formulas.
How to Read the Output
The number the Bonferroni mean returns is an overall performance figure that reflects how much mutual weakness overlaps between criteria. A low score can indicate that several criteria are weak at the same time; an isolated weakness on a single criterion does not produce such a sharp drop.
The most notable feature of this figure is that it can distinguish situations WAM cannot. Two alternatives with the same average score, one balanced and one unbalanced, are equal according to WAM; the Bonferroni mean separates the two by giving them different scores and places the unbalanced one slightly behind.
Thus instead of writing:
"The Bonferroni score came out low, so this alternative is generally weak"
the report should read:
"The Bonferroni score came out low; this indicates the alternative may be weak on several criteria at once, and which pairs of criteria contributed to this drop should be examined separately"
Data Type and Inputs
The Bonferroni mean works with crisp, non-negative data. DecisionMind holds no separate fuzzy, grey or intuitionistic extension of this building block; it works with crisp numbers.
You need: scores for at least two criteria, on the same scale and comparable with one another; a choice for the p and q parameters (setting both equal to 1 is the most common and most interpretable starting point); and, optionally, weights that sum to 1. As p and q grow larger, the operator becomes more sensitive to extreme values; this choice comes not from the data but from the analyst's view of risk, and it must be stated in the report.
When to Use It, When Not To
The Bonferroni mean is a suitable choice when criteria genuinely interact, that is, when several criteria being weak at once is considered worse than a single criterion being weak. It has a natural place in fields such as security, risk management and quality control, where the view that "weaknesses combining is dangerous" holds.
Where criteria are genuinely independent of one another, or where there is no information to justify a choice of the p and q parameters, the Bonferroni mean adds unnecessary complexity, and WAM is sufficient. It should also not be used if the interpretation cannot easily be explained to the decision-maker, that is, if you are not prepared for the question "why did these two alternatives with the same average receive different scores."
Criteria interact with one another (risk of simultaneous weakness) → Bonferroni mean
Criteria are independent, no extra complexity is needed → WAM
Not interaction but the wish to penalise a single criterion's extreme low value → WGM or WHM
Interaction is wanted not between pairs but among triples or larger groups → Heronian mean or higher-order generalisations
The degree of interaction should be adjustable through a single parameter → Power Mean, though this family does not capture criterion interaction
Strengths
The Bonferroni mean's chief advantage is that it makes visible a piece of information WAM cannot see: mutual weakness between criteria. As Beliakov and colleagues show, this feature gives the operator sound mathematical properties, preserving monotonicity and boundary conditions (Beliakov et al., 2010). Furthermore, through the p and q parameters, the operator can be tuned across a wide range, from full compensation (as p and q approach zero) to capturing strong interaction; this flexibility, as Xu and Yager show, also carries over to settings with uncertain and subjective assessments (Xu and Yager, 2011).
Weaknesses
The Bonferroni mean's weakness is that its interpretation is far harder than WAM's; explaining to a decision-maker why two alternatives with the same average received different scores takes extra effort. Moreover, the choice of the p and q parameters is largely arbitrary; different p, q pairs can produce different rankings from the same data, and this choice usually comes not from the data but from the analyst's assumption (Beliakov et al., 2010). Finally, as the number of criteria grows, the number of pairs grows rapidly; the computational load is heavier than WAM's, and this performance effect must be borne in mind when working with many criteria.
Common Mistakes
The most common mistake is leaving the p and q parameters at their default value (usually p = q = 1) without offering any justification; this choice rests on an assumption, not on the data, and must be explained in the report. A second mistake is using the Bonferroni mean when criteria are genuinely independent; in that case the operator adds needless complexity and produces no meaningfully different result from WAM. A third mistake is confusing a small difference between two alternatives' Bonferroni scores with a small difference in the underlying interaction pattern; even where the score gap is small, the criterion pattern beneath it can be very different.
The governing principle is this:
The Bonferroni mean can distinguish two alternatives that WAM shows as equal; but if the result is reported without explaining which pair of criteria the distinction comes from, it remains unintelligible.
Cases
Each case opens with a decision table, describes in words what the method does to it, and shows how to read the result. The first case is a worked example DecisionMind constructed for validation, showing with concrete figures how the Bonferroni mean distinguishes two alternatives that WAM shows as equal.
1. Cybersecurity: Comparing the security posture of two systems (illustrative example)
Suppose an organisation's information security team assesses two systems on three measures (patch compliance rate, access control score, monitoring coverage score; all on a 0–1 scale and "higher is better"). p = q = 1 and equal weighting (the unweighted form) are used.
| System | Patch compliance | Access control | Monitoring coverage |
|---|---|---|---|
| S1 | 0.4 | 0.6 | 0.8 |
| S2 | 0.6 | 0.6 | 0.6 |
| Direction | higher is better | higher is better | higher is better |
S1's patch compliance is low (0.4) and its monitoring coverage is high (0.8). All three of S2's measures are middling (0.6).
Computed with WAM: S1 = (0.4+0.6+0.8)/3 = 0.600. S2 = (0.6+0.6+0.6)/3 = 0.600. The two systems are exactly equal under WAM.
Computed with the Bonferroni mean: S1 = 0.589. S2 = 0.600. The Bonferroni mean distinguishes the two systems that WAM shows as equal, and places S2 slightly ahead.
| System | WAM score | Bonferroni score |
|---|---|---|
| S1 | 0.600 | 0.589 |
| S2 | 0.600 | 0.600 |
The result reads as follows. WAM fully offsets S1's low patch compliance with its high monitoring coverage and shows the two systems as equal. The Bonferroni mean, by contrast, catches the low product in the pairs where S1's patch compliance is matched against the other two measures, and this pulls S1's score below S2's. Because no pair in S2 is weak, no penalty arises there.
The security team hesitates here: S1 has a single weak point (patch compliance), whereas S2 has no strong point at all. The Bonferroni mean placing S2 ahead rests on the assumption that "weakness spread out but balanced is safer than weakness concentrated in one point"; this assumption may not hold in every organisation, and the team must discuss it openly.
In the report: "Under WAM the two systems have an equal security score (0.600); but under the Bonferroni mean, which accounts for interaction between criteria, S2 comes out slightly ahead (0.600 against 0.589), because S1's weakness in patch compliance pulls its score down once paired with the other measures."
Source: this table is an illustrative example DecisionMind constructed to validate its Bonferroni mean engine against WAM comparatively; it is not taken from a specific article. The engine produces the same results.
2. Maritime: Assessing equipment maintenance condition at a port operation
A port operator will assess the maintenance condition of three crane units on three measures (mechanical condition score, electronic control system score, operator feedback score; all "higher is better"). The maintenance team chose the Bonferroni mean because it considers two systems being weak at the same time to carry a serious risk of failure.
The method pairs the three units' scores two at a time and averages them. Suppose one unit's mechanical condition and electronic control score are both low at the same time, while its operator feedback is high; the Bonferroni mean catches the pair where these two weak measures meet, and places the unit further behind than WAM would.
The maintenance team hesitates here: high operator feedback could mean the equipment causes no problems in daily use. Yet the simultaneous presence of mechanical and electronic weakness may point to a serious risk of failure in the coming period. The Bonferroni mean's low score should be read as an early warning of this risk.
In the report: "According to the Bonferroni mean, the unit whose mechanical condition and electronic control are weak at the same time falls behind; this may indicate a high risk of failure in the coming period and should be taken as a priority in the maintenance plan."
3. Disaster Management: Combining resilience scores in shelter-site selection
A disaster management unit will assess three candidate shelter buildings on three measures (structural resilience score, ease-of-access score, capacity score; all "higher is better"). The unit prefers the Bonferroni mean because it considers that structural resilience and ease of access being low at the same time could render a building unusable.
The method pairs the three buildings' scores two at a time and averages them. Suppose one building scores medium-low on structural resilience and ease of access at the same time, but high on capacity; the Bonferroni mean penalises this simultaneous weakness in the two measures and places the building further behind than WAM would show.
The unit hesitates here: high capacity during a disaster is of no use if the building is not earthquake-resistant or if its access routes are compromised. The Bonferroni mean placing this building behind is apt precisely because it captures exactly this kind of risk.
In the report: "According to the Bonferroni mean, the building whose structural resilience and ease of access are weak at the same time falls behind; even though its capacity is high, the simultaneous weakness in these two measures can jeopardise usability."
4. What Not to Do
Had S1's monitoring coverage score in the cybersecurity table also been low (say 0.4), and had this gone unnoticed and been reported using WAM alone, S1's true level of risk would have remained invisible, despite being far worse than S2's, which WAM shows as equal. A second error is reporting only that "the Bonferroni mean was used" without stating the p and q parameters at all; different choices of p and q can produce different rankings, and this choice must be stated explicitly in the report. A third error is treating the small gap of 0.011 between S1 and S2 (0.600 against 0.589) as an insignificant rounding error; this gap is a direct numerical trace of the interaction between criteria and must not be disregarded.
Sources
For the formula behind this step, the intermediate tables and citation formats (BibTeX, RIS, APA), see the DecisionMind method page: decisionmind.app/library/bonferroni-mean
Bonferroni, C. (1950). Sulle medie multiple di potenze. Bollettino dell'Unione Matematica Italiana, 5, 267–270. (no DOI)
Beliakov, G., James, S., Mordelová, J., Rückschlossová, T., & Yager, R. R. (2010). Generalized Bonferroni mean operators in multi-criteria aggregation. Fuzzy Sets and Systems, 161(17), 2227–2242. DOI: 10.1016/j.fss.2010.04.004
Xu, Z., & Yager, R. R. (2011). Intuitionistic fuzzy Bonferroni means. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 41(2), 568–578. DOI: 10.1109/TSMCB.2010.2072918