Methods · Ranking
STOCHASTIC-UTA (Additive Utility Method under Uncertainty)
STOCHASTIC-UTA derives a consistent utility function from a reference ranking supplied by the decision-maker, and carries uncertainty in the criterion values through into the result by sampling.
Base method's data type: Classical
What Is the Method?
STOCHASTIC-UTA answers, together, the questions "how is a decision-maker's implicit evaluation logic inferred from the way they ranked a few alternatives" and "how does that logic stay reliable when the criterion values are not known precisely." Its output is a utility, or acceptability, score for every alternative and the rank that score produces. Stavrou, Ventikos and Tsoukalas proposed the method in 2018 for risk assessment in maritime operations such as ship-to-ship fuel transfer. It can also be used in other fields involving uncertainty, such as energy technology selection, supplier selection and healthcare system evaluation. It combines UTA's (Jacquet-Lagrèze and Siskos, 1982) classical approach of inferring utility from preference (preference disaggregation) with the logic of SMAA (Stochastic Multicriteria Acceptability Analysis), which measures acceptability under uncertainty.
The Philosophy Behind It
UTA's philosophy is to observe how the decision-maker ranks a few alternatives, rather than asking them directly for a formula or a set of weights, and to reverse-engineer a utility function consistent with that ranking. STOCHASTIC-UTA adds a layer of uncertainty to this. The criterion values themselves may not be known precisely; a measurement error margin or an expert estimate may be involved. In that case, the method repeatedly samples these values from a probability distribution instead of treating them as single numbers, and redoes the utility calculation for every sample.
An analogy makes this clear. A doctor, rather than trusting a single test result, accounts for the margin of measurement error. They assess the same test result under many possible error scenarios and ask "in what percentage of the plausible error range does this diagnosis hold." STOCHASTIC-UTA works the same way: the result is not a single definite ranking but an acceptability rate of the kind "in what percentage of the samples did this alternative come out best." The philosophical consequence is that the method is both additive and compensatory, and that it turns uncertainty explicitly into the language of probability rather than hiding it.
How It Works
The method proceeds through nine steps; the first six hold even without uncertainty, and the last three add the uncertainty sampling.
First step, direction correction. Cost criteria are reversed so that every criterion can be treated as "higher is better"; each criterion's best and worst value is recorded.
Second step, dividing the criterion range into stages. Each criterion's range from worst to best is divided into a set number of equal stages. These stages are the points at which the utility function will be defined piecewise, linearly.
Third step, the linear relationship between stages. Each alternative's value on each criterion is expressed linearly between the two nearest stages; this allows the utility function to be written as a combination of the unknown stage values.
Fourth step, building the linear programming model. A model is built that minimises the total error while remaining consistent with the decision-maker's reference ranking. The model carries three kinds of constraint. Preference constraints require the utility difference between every consecutive pair in the reference ranking to exceed a set threshold. Monotonicity constraints ensure that, for a given criterion, no later stage yields a lower utility than the one before it. Normalisation constraints fix the worst stage's utility at zero and the sum of every criterion's best-stage utilities at one.
Fifth step, solving the model. The linear programming model is solved to find the utility value at every stage of every criterion; the solution gives the utility function most consistent with the reference ranking.
Sixth step, computing the total utility. Each alternative's total utility is found by summing the utility values corresponding to its criterion values.
Seventh step, uncertainty sampling. If the criterion values are not precise, each value is drawn at random from its own probability distribution; steps three through six are then repeated many times over these samples. If the values are precise, this step reduces to a single computation.
Eighth step, computing the acceptability rates. For every alternative, the number of samples in which it comes out in each rank is counted; from this a rank-acceptability rate and an overall acceptability score are derived for every alternative.
Ninth step, ranking. Alternatives are ranked from largest to smallest acceptability score; when no uncertainty sampling has been carried out, this ranking is identical to the ranking by total utility.
The formulas behind each step, the intermediate tables and the citation formats are given on the DecisionMind method page; this card carries no formulas.
How to Read the Output
When no uncertainty sampling has been carried out (the deterministic mode), the score is the total utility computed from the utility function consistent with the decision-maker's reference ranking; the best alternative takes a value close to 1, the worst close to 0. When uncertainty sampling has been carried out, the score is an acceptability rate: a summary of how often, and in which rank, the alternative appeared across the samples. In both cases the score is meaningful only for this particular alternative set and this reference ranking.
The error margin (F*) that emerges from solving the model should also not be overlooked. If F* is zero, the reference ranking is fully consistent with an additive utility function. If F* is greater than zero, the decision-maker's preferences do not fit an additive model exactly; this is not an error, it is the method's own way of quantifying that inconsistency.
For this reason:
"STOCHASTIC-UTA found the most accurate ranking"
should be written instead as:
"This ranking is the product of the utility function consistent with the reference ranking the decision-maker supplied; where uncertainty sampling was used, the score is an acceptability rate, not a guarantee of a definite ranking"
Data Type and Inputs
STOCHASTIC-UTA works with crisp data: one number per cell, and optionally a probability distribution. DecisionMind holds STOCHASTIC-UTA only in this base form; there is no separate data-type extension.
You need alternatives in rows, criteria in columns, one number per cell; direction information for every criterion. You also need a reference ranking from the decision-maker covering at least a few alternatives, whether the full set or a representative subset. STOCHASTIC-UTA produces weights rather than requiring them from outside; the utility function takes their place. If the uncertainty mode is to be used, a probability distribution is also needed for every criterion cell. The recommended number of alternatives is between three and thirty, with a comfortable range of four to fifteen; the comfortable range for the number of criteria is three to ten.
When to Use It, When Not To
STOCHASTIC-UTA is a suitable choice when the decision-maker can reliably rank a few alternatives and a general evaluation logic (a utility function) needs to be inferred from that ranking. When the criterion values are uncertain and the effect of that uncertainty on the result needs to be shown, the method's Monte Carlo mode answers exactly that need. The method is unsuitable when the decision-maker cannot give a consistent reference ranking, or when strong non-additive interactions exist between criteria, that is, when one criterion's effect changes entirely with the value of another.
A reference ranking exists, a utility function is to be inferred → STOCHASTIC-UTA
Criterion values are uncertain, that uncertainty must be carried through into the result → STOCHASTIC-UTA (Monte Carlo mode)
Criterion values are precise, no uncertainty → classical UTA suffices
The reference ranking comes out inconsistent, the error margin is too large → UTASTAR (a more flexible form using a separate error variable for each pair)
Strengths
STOCHASTIC-UTA's core advantage is that it works from concrete examples rather than asking the decision-maker for an abstract weight, a task many decision-makers find easier than assigning weights directly. Turning uncertainty explicitly into an acceptability rate, rather than hiding it, strengthens the honesty of the report. The error margin (F*) offers a clear indicator of how reliable the result is.
Weaknesses
Its limitations stem from the complexity of the model. First, the linear programming model's solution is not unique; different optimal solutions can give different utility functions at the same error margin, which is why post-optimality analysis, averaging several solutions, is recommended (Jacquet-Lagrèze and Siskos, 1982). Second, uncertainty sampling substantially increases the computational burden; run time grows with the number of samples. Third, the quality of the probability distributions lies outside the method itself; sampling from a poorly calibrated distribution produces a misleading acceptability rate (Durbach, Lahdelma and Salminen, 2016).
Common Mistakes
The most common mistake is forgetting to include some of the alternatives in the reference ranking; this leaves the linear programming model under-constrained and the solution meaningless. A second mistake is setting the utility-difference threshold between consecutive alternatives (δ*) far larger than the natural utility gaps allow; this can make the model unsolvable and forces a large error margin. A third mistake is feeding a cost criterion into the model without direction correction, that is, without negating it; this reverses the criterion's true effect and penalises a low-cost alternative. A fourth mistake is reporting the result as "definite" when the error margin (F*) is greater than zero; F*>0 is a sign of inconsistency and must be shown in the report.
The governing principle is this:
A STOCHASTIC-UTA result reflects the reference ranking the decision-maker supplied and, where present, the criterion uncertainty; ignoring the error margin and the acceptability rate gives the result a false impression of certainty.
Cases
Each case opens with a decision table, describes in words what the method does to it, and shows how to read the result. The first case is DecisionMind's validation example. The remaining cases are illustrative constructions.
1. Maritime: Choosing a safety protocol for ship-to-ship fuel transfer
A ship operator's risk assessment committee will choose one of four safety protocols for use in ship-to-ship fuel transfer operations. Three criteria apply: operational efficiency score, crew safety score and environmental compliance score; all three are "higher is better." The committee has ranked the four protocols by its own expert judgement as P1≻P2≻P3≻P4; STOCHASTIC-UTA will search for a utility function consistent with this reference ranking. Each criterion is modelled with a single linear stage (α=1), the consecutive-difference threshold (δ*) is set at 0.05, and no uncertainty sampling is used (N=1).
| Protocol | Efficiency | Crew safety | Environmental compliance |
|---|---|---|---|
| P1 | 9 | 3 | 6 |
| P2 | 6 | 9 | 3 |
| P3 | 3 | 6 | 9 |
| P4 | 1 | 1 | 1 |
| Direction | higher is better | higher is better | higher is better |
| Committee ranking | 1st | 2nd | 3rd (P4 last) |
The method builds a single line segment from worst to best for every criterion, solves the linear programming model to remain consistent with the committee's P1≻P2≻P3≻P4 ranking, and finds the total utility of the four protocols.
| Protocol | Total utility | Rank |
|---|---|---|
| P1 | 1.00 | 1 |
| P2 | 0.75 | 2 |
| P3 | 0.50 | 3 |
| P4 | 0.25 | 4 |
The result reads as follows. The model is solved without error (F*=0); this means the committee's ranking is fully consistent with an additive utility function built from the three criteria. P1 is not best on every criterion (best on efficiency, but middling on crew safety and environmental compliance), yet it comes out first on overall balance. P4 holds the lowest value on every criterion and finishes last.
The committee hesitates here: the difference threshold (δ*) has been kept as small as 0.05, meaning that even a small gap between consecutive protocols has been accepted. Had the threshold been made larger, the model could have become unsolvable, because demanding a large gap can make no utility function compatible with the reference ranking at all. Furthermore, because only a single stage (α=1) has been used, every criterion's utility curve is treated as fully linear; if crossing a certain threshold on crew safety is considered disproportionately bad, more stages (α>1) may be needed.
In the report: "A utility function fully consistent with the committee's reference ranking has been found (F*=0); P1 has the highest total utility (1.00). Increasing the number of stages would relax the linearity assumption on the utility curves and could change the result."
Source: Stavrou, Ventikos and Tsoukalas (2018) is the method's founding source and presents a real application in maritime risk assessment. The figures in this card do not come from the paper's own table but from a synthetic validation example prepared to test DecisionMind's LP solver (α=1, N=1, closed-form check).
2. Election Logistics: Choosing a ballot-counting device vendor
An electoral board, when choosing a ballot-counting device vendor, accepts that its technical performance estimates (failure rate, average count time) are not fully precise but are known only within a probability range derived from past data. The board has ranked two vendors as A≻B based on its past experience, but decided to use STOCHASTIC-UTA's Monte Carlo mode (N=2000) to account for the uncertainty in the failure-rate estimate.
The method redraws the failure-rate estimate from its probability distribution at random for every sample, redoes the utility calculation, and, after two thousand samples, counts how many times each vendor came out first. Suppose the result shows vendor B coming out first in 62 per cent of the samples and vendor A coming out first in 38 per cent.
The board hesitates here: 62 per cent is not a definite advantage; A could still come out ahead in the remaining 38 per cent probability. The board should report this not with the definite language "B won" but by noting a tendency in favour of B under uncertainty. If the past data set underlying the failure-rate estimate is small, the probability distribution itself should also be questioned.
In the report: "Across two thousand Monte Carlo samples, vendor B came out first in 62 per cent of samples; this is not a definite advantage but a tendency in favour of B under uncertainty in the failure-rate estimates."
3. Freight: An inconsistent preference in fleet fuel technology selection
A freight company's logistics manager has ranked four fuel technologies for fleet adoption by their own experience. Three criteria apply: fuel cost (lower is better), carrying capacity (higher is better) and maintenance frequency (lower is better); the fuel-cost estimate is uncertain owing to seasonal fluctuation. Once the manager supplies the reference ranking, the STOCHASTIC-UTA model is solved.
Suppose the model cannot be solved without error and a small error margin (F*=0.03) emerges; this shows that the manager's preferences do not fit an additive utility function built from the three criteria exactly. The model still finds the most consistent approximate utility function and produces a ranking.
The manager hesitates here: with F*>0, there are two options. Accept the inconsistency as it stands and show it in the report, or move to a more flexible model such as UTASTAR, which defines a separate error margin for each reference pair. The manager should also examine separately which criterion the inconsistency stems from, for instance an unexpected trade-off between maintenance frequency and fuel cost.
In the report: "A small inconsistency (F*=0.03) has been found between the reference ranking and the model; the manager's preferences do not fit a fully additive model, and UTASTAR may be considered for a more detailed examination."
4. What Not to Do
Had the environmental compliance criterion been mistakenly marked "lower is better" in the maritime case, the model would treat P4, which holds the lowest value on every criterion, as best on this criterion, rendering the result meaningless. A second error is adding a fifth protocol to the reference ranking afterwards without stating its comparative position against the other four; this leaves the linear programming model under-constrained. A third error would be feeding a cost criterion, had one existed in the same table, into the model without direction correction, that is, without negating it; a low-cost protocol would then be mistakenly penalised.
Sources
For the formulas behind each step, the intermediate tables and citation formats (BibTeX, RIS, APA), see the DecisionMind method page: decisionmind.app/library/stochastic-uta
Stavrou, D. I., Ventikos, N. P., & Tsoukalas, V. D. (2018). Robust Evaluation of Risks in Ship-to-Ship Transfer Operations: Application of the STOCHASTIC UTA Multicriteria Decision Support Method. In P. T. W. Lee & Z. Yang (Eds.), Multi-criteria Decision Making in Maritime Studies and Logistics (pp. 161-185). Springer. DOI: 10.1007/978-3-319-62338-2_8
Jacquet-Lagrèze, E., & Siskos, J. (1982). Assessing a set of additive utility functions for multicriteria decision-making, the UTA method. European Journal of Operational Research, 10(2), 151-164. DOI: 10.1016/0377-2217(82)90155-2
Durbach, I., Lahdelma, R., & Salminen, P. (2016). Modelling uncertainty in stochastic multicriteria acceptability analysis. Omega, 64, 13-23. DOI: 10.1016/j.omega.2015.10.015
Arcidiacono, S. G., Corrente, S., & Greco, S. (2024). Inducing a probability distribution in Stochastic Multicriteria Acceptability Analysis. Omega, 123, 102969. DOI: 10.1016/j.omega.2023.102969