Methods · Ranking
KEMIRA (KEmeny MedIan Indicator Ranks Accordance)
KEMIRA splits the criteria into two meaningful groups, fits each group to the experts' priority rankings, and then ranks the alternatives by summing the two groups' scores.
Base method's data type: Classical
What Is the Method?
KEMIRA is a ranking method for when you hold a measured decision table and more than one expert opinion on the importance of that table's criteria. Its output is a single combined score for every alternative, together with the rank that score produces. It does not ask for direct numerical weights on the criteria; instead, it asks experts to order the criteria by importance, reduces those orders to a single consensus order, and then searches for weights consistent with that consensus itself. Krylovas, Zavadskas, Kosareva and Dadelo proposed it in 2014; the method is designed specifically for situations where the criteria split into two distinct families, for example engineering criteria and social criteria.
The Philosophy Behind It
The idea behind KEMIRA is this. Asking an expert to assign a criterion exactly 0.27 of weight is difficult and often artificial. But asking the same expert to say that one criterion matters more than another is easy. KEMIRA takes this observation seriously: it asks experts only to order the criteria by importance. If more than one expert exists and their orders differ, the method reduces these orders to a single consensus order using what is called the Kemeny median. This means finding the single ordering that, in total, sits closest to all the experts' orders; it is the counterpart, in the world of rankings, of the statistical idea of a median.
The resulting consensus order is not enough on its own, because infinitely many weight sets are consistent with the same order, every set that obeys the rule that a more important criterion receives a larger weight. KEMIRA adds a second idea at this point: it scans the whole space of consistent weight sets, at a given resolution, and picks from among them the set under which the two criterion groups, engineering and social, say, rank the alternatives most consistently with each other. In this way the method stays faithful to expert opinion, the order, while not forcing numerical precision from outside but searching for it within itself.
The philosophical consequence of this approach is a search for compromise. KEMIRA is neither a purely subjective weighting method, unlike AHP it does not ask for a single weight set, nor a purely objective one, unlike Entropy it does not look only at the data; it searches somewhere between the two, bounded by the expert ranking. Within a group it is compensatory: a weakness on one criterion can be offset by another criterion in the same group, and because the final score is the sum of the two groups, a kind of balancing exists between the groups too.
How It Works
The method proceeds through five steps.
First, scale equalisation. Each criterion group is normalised separately, within itself. Cost-direction criteria are inverted first, then every column is scaled between 0 and 1 relative to its own minimum and maximum value.
Second, reconciling the experts' priority orders. Every expert orders the criteria in their own group by importance. If more than one expert exists, the orders can differ. KEMIRA finds, via the Kemeny median, the single consensus order that in total sits closest to these orders. This step is carried out separately for each group.
Third, scanning the consistent weight sets. Every weight set that does not conflict with the consensus order, where a more important criterion genuinely receives a larger weight, is scanned at a given resolution, in steps of one tenth, for instance. The finer the scan, the more candidate sets there are.
Fourth, selecting the most consistent weight set. For every candidate weight set, the alternatives are ranked within that group. The method selects the weight set that maximises how many alternatives the two groups share at the top of their rankings, and, in the case of a tie, the one that minimises the difference between the two groups' rankings.
Fifth, combining. The engineering-group score and the social-group score, both calculated with the selected weights, are summed. The alternative with the highest total is placed first.
The formulas behind each step, the intermediate tables and the citation formats are given on the DecisionMind method page; this card carries no formulas.
How to Read the Output
The combined score shows an alternative's total standing across the two criterion groups; it is not a percentage or a probability. The size of the score is meaningful only for this alternative set, these experts' priority orders, and the chosen scan resolution. It cannot be compared with a score from a different analysis.
Two layers of uncertainty lie behind the score. First, the Kemeny median calculation that finds the consensus order can produce more than one ranking tied at the same lowest distance; in that case a rule is needed to decide which order is chosen, and the report should state that rule. Second, the fourth step, which selects among the consistent weight sets, is itself an optimisation; as the scanned resolution coarsens, as the step size grows, a different weight set can be selected and the result can change.
Thus instead of writing:
"KEMIRA found the best alternative"
the report should read:
"With these experts' priority orders and this scan resolution, the alternative with the highest combined score is this one; if the consensus order involved a tie, the report should state which rule resolved it"
Data Type and Inputs
KEMIRA works with crisp numerical data. You need a decision table whose criteria can be split into at least two meaningful groups, for example measurable engineering criteria and context-dependent social criteria, direction information for every criterion, and independent orders from more than one expert ranking the criteria within each group by importance. It neither asks for nor produces numerical weights; the only thing it produces is the alternatives' order. DecisionMind carries no extension of this method; it is offered only in its base form, working with crisp numbers.
The number of criterion groups can exceed two, but the method's definition is built on two groups. There must be at least two experts; with a single expert the idea of the Kemeny median loses its meaning, and that expert's own order simply becomes the consensus order. As the scan resolution, the step size, shrinks, the computational burden rises quickly, and this burden grows further as the number of criteria increases.
When to Use It, When Not To
If you want to take only an order of importance from experts rather than exact numerical weights, if more than one expert cannot agree among themselves, and if your criteria naturally split into two distinct families, KEMIRA is a suitable choice. It has been used in problems where both measurable and context-dependent criteria appear together, such as site selection, supplier evaluation and personnel selection.
If your criteria all belong to a single family, all of the same kind, all financial, say, you cannot benefit from KEMIRA's two-group split; direct weighting methods such as AHP, BWM or SWARA are more suitable in that case. If the number of criteria is large or a fast result is needed, KEMIRA's weight scan can become heavy.
Expert opinion available only as an order, two criterion families exist → KEMIRA
Expert opinion can be taken directly as a numerical weight → AHP, BWM, SWARA
Criteria from a single family, weight to be derived from the data → Entropy, CRITIC
Classification rather than ranking is needed → elimination-based methods
Strengths
KEMIRA's most important strength is that it asks experts for information that is easy to give, an order of importance, rather than placing the burden of assigning numerical weight on them. It does not ignore disagreement among more than one expert; it turns it into an explicit consensus mechanism via the Kemeny median. By splitting the criteria into two distinct families, it allows engineering and social criteria, which are hard to compare on a single common scale, to be handled together; this is close to how domain experts naturally think.
Weaknesses
Its limitations stem largely from its computational structure. The step that scans the consistent weight sets grows combinatorially; as the number of criteria increases or the scan resolution becomes finer, the number of candidate sets multiplies quickly (Krylovas et al., 2014). The Kemeny median calculation can produce more than one ranking tied at the same lowest distance; in that case which order is chosen becomes a matter of preference, and if this is not reported the result looks arbitrary. Which group a criterion is assigned to, engineering or social, also lies outside the method, as the analyst's own decision; if that split changes, the result changes too. Because of the method's heavy computational burden, later work (Krylovas, Dadelo, Kosareva and Zavadskas, 2017) has proposed forms that combine the expert ranking with objective entropy weights; this is itself a sign that the base KEMIRA does not suffice on its own in every situation.
Common Mistakes
The most common mistake is reading the combined score as a percentage or a probability; the score reflects only this alternative set and this consensus. A second mistake is deciding which group a criterion belongs to without justification and failing to report that decision. A third mistake is not stating which rule resolved a tie in the Kemeny median calculation; the reader may then assume the result is the only possible one. A fourth mistake is changing the scan resolution, the step size, and expecting the same result; a coarser scan can select a different weight set and hence produce a different ranking. A fifth mistake is working with a single expert and presenting the method as an "expert consensus"; the idea of consensus becomes meaningful only with more than one, genuinely independent, expert ranking.
The governing principle is this:
A KEMIRA result is the product of reconciling the experts' priority orders and searching for weights consistent with that consensus; if the consensus involved a tie, or a choice was made in the scan resolution, the report must state this plainly.
Cases
Each case opens with a decision table, describes in words what the method does to it, and shows how to read the result. The first case is taken from a textbook example in which the method is applied. The remaining cases are illustrative constructions.
1. Healthcare: Site selection for hospital construction (Alinezhad and Khalili, 2019)
A municipality will choose among seven candidate sites for a new hospital building. The criteria are split into two groups. The engineering group holds four criteria: distance to the city centre (lower is better), distance to the high-pressure gas line (higher is better), distance to the high-voltage line (higher is better), and distance to the water network (lower is better). The social group holds three criteria: distance to industrial sites (lower is better), estimated annual patient count (higher is better), and regional population (higher is better). Five experts have ranked the criteria within each group by their own order of importance; the experts' orders differ from one another.
The method first normalises the two groups separately. It then reduces the five experts' priority orders in the engineering group (city centre first, water network second, and so on) to a single consensus order using the Kemeny median, and does the same for the three criteria in the social group. For both groups it then scans, in steps of one tenth, the weight sets consistent with this consensus order, and selects the pair of weight sets that makes the two groups' rankings most consistent with one another. Finally, it sums each candidate site's engineering score and social score.
| Site | City centre (km) | Gas line (km) | High-voltage line (km) | Water network (km) | Industry (km) | Annual patients | Regional population |
|---|---|---|---|---|---|---|---|
| A1 | 1.5 | 0.6 | 2.5 | 1.37 | 9.26 | 3,189 | 55,269 |
| A2 | 3.5 | 1.2 | 4.5 | 0.5 | 8.64 | 498 | 9,327 |
| A3 | 0.8 | 0.5 | 3.0 | 0.1 | 6.44 | 2,484 | 50,798 |
| A4 | 4.8 | 1.2 | 1.6 | 2.0 | 11.19 | 2,676 | 56,206 |
| A5 | 5.5 | 1.0 | 1.6 | 0.3 | 5.90 | 3,291 | 66,807 |
| A6 | 0.6 | 0.7 | 2.0 | 0.6 | 6.09 | 6,490 | 132,136 |
| A7 | 0.3 | 0.4 | 2.0 | 0.6 | 5.72 | 5,497 | 123,314 |
| Direction | lower is better | higher is better | higher is better | lower is better | lower is better | higher is better | higher is better |
| Site | Combined score | Rank |
|---|---|---|
| A6 | 1.795 | 1 |
| A7 | 1.679 | 2 |
| A3 | 1.199 | 3 |
| A1 | 1.021 | 4 |
| A5 | 0.807 | 5 |
| A2 | 0.641 | 6 |
| A4 | 0.592 | 7 |
The result reads as follows. A6 and A7 are the two sites furthest from industrial facilities and with the highest regional population and patient counts; because they lead clearly in the social group, their middling performance in the engineering group does not pull the total score down. A3 is strong in the engineering group, being very close to the water network and close to the city centre, but weaker in the social group; it settles into third place as a balance of the two. A4 and A2 remain in the last places because they stay middling or weak in both the engineering and social groups.
The municipality hesitates here. For the social group, the five experts' priority orders produced three separate orderings tied at the same lowest distance in the Kemeny median calculation; the example in the book chose one of these three by a tie-break rule. Had the municipality used a different tie-break rule, the social group's consensus order could change, which in turn could affect the weight scan and hence the small gap between A6 and A7. The report must therefore state plainly which rule was applied in the case of a tie.
In the report: "Once the engineering and social experts' priority orders are reconciled, A6 receives the highest combined score (1.795); the gap to A7 (1.679) is small and is sensitive to how the three-way tie in the social group's consensus order is resolved."
Source: Alinezhad and Khalili (2019), Chapter 27, §27.3, pp. 208-214. This case is the book's worked example of the method proposed by Krylovas and colleagues (2014); the DecisionMind team is reviewing whether this method's data-driven weight scan may not always respond in the same direction to single-criterion improvements, which is generally a natural feature of data-dependent weighting methods.
2. Logistics: A courier company's new distribution depot site
A courier company will choose one of three candidate sites for a new regional distribution depot. The engineering group holds two criteria: distance to the main highway (lower is better) and depot area size (higher is better). The social group holds two criteria: expected noise-complaint risk owing to proximity to residential areas (lower is better) and the size of the local labour pool (higher is better). Four people from the operations and public-relations teams have each ranked the two criteria within their own group by importance.
The method normalises the two groups separately, reconciles the four people's rankings with the Kemeny median, scans the consistent weights, and selects the set that makes the two groups most consistent with one another. Suppose the result places first the site closest to the highway but with a smaller labour pool; its strength in the engineering group offsets its weakness in the social group.
The company hesitates here: the operations team regards proximity to the highway as the most important criterion, while the public-relations team regards noise risk as most important; because no weight split has been made between the two groups, the engineering and social scores have been summed with equal importance. If the company considers the social group more important, this requires a separate inter-group weighting outside KEMIRA.
In the report: "This is the site that receives the highest score under the engineering and social consensus orders; the report should note that the two groups were combined with equal weight in the total, and that a difference in importance between the groups, if wanted, needs separate treatment."
3. Education: Building selection for a new examination centre
An educational institution will hold a centralised examination in one of three candidate buildings. The engineering group holds two criteria: building capacity (higher is better) and the adequacy score of the electrical infrastructure (higher is better). The social group holds two criteria: distance to public transport (lower is better) and the surrounding noise level (lower is better). Two units of the institution, one responsible for exam security and one for candidates, have ranked the criteria within their own groups.
The method normalises the two groups separately, reconciles the two units' rankings, scans the consistent weights, and calculates the combined score. Because the number of experts here drops to two, the Kemeny median seeks a middle ground between the two orders. Suppose the building with the largest capacity but the greatest distance from public transport comes out first.
The institution hesitates here: with only two experts, the Kemeny median calculation can sit closer to a single expert's order; adding a third independent opinion could change the consensus order and hence the result. Moreover, if distance from public transport creates a practical obstacle for a large share of candidates, this is a threshold matter, and KEMIRA's compensatory summing logic may overlook that obstacle.
In the report: "Once the two units' priority orders are reconciled, this building receives the highest score; the small number of experts makes the consensus order fragile, and adding a third opinion is recommended."
4. What Not to Do
Had the three-way tie in the social group's consensus order in the first case's table gone unnoticed, and the result been presented as a single, definitive ranking, the municipal council would have found a different order on repeating the same analysis with a different tie-break rule, and lost confidence in the method. A second error is summing the engineering and social groups as though always equally important, without weighting them separately by importance; this is an implicit decision and must be stated in the report. A third error is presenting a single expert's ranking as a "consensus"; the Kemeny median is meaningful only when more than one independent ranking exists.
Sources
For the formulas behind each step, the intermediate tables and citation formats, see the DecisionMind method page: decisionmind.app/library/kemira
Krylovas, A., Zavadskas, E. K., Kosareva, N., & Dadelo, S. (2014). New KEMIRA method for determining criteria priority and weights in solving MCDM problem. International Journal of Information Technology & Decision Making, 13, 1119–1133. DOI: 10.1142/S0219622014500825
Alinezhad, A., & Khalili, J. (2019). KEMIRA method (Bölüm 27). New Methods and Applications in Multiple Attribute Decision Making (MADM). Springer, International Series in Operations Research & Management Science, Cilt 277, 205–215. DOI: 10.1007/978-3-030-15009-9_27
Krylovas, A., Zavadskas, E. K., & Kosareva, N. (2016). Multiple criteria decision-making KEMIRA-M method for solution of location alternatives. Economic Research-Ekonomska Istraživanja, 29(1). DOI: 10.1080/1331677X.2016.1152560
Krylovas, A., Dadelo, S., Kosareva, N., & Zavadskas, E. K. (2017). Entropy–KEMIRA approach for MCDM problem solution in human resources selection task. International Journal of Information Technology & Decision Making. DOI: 10.1142/S0219622017500274