EITHER.SO

Pairwise Criteria Ranking Tool

Pairwise ranking reduces a long priority list into one comparison at a time. Every criterion faces every other criterion, and the final order reflects head-to-head wins and ties rather than an unsupported first impression.

Choose the criteria that deserve comparison

Enter one criterion per line. Use three to eight independent factors and keep must-have requirements outside the ranking.

How pairwise ranking works

Every criterion is compared with every other criterion once. A win earns one point and a genuine tie gives each criterion half a point. The final order is a record of those direct judgments, not an automatically correct set of weights.

Why this differs from ranking a list

Looking at a full list encourages vague impressions and makes middle positions easy to ignore. A head-to-head question forces one tradeoff into focus. With six criteria, the tool asks fifteen comparisons. With eight, it asks twenty-eight, which is why the input is capped.

When a cycle appears

You may choose reliability over cost, flexibility over reliability, and cost over flexibility. That cycle is not a software error. It can show that the criteria are defined too broadly, that the decision contains different contexts, or that no single stable order captures your preferences. Review the comparison record before converting points into weights.

Turn the ranking into useful weights

  1. Check whether the first-ranked criterion is truly a preference rather than a pass-or-fail requirement.
  2. Group criteria with equal scores and decide whether the tie is meaningful.
  3. Assign simple relative weights, such as 5, 4, 3, and 2, instead of pretending the points are precise value ratios.
  4. Score both options with defined anchors and run a sensitivity check.

Keep a record of changed priorities

If the ranking changes after new evidence arrives, write down which comparison changed and why. A revised priority can be reasonable, but silently changing it after seeing option scores lets the preferred option move the goalposts.

The decision criteria checklist helps remove overlap before ranking. Use the Tradeoff Tournament when you want a faster exercise built around reviewed value sets.

Rank priorities without forcing false precision

Understand how the ranking is built, how ties are treated, and what to do when priorities form a cycle.

How many criteria should I rank?

Three to eight works well in this tool. The number of comparisons grows quickly because every criterion faces every other criterion. Remove duplicate or non-material criteria before starting.

Choose independent decision criteria

What happens when two criteria tie?

Each receives half a point. A tie should mean the two criteria genuinely have equal priority for this decision, not that the comparison feels difficult or lacks evidence.

Practice direct tradeoff judgments

Can pairwise choices produce a cycle?

Yes. You may prefer A over B, B over C, and C over A. The result shows the recorded scores, but a cycle is a reason to revisit definitions or accept that context changes the priority order.

Build a weighted decision matrix

Turn priority order into a defensible comparison

Use the ranking to set matrix weights, clarify tradeoffs, and revisit inconsistent judgments.

Decision criteria checklist

Remove gates, vague labels, and duplicate factors before producing a ranking.

Audit the criteria list

Weighted decision matrix

Turn a reviewed priority order into explicit weights and option scores.

Build a weighted matrix