xs.dev

Judge panel

The same question goes to several drafters who each see it differently. One judge compares the drafts topic by topic and writes down every choice with its reason.

Written
18 November 2026
Reading
1 min read
Share
The judge panelOne brief goes to three architects, who each write a draft from their own point of view: platform, security and product. All three drafts go to the lead, who judges them topic by topic and writes one spec that keeps the reason for each choice.same question3 draftswinner per topicBRIEFPLATFORMdraftSECURITYdraftPRODUCTdraftLEADjudgesONE SPECreasons keptThe judge panelOne brief goes to three architects, who each write a draft from their own point of view: platform, security and product. All three drafts go to the lead, who judges them topic by topic and writes one spec that keeps the reason for each choice.same question3 draftswinner per topicBRIEFPLATFORMdraftSECURITYdraftPRODUCTdraftLEADjudgesONE SPECreasons kept
The same question goes to three drafters. The lead compares the drafts topic by topic and writes one spec.

Use it When a design has many decisions and I do not trust one draft to see all of them.

The problem

One architect writes one design. It is consistent, and it is blind where its author is blind. A design written with only the platform in mind forgets what a stolen token can do. A design written with only security in mind forgets that I want to save a link from my phone.

How it works

  1. One brief goes to three architects. Each writes a full draft from one point of view: platform, security and product.
  2. The three drafts go to a lead. The lead does not pick a winning draft. It lists the topics where the drafts disagree.
  3. For each topic the lead picks one option and writes down why.
  4. The result is one spec. The table of disagreements stays at the top of it, so anyone can see later what was chosen and what was turned down.

What it costs

Three drafts instead of one, and a fourth pass to merge them. Most of the three drafts say the same thing, so most of that work is spent three times. The value is in the part where they differ.

Where it fails

The judge can only choose between what the drafters wrote. If all three miss something, the panel misses it too. That is why the spec went through a second pattern afterwards, adversarial verify.

The lead can also pick by majority instead of by reason. Two drafts agreeing is a hint, not a proof. The rule that every choice needs a written reason is what keeps that honest.

Where I used it

For the spec of the AI lab. The three drafts disagreed on 26 topics. One example: the security draft wanted a fifth Worker for the scheduled jobs. The lead chose four, because a fifth would need its own binding to every private store, and that makes the private surface wider, not smaller.

Used inAI lab

Next: Plan, then build, then QAAll patterns

Contents

  1. 01The problem
  2. 02How it works
  3. 03What it costs
  4. 04Where it fails
  5. 05Where I used it

Contact

    ↑↓ to moveEnter to open/ opens this anywhereEsc for the resultsEsc twice to close