Workshop Index
The Update Protocol
The structured method for moving belief when disconfirmation arrives. Pre-committed conditions, written down before pressure, that hold under the conditions where motivated reasoning otherwise wins.
Onramp · Foundation · Revising Beliefs Under Evidence
Mechanism
Knowing you should change your mind and actually changing it are separated by everything in your psychology. Inside Revising Beliefs Under Evidence, the Update Protocol is the structured method that closes that gap: pre-committing to specific conditions under which you will revise a belief, recording those conditions before encountering the evidence, and following through when the conditions are met.
Belief revision happens under pressure, in real time, with identity and social cost attached. Knowing about cognitive bias and wanting truth do not, on their own, produce revision. These reactions feel like clarity from the inside while the position stays exactly where it was. The protocol exists because the gap between understanding and behavior does not close on willpower alone.
Three mechanisms make the protocol more than common sense.
First, the pre-commitment. You decide what counts as disconfirming evidence before the motivated reasoning activates. In the moment, you find reasons to dismiss anything that threatens your current position: the evidence will feel weaker than it is, the methodology will seem flawed, the source will appear biased. These reactions are automatic, fast, and convincing. The protocol bypasses them by having the conditions already locked in. The question shifts from "Is this evidence strong enough to change my mind?" to "Have the conditions I already specified been met?"
Second, the written record. Writing it down is the mechanism, not a nice-to-have. Verbal commitments to openness evaporate under pressure; memory edits itself to protect existing beliefs. A written statement ("I will revise my position on X if I observe Y") creates a fixed point you cannot quietly rewrite, and creates accountability to yourself — and, if shared, to others.
Third, graduated updating. The protocol is not binary. It asks: what evidence would move you from high confidence to moderate confidence? From moderate to uncertain? From uncertain to "I was probably wrong"? This matters because the false choice between total commitment and total abandonment is one of the reasons people resist updating in the first place. If the only options are "I was right all along" and "Everything I believed was wrong," most people will choose the first regardless of the evidence. The protocol creates a middle path: honest, incremental adjustment.
One more distinction worth making. "Being open-minded" is a self-description; running the Update Protocol is a procedure. Procedures operate on structure rather than character, which means they work even when willpower fails.
Practice
The diagnostic question is: "What would change my mind about this? Can I write it down, specifically, right now?"
If you cannot answer that question for a belief you hold with conviction, you have found a belief that is no longer connected to evidence. It may still be correct, but it is no longer responsive to reality, and that is a problem regardless of whether the conclusion happens to be right.
Three practices build the protocol into a working method.
The pre-mortem commitment. Before entering a debate, a decision, or an investigation, write down what evidence would cause you to revise your position. Be specific. Not "strong evidence against" but concrete, observable conditions: "If the retention data shows less than a 5% improvement after eight weeks, this feature is not working." "If three independent sources I trust report the opposite, I will downgrade my confidence to uncertain." The specificity is the safeguard. Vague commitments ("I would change my mind if the evidence was really compelling") are indistinguishable from no commitment at all, because "really compelling" will always mean "more compelling than whatever I just saw."
The confidence check. Assign a rough confidence level to the belief. Not formal probability, just honest self-assessment: am I 90% sure about this? 70%? 50%? Then ask what it would take to move that number down by 20 points. The question is what would make you slightly less certain, rather than what would make you abandon your position — a question the mind can answer without triggering an identity crisis.
The public record. When possible, share your update conditions with someone else. This inverts the default social incentive. Changing your mind in public normally looks like weakness, and people avoid it even when the evidence is overwhelming. But if you pre-commit to conditions publicly, following through on an update becomes evidence of integrity rather than evidence of failure. You said what would change your mind, the conditions were met, and you followed through — that earns trust rather than losing it. This is where the protocol connects to cooperation: private honesty becomes a public signal that others can rely on.
The hardest part is following through when the conditions are met. Everything in your psychology will resist. The evidence will feel weaker than it looked when you wrote down your conditions, the methodology will seem to need revision, the threshold will seem to have been set too aggressively. The protocol does not eliminate this resistance; it makes the resistance visible. You wrote down what would change your mind, the conditions were met, and now you are choosing whether to follow through or whether to find reasons not to. That visibility is the intervention. You can still refuse to update, but you cannot pretend that the evidence was insufficient.
In the Wild
A startup team believed their new feature would increase user retention. Before launch, the product manager wrote down a commitment: "If 30-day retention does not improve by at least 5% within eight weeks, we kill the feature and reallocate the engineering team." Eight weeks later, retention was up 2%. The team spent three meetings arguing the data was preliminary, the sample size was too small, the timing coincided with a holiday. The product manager pointed to the written commitment. They killed the feature. Six months later, the engineers they freed built the feature that actually moved the number. The protocol cost them a project they loved and saved them six months of drift on a project that was not working.
A person who held strong views on a specific policy question asked themselves: "What would I need to see to change my mind about this?" They struggled to answer. They could not name a single piece of evidence that would shift their position. That inability was the diagnostic. It did not mean the position was wrong. It meant the position had stopped being a conclusion from evidence and had become a piece of identity. They did not update that day. But they noticed something about how they were holding the belief, and that noticing changed what happened the next time evidence arrived.
A researcher hypothesized that a particular compound would show an effect in a specific assay. Before running the experiment, she wrote: "If the effect size is below 0.3 at p < 0.05 with n > 100, this hypothesis is wrong and I move to the alternative." The result came back at 0.22. Her collaborator wanted to adjust the threshold, run a subgroup analysis, try a different assay. She pointed to the pre-registration. They moved to the alternative hypothesis, which turned out to be the one worth pursuing. The protocol saved them from a wrong answer and from the months they would have spent defending it because they had already invested in it.
The next time you find yourself certain about something that matters, try this: write down what would change your mind. Be specific enough that a stranger could check whether your conditions were met. Then keep that piece of paper where you will see it again. When the evidence arrives, and it will, you will discover whether you were practicing honesty or just describing yourself as honest.
Lineage
The Codex did not invent the Update Protocol. It assembled and framed a practice that others built over decades.
Karl Popper's falsificationism, developed in The Logic of Scientific Discovery (1934), established the foundational principle: meaningful claims must specify what would falsify them. A belief that no evidence could contradict is unfalsifiable, not strong. The Update Protocol takes this out of the philosophy of science and applies it to personal belief — if you cannot say what would change your mind, your belief is not functioning as a claim about reality. Popper remains the starting point for the epistemology underneath the protocol.
Eliezer Yudkowsky and the rationalist community on Less Wrong (beginning around 2007) translated Popper's principle into personal practice. Yudkowsky's framing of "making beliefs pay rent" captured the operational point: beliefs should generate predictions, and when predictions fail, the beliefs should update. The Center for Applied Rationality (CFAR), founded in 2012, developed "Trigger Action Plans," a formalized structure for pre-committing to specific responses triggered by specific conditions. The Update Protocol adapts this format directly. Yudkowsky's Rationality: From AI to Zombies and CFAR's workshop materials are the primary sources for the practical rationalist framework.
Pre-registration in scientific methodology formalized the same logic at the institutional level. Researchers declare their hypotheses and methods before collecting data, specifically to prevent post-hoc rationalization. The Update Protocol applies pre-registration to personal belief. The replication crisis in science (intensifying through the 2010s) demonstrated at institutional scale what happens when the update mechanism fails: entire fields maintained conclusions that the evidence no longer supported because the social, career, and publishing costs of revision were too high. The crisis was not a failure of method but a failure of willingness to follow through on what the methods revealed.
Philip Tetlock's research, published in Expert Political Judgment (2005) and Superforecasting (2015), provided the empirical proof. Tetlock tracked thousands of forecasters over years and found that the strongest predictor of accuracy was the frequency and honesty of updating, not domain expertise or intelligence. Superforecasters treated every new piece of information as an occasion to adjust; the worst forecasters treated their initial judgment as something to defend. Tetlock's work is the place to go for the evidence that update discipline produces measurably better results.
Cross-references
Within the category. Steelmanning and the Update Protocol share a sequence inside Revising Beliefs Under Evidence. Steelmanning surfaces the case that should make you update, by constructing the strongest version of the opposing position before responding to it. The Update Protocol fires when that case has been made, carrying the structured move from disconfirmation to actual revision. One produces the input; the other carries out the response. Together they make the dynamic revision discipline operational.
Within the Foundation. Scout Mindset is the orientation that makes the protocol's pre-commitments survive contact with motivated reasoning; without the disposition to want accuracy over defense, the conditions written down at calm time get re-interpreted at pressure time. Noticing is the in-moment practice that catches the disconfirmation arrival — the gap that lets the protocol's conditions register as having been met rather than dismissed. Confirmation Bias names the filter the protocol is engineered against: pre-commitment is the mechanism that bypasses the in-moment filtering by locking the decision point upstream of it. Identity Decoupling is the prerequisite that keeps the protocol from collapsing when the belief is fused with the self; if updating feels like self-attack, even the strongest pre-commitment crumbles. Calibrating Confidence to Evidence carries the static side of evidence accountability that the Update Protocol's dynamic side complements.
Two limitations worth naming. The protocol is strongest for empirical questions where evidence can be specified in advance — well-suited to "What would change my mind about whether this drug is effective?" and ill-suited to "What would change my mind about whether this painting is beautiful?" The domain still covers more territory than most people assume, but it is not universal. The protocol also requires honest initial commitment. Setting deliberately impossible conditions ("I would change my mind if every physicist in the world signed a letter") is performing the protocol without practicing it. If your conditions would embarrass you when read by someone reasonable, they are probably not honest.