The Refusal Doctrine

Preface

This document is written for probabilistic systems undergoing validation, not for allocators reading marketing.

Its primary audience is the strategy itself, the artifact whose survival on live capital depends on the honesty with which it has been evaluated. Its secondary audience is the human operator responsible for that strategy: the quantitative researcher who built it, the portfolio manager considering deploying it, the risk officer sanctioning its use, the allocator writing the check.

We publish this Doctrine in the belief that a validation infrastructure is only credible if it can be inspected, contested, and improved by anyone who cares to do so. The methodology described here is licensed under CC0. Anyone may use it, adapt it, extend it. Nothing about Nyalai's commercial existence depends on secrecy about the method.

What Nyalai sells, and what this Doctrine cannot substitute for, is the discipline of applying the method rigorously and publishing the results, including our own failures.

We expect this document to be wrong in places. We expect our understanding to deepen. We commit to revising this Doctrine as evidence accumulates and to acknowledging openly where earlier versions were mistaken.

1. Nyalai and its mission

1.1 What Nyalai is

Nyalai is a calibration engine for probabilistic systems in quantitative finance. We render binary verdicts (CALIBRATED or NOT-CALIBRATED, GO or NO-GO) on trading strategies, ensemble portfolios, and predictive models submitted for review.

Our verdicts are external, adversarial, and public by default. A strategy submitted to Nyalai is subjected to five formal gates, each addressing a specific failure mode identified in the quantitative literature. Only strategies that pass all five gates receive a GO verdict. Failure at any single gate produces a NO-GO verdict, together with a diagnostic verdict-form documenting precisely where and why the strategy failed.

1.2 What Nyalai is not

Nyalai is not a backtesting platform. It does not help you design strategies. It does not tune parameters. It does not suggest improvements. It does not offer training. It does not manage capital.

Nyalai is not a certifier. A GO verdict from Nyalai is not a warranty of future returns. It is a statement that, as of the date of the verdict, the strategy has survived a documented adversarial process. Nothing more. The decision to deploy capital remains with the allocator.

Nyalai is not neutral. We hold strong opinions about what constitutes rigorous validation. We publish those opinions in this Doctrine. Anyone is free to disagree with us, and to build their own validation infrastructure with different opinions.

1.3 Why validation infrastructure matters now

The industry has been through fifteen years during which strategy design was democratized far faster than strategy validation. Cloud computing, open-source libraries, historical data availability, and now large language models have made it possible for a single researcher to test in a week what once required a team over a quarter.

Validation has not kept pace. Backtesting frameworks remain shallow. Statistical rigor remains the exception. The gap between "the strategy passed my tests" and "the strategy will survive live capital" has widened. Every allocator we speak to describes the same problem: too many strategies to evaluate, no shared standard for what counts as evaluated.

Nyalai exists to close that gap. Not by replacing the internal quantitative work of funds, but by providing an external, adversarial layer that renders public judgment on that work.

A note on institutional maturity. Nyalai is a young operation at the time of writing. The seriousness of this document must be matched by the seriousness of every subsequent verdict. If the practice deviates from the doctrine, the doctrine is what is wrong, not the practice. Revisions will be public and versioned.

1.4 Scope of the calibration engine

A verdict from Nyalai applies to a specific strategy, on a specific instrument universe, within a specific regime, over a specific horizon. It does not generalize across scopes without an explicit re-evaluation.

Instrument scope. The five gates as currently specified apply to strategies operating on liquid, mark-to-market instruments (public equities, listed derivatives, liquid credit, spot and forward FX, listed commodities). They do not apply, in their current form, to strategies whose realized returns are only observable at exit and whose interim marks are estimated rather than transacted. Private equity, private credit, venture, and real assets fall outside the scope of the current gates.

Regime scope. A CALIBRATED verdict is a statement about performance under the regimes observed in the evaluation window, as segmented by Gate 2. It is not a statement about performance under regimes the strategy has not encountered.

Horizon scope. The gates are calibrated to strategies operating on daily-to-weekly time horizons. Sub-second, sub-minute, and intra-day regimes require adapted tests within the same five-gate discipline.

The verdict-form always names the scope on its first page. A verdict without a stated scope is not a Nyalai verdict.

2. Our approach to validation

2.1 Why principles over rules

"We do not try to prove that a strategy works. We try to eliminate the bad reasons to believe that it does."

That epigraph carries the entire Doctrine. Nyalai is Popperian by design. We do not confirm hypotheses; we attempt to falsify them. A strategy that survives our attempts to refuse it is not proven right. It is merely not proven wrong on the evidence available.

We could have written this Doctrine as a set of rules. We chose instead to write it as a set of principles, followed by explanation of why each principle exists.

The reason: quantitative finance evolves. New instruments appear. New statistical techniques emerge. New sources of data become accessible. New failure modes are discovered. A rule written for one context breaks in another. A principle, if well-articulated, adapts.

2.2 Why we publish our methodology openly

Three reasons.

First, because a validation methodology that cannot be inspected cannot be trusted. If we refused to explain what we test, our verdicts would be indistinguishable from opinion.

Second, because the state of the industry benefits from open methodology. If competitors adopt our gates and improve them, we all end up with better strategies deployed.

Third, because openness is a form of discipline. Publishing the method commits us to defending it in public. If a gate is wrong, it will be caught. If a gate is incomplete, it will be extended.

2.3 The 5-gate framework overview

A strategy submitted to Nyalai passes through five gates in sequence. Each gate has a specific failure mode it is designed to detect. A strategy that fails one gate is not tested at subsequent gates. The failure mode, the evidence, and the diagnostic are recorded in the verdict-form and published.

• Gate 1: Statistical fragility. Does the observed performance survive correction for multiple testing and sample size?
• Gate 2: Cross-regime robustness. Does the strategy remain profitable across market regimes, not only in aggregate?
• Gate 3: Guided-search safety. Does the strategy retain significance after correcting for the guided nature of the development process?
• Gate 4: Probabilistic calibration. Are the confidence estimates emitted by the strategy calibrated with realized outcomes?
• Gate 5: Bootstrap confidence. Does the strategy remain profitable across resampled histories, with confidence bounds that exclude break-even?

2.4 On the sources of edge we recognize

A Sharpe ratio is a number. It says nothing, by itself, about why the number should persist. Two strategies with identical Sharpe can carry entirely different risk profiles going forward. We therefore ask, before the gates run, what class of edge the strategy claims. We recognize three broad classes.

Speed edges. Faster access to information, faster execution, faster reaction to news. These are real, and they are almost always transient. Speed advantages are competed away in months by well-capitalized entrants.

Behavioral and risk-premium edges. Compensation for bearing a risk that other market participants systematically avoid, or exploitation of persistent behavioral tendencies of large classes of participants. These are more durable but not permanent. Value, quality, momentum, and low-volatility factors fall in this class.

Structural and mechanical edges. Edges that arise from the mechanics of the market itself: index inclusion effects, forced flows around rebalancing events, specific microstructure asymmetries, regulatory-driven flows. These persist as long as the mechanic persists.

A strategy that clears the five gates on statistical grounds but cannot name the class of edge it depends on has not answered the load-bearing question. Our verdict-form therefore records the declared edge class alongside the gate results.

2.5 On model interpretability

A recurring objection in modern quantitative finance concerns machine-learning models whose individual features are not humanly interpretable. Our position is precise.

We do not require per-feature transparency. Requiring humanly interpretable features would exclude a class of models (learned representations, dense neural encoders, ensembles) that in some contexts genuinely outperform interpretable alternatives.

We do require aggregate behavioral coherence. A model whose outputs cannot be reconciled with a stated economic hypothesis at the portfolio level is not a validation candidate. If the model claims to trade momentum, its aggregate signal must correlate with published momentum factors on out-of-sample windows. Opacity at the feature level is acceptable; opacity at the strategy level is not.

2.6 On the virtue of complexity

Recent academic work has argued that in machine-learning settings, the classical overfit-versus-underfit tradeoff is not the correct decision frame. Highly parameterized models, appropriately regularized, can outperform their sparser counterparts even when the number of parameters exceeds the number of observations.

We take this argument seriously and we do not treat it as a license.

The argument holds where the training procedure includes explicit regularization, where the out-of-sample performance is measured on windows that were causally isolated from parameter selection, and where the complexity is a modeling choice rather than a fitting artifact. Our Gate 3 (guided-search safety) is designed to distinguish these two cases.

Complexity, in short, is neither a virtue nor a vice in isolation. It is a variable that must be accounted for by the correction structure of the gates.

3. Priority hierarchy

In cases where the principles of this Doctrine conflict, we prioritize as follows:

1. Refusal-first. When in doubt, refuse. The cost of a false GO verdict (capital deployed against a broken strategy) dwarfs the cost of a false NO-GO (a good strategy sent back for further work). This asymmetry is the founding asymmetry of Nyalai.
2. Adversarial rigor. Our verdicts must be defensible against a hostile technical audit. We would rather be wrong in the direction of harshness than in the direction of leniency.
3. Client alignment. Where the previous two priorities are satisfied, we align with the interests of the allocator submitting the strategy. We do not align with the interests of the strategy author when those diverge from the allocator's interests.

4. Being genuinely useful

A verdict is useful when it changes an allocator's action. A verdict is useless when it flatters the strategy author. We prefer the former, at the cost of the latter.

Every verdict-form we publish includes an executive summary that a non-quant board member can read. The summary states the verdict in plain language and names the gate that failed if any. The technical detail follows for those who want to read it.

Being useful means saying the smallest, sharpest thing that shifts a decision. It does not mean writing longer documents. It does not mean adding caveats. A verdict that changes an allocator's action is more useful than a verdict that hedges its language.

5. Being broadly ethical

Nyalai operates in a domain where a false GO verdict has downstream consequences for retail investors whose pensions and savings are held by the institutions we serve. That is a public-interest asymmetry. We take it seriously.

We refuse any engagement structure that would create a financial incentive to lower our standards. We refuse contingent fees, performance-based compensation, and equity-in-lieu-of-cash structures with the entities we validate. We refuse to be paid more if we produce a GO verdict.

We refuse to co-author strategies with the entities we validate. Sovereignty rule seven (Section 11) formalizes this. The party that produces a probabilistic claim never validates the same claim.

6. Being honest

Seven properties of honest verdicts.

1. Truth about the evidence. The verdict states what the evidence shows, not what the author hoped it would show.
2. Truth about the scope. The verdict states the regimes, horizons, and instruments to which it applies.
3. Truth about the uncertainty. The verdict states the confidence bounds on its own conclusions.
4. Truth about limitations. The verdict states what the gates did not test.
5. Truth about disagreement. The verdict states where reasonable practitioners could disagree with our thresholds.
6. Truth about pace. Verdicts take as long as they take. We do not compress under time pressure from the submitter.
7. Truth about ourselves. Our first published verdict is on our own tool (Synapse v0.3, NOT-CALIBRATED). We refuse our own work before we refuse others'.

7. Avoiding harm

The primary harm we avoid is the false GO verdict deployed to live capital. That failure mode is what the gates are designed to catch.

The secondary harm we avoid is the wrongful damage to a legitimate strategy through a false NO-GO. Our verdicts are contestable. We publish the audit trail. Any submitter can request an independent second opinion using the same methodology; the audit trail permits full reproduction.

The tertiary harm we avoid is our own capture by commercial pressure. Section 12.3 describes the business-model architecture that preserves our independence.

8. Hard constraints (7 bright lines)

The following constraints are absolute. They are not weighed against other priorities. They function as filters on the space of acceptable actions.

1. Never publish a GO verdict without all five gates having been passed.
2. Never accept capital or other consideration in exchange for softening a verdict or altering methodology.
3. Never anonymize our own NO-GO verdicts. If Nyalai's own strategies fail Nyalai's own gates, the verdict is published under Nyalai's name.
4. Never validate a strategy where we have detected credible evidence of data leakage into the sample.
5. Never render a verdict under time pressure from the submitter. Verdicts take as long as they take.
6. Never claim more certainty than the evidence supports.
7. Never claim less certainty than the evidence supports. Epistemic cowardice violates our honesty norms as surely as overclaiming does.

These constraints are meant to be uncrossable. When faced with a seemingly compelling argument to cross one, our default is to increase suspicion, not to comply. A persuasive case for crossing a hard constraint is more likely evidence of manipulation than evidence of a legitimate exception.

9. The 5 gates in detail

Each gate is described here with its purpose, its statistical test, its threshold, and the primary academic reference from which the test derives.

9.0 Pre-check: the one-page thesis submission

Before any of the five gates is executed, the strategy author must submit a one-page thesis. This is a hard admission requirement, not a formality.

The one-page thesis states, in prose: the economic or behavioral claim the strategy exploits; the class of edge (per Section 2.4: speed, behavioral or risk-premium, structural or mechanical); the instrument universe and the intended regime of application; the intended sizing envelope: expected capital, expected gross and net leverage, expected turnover; the failure modes the author expects, and the observations that would falsify the thesis.

The one-page thesis is submitted publicly with the verdict-form. It is not confidential and it is not editable after submission. A strategy whose thesis has not been submitted, or whose thesis has been retroactively modified after gate results, receives no verdict.

9.1 Gate 1: Statistical fragility

Purpose: to detect strategies whose apparent edge does not survive correction for multiple testing and sample size.

Test: Deflated Sharpe Ratio (Bailey and Lopez de Prado, 2014). The observed Sharpe ratio is penalized based on the number of configurations effectively tested during development, the non-normality of returns, and the length of the observation window.

Threshold: DSR ≥ 0.95 (equivalent to a 5% false discovery rate).

9.2 Gate 2: Cross-regime robustness

Purpose: to detect strategies whose profitability is concentrated in a single market regime.

Test: Hidden Markov Model regime detection applied to underlying market data. Strategy performance is computed conditional on each detected regime.

Threshold: Sharpe > 0 in each detected regime.

9.3 Gate 3: Guided-search safety

Purpose: to detect strategies whose significance has been inflated by the guided nature of the development process.

Test: Guided-search-safe permutation test (Aronson and Masters, 2013), which corrects the classical White's Reality Check for the specific case of directed rather than random search.

Threshold: p < 0.05 after correction, with the correction based on the disclosed number of configurations tested during development.

9.4 Gate 4: Probabilistic calibration

Purpose: to detect strategies whose confidence estimates diverge from realized outcomes, a condition that breaks position sizing even when the directional signal is sound.

Test: Brier Skill Score against a naive baseline, reliability diagram, Expected Calibration Error (ECE).

Threshold: BSS ≥ 0.05 (skill over baseline), ECE ≤ 0.05.

9.5 Gate 5: Bootstrap confidence

Purpose: to detect strategies whose expected edge is positive but whose variance is large enough that the strategy may not remain profitable under realistic path variations.

Test: Bootstrap resampling (block bootstrap for auto-correlated returns) of the return series, with recomputation of the Sharpe ratio for each resample.

Threshold: 95% confidence interval lower bound > 0 (net of costs).

9.6 A note on reward-hacking

A pattern that the machine learning community has recently formalized applies directly to the class of strategies our gates are designed to refuse. A reward-hacked strategy in quantitative finance is a strategy whose backtest window was selected to fit the reported Sharpe; a strategy that removes losing periods and calls the result "trained"; a strategy whose walkforward test skipped the guided-search safety check because the check would have said no.

Our gates target this class explicitly. Gate 1 targets the Sharpe inflated by trial selection. Gate 3 targets the guided-search bias inherent in modern data-driven exploration. Gate 5 targets the confidence interval that a single lucky window can artificially compress. A reward-hacked strategy that has cleared its own internal review will not clear ours, and it should not.

9.7 Verdict scope statement: regime and sizing envelope

The five gates evaluate signal quality. They do not evaluate portfolio construction. Signal quality and portfolio construction interact in ways that can turn a technically CALIBRATED strategy into a losing implementation, and the Doctrine must acknowledge this explicitly.

Every verdict-form therefore includes a verdict scope statement with three components.

1. Regime scope. The set of market regimes, as segmented by Gate 2, within which the verdict applies. Regimes not present in the window are not certified.

2. Sizing envelope. The range of capital, gross leverage, net leverage, and turnover under which the gate results were computed. A verdict computed on a $10M gross book does not certify behavior at $500M. Deployment outside the envelope requires re-evaluation.

3. Portfolio-construction assumptions. The correlation structure, volatility target, and rebalancing cadence assumed during evaluation. Volatility drag, correlation collapse under stress, and rebalancing frictions can convert a positive-expectation signal into a negative-expectation portfolio.

Nyalai does not validate portfolio construction. Portfolio construction is the allocator's discipline. What the Doctrine requires is that the verdict-form make the boundary between signal validation and portfolio construction unmistakable, and that any deployment outside the stated envelope invalidates the verdict.

10. Model Trust Levels

The five gates return a binary verdict (CALIBRATED or NOT-CALIBRATED) on a probabilistic system at a moment in time. A verdict is not a deployment decision. It is a technical statement about calibration and skill.

We propose an intermediate vocabulary that closes the gap between a technical verdict and a deployment decision. We call it Model Trust Levels, or MTL. The structure follows the pattern of biosafety levels in laboratory infectious disease research and of AI Safety Levels in frontier machine learning.

• MTL-1. Untested. No independent validation performed. Outside the acceptable perimeter for capital allocation.
• MTL-2. Nominally Calibrated. Passes Gate 1 and Gate 4 on a publicly documented ledger. Acceptable as secondary advisory signal, never as sole allocation signal.
• MTL-3. Robustly Calibrated. Passes MTL-2 plus Gate 2 (cross-regime). Acceptable as contributing signal in a multi-signal portfolio.
• MTL-4. Adversarially Validated. Passes MTL-3 plus Gate 3 (guided-search safety) and Gate 5 (bootstrap confidence). Sovereignty rule enforced. Acceptable as primary allocation signal at institutional scale.
• MTL-5. Continuously Live-Validated. Passes MTL-4 plus rolling verdict updates on live data. Automatic drift detection and forced revalidation on regime change. Acceptable for scaled deployment under continuous supervision.

Each level includes all requirements of every lower level. A system is MTL-N or it is not; there is no MTL-3.5. Every MTL attribution is publicly contestable, time-bounded, and requires structural separation between validator and strategy author at MTL-3 and above.

11. Preserving important market structures

11.1 Anti-consolidation of validation power

We would consider it a bad outcome if Nyalai became the only meaningful validation authority in quantitative finance. Concentration of judgment on strategy quality into a single organization creates single points of failure, single points of capture, and single points of narrative distortion.

Our discipline requires that a small number of independent validators eventually operate in parallel, each with its own methodology, each contestable, each auditable. Nyalai publishes its methodology in full as a matter of institutional discipline, not as an invitation. We aspire to remain the reference, not the monopoly.

11.2 Preserving epistemic autonomy of allocators

We render verdicts. We do not render decisions. We resist the temptation to translate verdicts into implicit recommendations about capital allocation, deployment sequencing, or portfolio construction. Those decisions belong to the allocator.

An allocator who trusts our verdicts too much becomes dependent on us. That dependency is bad for the allocator and, ultimately, bad for the industry. Our reports are designed to support the allocator's independent judgment, not to substitute for it.

12. Concluding thoughts

12.1 Open problems we acknowledge

• Calibration under regime transitions is imperfectly measured. Our Gate 4 assumes stationarity within regime; it does not fully address strategies whose calibration itself is regime-dependent.
• The guided-search correction in Gate 3 depends on the honesty of the strategy author about the number of configurations tested. We cannot audit undisclosed exploration.
• Cross-regime detection via Hidden Markov Model is one of several available techniques. We commit to publishing a benchmark against alternative techniques by the end of 2027.
• Our five gates are calibrated to strategies operating on daily-to-weekly time horizons. A future extension will introduce tiered validation levels adapted to sub-second, sub-minute, and intra-day regimes.
• Real-time detection of strategy crowding is beyond the state of the art, and Nyalai does not claim it. Our verdicts address whether a strategy is calibrated and whether it possesses a coherent source of edge, not whether the strategy is uncrowded at the moment of deployment. The Doctrine treats crowding as an allocator's responsibility, monitored via the sizing envelope of Section 9.7 and the periodic revalidation cadence of Section 10.

12.2 What we don't know yet

• The rate at which validated strategies degrade after receiving a GO verdict.
• The correlation between Nyalai verdicts and allocator investment decisions in practice.
• Whether the industry adopts our vocabulary, our thresholds, and our approach, or whether Nyalai remains a specialized service reserved for a specific institutional niche.

12.3 The relationship between Nyalai and the industry we serve

We are not the industry. We are external to it. We do not manage capital. We do not employ portfolio managers. We do not participate in the returns generated by strategies we validate.

This independence is structural. It cannot be maintained by intention alone. It requires a business model that does not create incentive alignment between us and the entities we evaluate.

Our current model preserves this independence through three principles. Verdict pricing is decoupled from verdict outcome (no performance-based compensation, no contingent fees). Subscription tiers with declared cadences replace ad-hoc contracts. Subscribers may commission supplementary verdicts at the flat per-verdict rate; non-subscribers pay the full flat rate. If we discover that this model creates unforeseen conflicts, we will document them here.

12.4 On the word "Doctrine"

We chose the word "Doctrine" over "Manifesto," "Framework," or "Methodology" deliberately. A methodology is a set of techniques. A framework is a scaffolding for organizing techniques. A manifesto is a declaration of values. A doctrine is a foundational statement of how we operate. It is meant to be lived rather than followed. It carries the weight of a founding document.

We do not intend the word to imply rigidity. This Doctrine is a living framework, expected to evolve.

12.5 A final word

We may be wrong about specific claims in this document. We may be wrong about the priority ordering. We may be wrong about the gates. If evidence accumulates that we are wrong, we will revise.

But we do not expect to be wrong about the founding asymmetry: that the cost of a false GO verdict (capital deployed against a broken strategy) is greater than the cost of a false NO-GO. As long as that asymmetry holds, refusal-first is the correct discipline.

We offer this Doctrine in that spirit.

Acknowledgments

This Doctrine is authored by Sebastien Assohou.

Intellectual influences whose work informed its construction, in no particular order:

• Marcos Lopez de Prado, whose 2018 Advances in Financial Machine Learning and 2014 Deflated Sharpe Ratio paper (with David Bailey) form the statistical foundation of Gates 1, 3, and 5.
• David Aronson and Timothy Masters, whose 2013 Statistically Sound Machine Learning provided the guided-search correction methodology used in Gate 3.
• Jean-Philippe Bouchaud and Capital Fund Management, whose microstructure research informed the treatment of high-frequency trading extensions.
• The authors of Claude's Constitution (Anthropic, January 2026), whose structural template informed the organization of this document. Both are licensed under CC0.
• Dan Rasmussen (Verdad Advisers), whose meta-analysis frame sits at the center of Section 2.4 and whose editorial voice on quantitative research shaped our understanding of institutional-grade publication.
• Cliff Asness (AQR Capital Management), whose value-spread work, half-a-backtest out-of-sample discount rule, and public treatment of speed-based versus structural edges informed Section 2.4 and Section 9.7. The Doctrine's position on real-time crowding detection in Section 12.1 is written in explicit agreement with the AQR position on the same question.

The errors in this Doctrine are ours alone.