Governance-First AI for Safer Decision-Making Under Adverse Conditions
Building and validating a governance-first AI architecture that aims to reduce unsafe decisions under uncertainty, corruption, and conflicting evidence while preserving predictive performance.
Building and validating a governance-first AI architecture that aims to reduce unsafe decisions under uncertainty, corruption, and conflicting evidence while preserving predictive performance.
Project Details
Updated 07/03/26 · Edited by orgWhat is this project?
We're working on making AI more reliable under adverse conditions, situations where uncertainity, conflicting evidence, corrupted inputs, distribution shifts, or specialist failures can cause otherwise AI systems to make unsafe decisions.
To investigate this problem, we're developing MAVS-GC (Multi Adaptive Vetting Systems-Governance Core), a governance first AI architecture that seperates prediction from output governance. Instead of relying solely on model confidence or a single prediction pathway; MAVS-GC allows multiple specialists to evaluate the same input simultaneously while an independent governance layer evaluates diagnostic signals, contextual evidence, mitigation, and explicit threshold policies before deciding whether an output should be trusted to have real world influence or not.
The project has evolved into a structured research program, with emperical benchmarks, mathematical foundations, public implementations, mechanistic analysis and reproducibility studies.
What has been done?
- Formalizing MAVS-GC as a governance first AI Architecture with proper mathematical definitions and governance calculus.
- Building synthetic benchmark environments to evaluate that the governance mechanisms behave according to their intended semantics.
- Evaluating the framework across multiple real-world datasets spanning different domains under both clean and corrupted conditions.
- Measuring robustness under multiple corruption families to study how governance changes AI behavior as evidence quality deteriorates
- Performing mechanistic ablation studies to identify which governance components are responsible for the observed safety behavior.
- Building reproducible evaluation pipelines, governance traces, public documentation, and research infrastructure so that every result can be independently examined.
Across these stages, the same pattern emerged consistently that explicit output governance appears to substantially reduce unsafe acceptance outputs (about 144-200 times less) whilst maintaing a high predictive accuracy (85%+) and the framework's decision becomes increasingly stable as corruption severity increases.
However, we still do not know if this behavior can survive under industrial grade pressure, therefore; this justifies the next stage of the research, which is industrial grade validation. With funding, we'll expand the evaluation from the current benchmark program to substantially larger cross-domain benchmarks suits, additional corruption families, frontier AI models, and more realistic deployment conditions.
The objective is to rigorously determine whether safety and stability properties observed in current research continue to hold at a much larger scale.
What will happen if it succeeds?
If the project succeeds, it's primary output would be a validated governance-first architecture that enables AI systems to be explicitly governed before their outputs are allowed to have any real world influence whatsoever in adverse conditions. Instead of relying on model's prediction and confidence, AI systems would be able to incorporate a governance layer that evaluates diagnostic signals, contextual evidence, mitigation, and risk before determining whether an output should be trusted, rejected, accepted, or escalated.
If the industrial scale validation confirms that the MAVS-GC formalization generalizes beyond the current benchmarks, it would provide evidence that explicit output governance can become a reusable architectural layer for AI systems operating in safety critical environments.
Theory of Impact
Updated 07/17/26 · By grantmaking.aiToday's AI Safety work improves the model itself through better training, alignment, and fine tuning, while recent runtime governance primarily focuses on policy enforcement, permissions, and agent execution. MAVS-GC investigates a different hypothesis, that prediction and governance are fundamentally different computational problems. And that whether an AI output should influence the real world should be evaluated independently of how that output was generated.
If industrial scale validation confirms the behavior we've observed so far, the impact would not simply be a model with a better benchmark performance. It would provide evidence that explicit output governance can function as a reusable architecture layer that sits between AI predictions and real world actions.
Rather than allowing predictions to drive decisions, AI systems could first assess evidence quality, diagnostic signals, contextual conditions, and mitigation before deciding whether an output should be trusted enough to influence a real-world decision.
And thus, governance becomes a first-class computational capability rather than an implicit property of model training. AI systems would no longer only answer "What is the correct prediction?" but also "Has enough trustworthy evidence been accumulated for this prediction to justify real-world influence?" That distinction creates a new layer of reasoning that existing prediction-centric architectures do not explicitly model.
People
Updated 07/17/26 · By grantmaking.aiTeam Member
Funding Details
- Mar 3, 2026
- -
- 1 year
- -
- -
- -
- -
- -
- Seeking first grant.
- -
Discussion
No comments yet. Be the first to share your thoughts.