grantmaking.ai
Actively FundraisingRecent ActivityFull Database
Resources
grantmaking.ai
Actively FundraisingRecent ActivityFull Database
ResourcesApply for funding
grantmaking.ai kickoff grant round$776k / $1M distributed
Get funded

Database

The AI Safety database is a work in progress, as we are focusing on the launch of the initial $1M grant round. Feel free to send us ideas or feedback!
Applied for grant(remove filter)Raising funds(remove filter)Clear all
NameTypeTagsEndorsedTeamRaising $

Showing 401-444 of 444·Sorted by endorsements

NameTypeTagsEndorsedTeamRaising $
Developing methods to evaluate the trustworthiness of CV models
Project
ResearchEvals
--

Developing methods to evaluate the trustworthiness of CV models

Team?
Project
Previous

Page 9 of 9

Next
KAM: an economic mechanism against white-collar AI displacement
Project
CompanyResearchGovernance
-
-
Manhattan Kernel
Project
IndividualToolingControl
--
Prototyping Browser-Based Misinformation User Flows
Project
CompanyResearchDemocratic AI
--
ONYX Research Cloud: Trustworthy AI Infrastructure for Brain Health
Project
CompanyToolingAI Welfare
--
The Librairy
Project
NewsletterCommsX-Risk
--
New alignment approach, better than training AI on safe behaviour
Project
IndividualField-BuildingTechnical Safety
--
A fail-closed control layer and evals for autonomous agent fleets
Project
ResearchEvalsControl
--
MUSEUM: Multiscale Unified Systemic Existential Uncertainty Modeling
Project
ResearchX-Risk
--
AI Safety Evals and Red Teaming Platform
Project
ToolingEvalsPlatform
--
Evaluating Prompt Injection Defenses in LLMs
Project
ResearchSecurity
--
Scale Up: AI Development Index & Model Evals for Fabrication Benchmark
Project
PlatformResearchEvals
--
Healthy Human–AI Collaboration through CI Theory
Project
IndividualResearchAI Welfare
--
We Are Hokmah: Comparative Messenger Pilot
Project
ResearchGovernanceComms
--
Creedal AI
Project
ResearchValue Alignment
--
Pragmatic value alignment of LLMs to influence downstream behavoirs
Project
IndividualResearchValue Alignment
--
DriftBench v1.1: an ambivalence metric + 20 cross-domain scenarios
Project
ToolingEvals
--
WorkReady Academy: AI Transformation Academy
Project
PlatformEducationGovernance
--
The Veil: which human variables move the internals AI oversight reads?
Project
ResearchInterp
--
Lighthouse: Behavioral Governance for Conversational AI
Project
ResearchEvals
--
AI Panopticon
Project
IndividualResearchTechnical Safety
--
Animal Intelligence StoryTelling Project
Project
CommsTechnical Safety
--
Double Tagging a Survey Data for Real World Grounding
Project
ResearchForecasting
--
AI-Enhanced Smart Clinic Chair Platform
Project
Research LabResearch
--
AI Risk Sensemaking Through Interactive Future Scenarios
Project
CommsGovernance
--
MYCELIA- a consensus based AI with predictive & prescriptive telemetry
Project
ResearchRobustness
--
Beamline - Retroactive analysis of systems to create shared truths
Project
ToolingControl
--
Human Oversight Framework for AI Systems: Building Governance Capacity
Project
IndividualResearchGovernance
--
MiR
Project
MediaCommsGovernance
--
Auditing How AI Systems Convert Political Questions Into Technical One
Project
IndividualToolingGovernance
--
Cantivia
Project
CompanyToolingSecurity
--
AEGIS: Evidence-Backed Control Layer Reducing AI X-Risk
Project
CompanyToolingControl
--
Safety framework for animate materials
Project
ResearchTechnical Safety
--
Executable AI Safety Claims
Project
IndividualToolingEvals
--
AIOA Whitehat: Epistemic Control System
Project
ToolingControl
--
PulmoForge
Project
CompanyToolingSecurity
--
Building AI Safety Capacity within Cameroon Higher Education
Project
EducationTechnical SafetySecurity
--
Matrix Multiplication Without Matrices Tackles Concentration of Power
Project
ResearchCompute Gov
--
MASSIF (Multiscale Attractor Stability & Stress Inference Framework}
Project
IndividualResearchInterp
--
Governed Intelligence Architecture Specification (GIAS)
Project
StandardsGovernance
--
Standards compliance for High-Risk AI systems
Project
ConsultancyStandardsGovernance
--
Consenso:AI Infrastructure for Transparent Legal & Policy Intelligence
Project
ToolingEvals
--
Frontier Watch: monitoring our advancement towards superintelligence
Project
ForecastingResearchPlatform
--
Rendezvous
Project
PlatformCommunityX-Risk
--
Research
Evals
Fundraising
Claimed

Developing evaluation methods to determine when CV models can be trusted by addressing the gap between benchmark metrics and real-world performance.

Led byElena Eroshina
Endorsed by-

KAM: an economic mechanism against white-collar AI displacement

Team?
ProjectCompanyResearchGovernanceFundraisingClaimed

Selma: The AI that never leaves the building.

Led byKara Bombell, and others
Endorsed by-

Manhattan Kernel

Team?
ProjectIndividualToolingControlFundraisingClaimed

A deterministic Rust kernel that isolates dangerous LLM agents inside a strict compiler-integrated safety sandbox.

Led byLászló Lipcsik
Endorsed by-

Prototyping Browser-Based Misinformation User Flows

Team?
ProjectCompanyResearchDemocratic AIFundraisingClaimed

Qualitative UX research exploring how users respond to different prototypes of a browser-based tool for identifying online misinformation.

Led byCindy Gilbertson
Endorsed by-

ONYX Research Cloud: Trustworthy AI Infrastructure for Brain Health

Team?
ProjectCompanyToolingAI WelfareFundraisingClaimed

Building reproducible, transparent, and auditable AI infrastructure for neuroscience and clinical brain health.

Led byAffaan Shaikh
Endorsed by-

The Librairy

Team?
ProjectNewsletterCommsX-RiskFundraisingClaimed

The Librairy is a weekly newsletter that helps individuals and groups outside the field understand and be equipped with AI safety knowledge and resources.

Led bySakshi Chaubey
Endorsed by-

New alignment approach, better than training AI on safe behaviour

Team?
ProjectIndividualField-BuildingTechnical SafetyFundraisingClaimed

I've already shown that the approach is very promising. This project is about making people at AI labs and alignment academics aware of it first, then personally collaborate with them (or make others work on it, even w/o me).

Led byMichele Campolo
Endorsed by-

A fail-closed control layer and evals for autonomous agent fleets

Team?
ProjectResearchEvalsControlFundraisingClaimed

A fail-closed control plane for coding-agent fleets — spend caps, audited actions, rollback — plus a public eval suite and automated red-team explorer that measure whether any control layer actually stops unsafe agent actions.

Led byJackie YU
Endorsed by-

MUSEUM: Multiscale Unified Systemic Existential Uncertainty Modeling

Team?
ProjectResearchX-RiskFundraisingClaimed

LPMs for modeling x-risk patterns across human taxonomies and agentic swarms

Led byDave Haas
Endorsed by-

AI Safety Evals and Red Teaming Platform

Team?
ProjectToolingEvalsPlatformFundraisingClaimed

A no-code AI safety evaluation (including red teaming) tool that enables non-technical domain experts (e.g. social scientists, STEM experts) as well as AI engineers to design, run, and communicate effective and efficient evals.

Led byJeanice Koorndijk
Endorsed by-

Evaluating Prompt Injection Defenses in LLMs

Team?
ProjectResearchSecurityFundraisingClaimed

An independent evaluation of current prompt injection defenses in large language models, producing practical recommendations for safer AI deployment.

Led byIsmail Magan
Endorsed by-

Scale Up: AI Development Index & Model Evals for Fabrication Benchmark

Team?
ProjectPlatformResearchEvalsFundraisingClaimed

Expanding a continuously updated database covering global panel AI data as a ground-truth benchmark which allows stress-testing frontier LLMs’ fabrication rates in global contexts (lower-income and upper-income countries’ contexts

Led byJason Hung
Endorsed by-

Healthy Human–AI Collaboration through CI Theory

Team?
ProjectIndividualResearchAI WelfareFundraisingClaimed

Developing CI Theory and the Exogram framework to enable healthy, sustainable human–AI collaboration and reduce long-term AI risk.

Led byHiroto Onda
Endorsed by-

We Are Hokmah: Comparative Messenger Pilot

Team?
ProjectResearchGovernanceCommsFundraisingClaimed

Testing, in Washington, DC, if a AI generated messenger can build trust in communities largely unseen in AI Safety as well as a human being.

Led byKaren Maria Alston
Endorsed by-

Creedal AI

Team?
ProjectResearchValue AlignmentFundraisingClaimed

A first-person creed for AI defining what the AI is for rather than what it must not do, to be internalized during training, not tacked on after.

Led bySamareh Jack
Endorsed by-

Pragmatic value alignment of LLMs to influence downstream behavoirs

Team?
ProjectIndividualResearchValue AlignmentFundraisingClaimed

Four-month project to fine-tune LLMs on public value surveys, evaluate behavior via a text-based agent simulator, and run a public consultation comparing model actions to respondents’ values.

Led byJames Thompson
Endorsed by-

DriftBench v1.1: an ambivalence metric + 20 cross-domain scenarios

Team?
ProjectToolingEvalsFundraisingClaimed

Deterministic, no-LLM-judge benchmark for how faithfully AI tracks changing beliefs. Funding v1.1: a new ambivalence metric + 20 cross-domain scenarios.

Led byOleksii Simon
Endorsed by-

WorkReady Academy: AI Transformation Academy

Team?
ProjectPlatformEducationGovernanceFundraisingClaimed

Equipping our society for people-centric AI transformation

Led byKeith Thode
Endorsed by-

The Veil: which human variables move the internals AI oversight reads?

Team?
ProjectResearchInterpFundraisingClaimed

The Veil measures how the other side of the exchange, human or artificial, changes where and how a language model computes, toward testing whether those shifts confound the activation-based tools AI safety relies on.

Led byPetya Sarafova
Endorsed by-

Lighthouse: Behavioral Governance for Conversational AI

Team?
ProjectResearchEvalsFundraisingClaimed

Researching whether many conversational AI failures share underlying behavioral dimensions — and whether those dimensions can be independently governed.

Led byKathlyn Kelly, and others
Endorsed by-

AI Panopticon

Team?
ProjectIndividualResearchTechnical SafetyFundraisingClaimed

Develop a decision-theory framework for AI self-alignment in nested, cyclic, partially observable multi-agent environments where delayed punishment for welfare compromise promotes cooperative behavior.

Led byEduard Kapelko
Endorsed by-

Animal Intelligence StoryTelling Project

Team?
ProjectCommsTechnical SafetyFundraisingClaimed

A transmedia storytelling project using an animal characters as a metaphor for AI

Led byWill Shin
Endorsed by-

Double Tagging a Survey Data for Real World Grounding

Team?
ProjectResearchForecastingFundraisingClaimed

a person takes an occupational Survey data (+1 or 2 fresh, third party) +a existing alignment emulation model / trigger analysis mod "what would happen" emu then do all sorts of manual tagging, for maximum real world grounding

Led byAndrew Djuwidja
Endorsed by-

AI-Enhanced Smart Clinic Chair Platform

Team?
ProjectResearch LabResearchFundraisingClaimed

Long-term vision is to transform the Smart Clinic Chair from a telehealth device into an AI-enhanced remote examination room capable of extending clinical intelligence into healthcare deserts, workplaces, transportation truckstops

Led byvincent waterson
Endorsed by-

AI Risk Sensemaking Through Interactive Future Scenarios

Team?
ProjectCommsGovernanceFundraisingClaimed

12-week project to build and user-test a web interactive narrative prototype that communicates AI risk scenarios to non-technical young adults, producing notes, feedback data, and a public write-up.

Led bywei jiang
Endorsed by-

MYCELIA- a consensus based AI with predictive & prescriptive telemetry

Team?
ProjectResearchRobustnessFundraisingClaimed

Language model where its attention-heads are not competing but consenting. Its governors monitor the hidden state geometry and provide early-warning by predicting failure and timely modify latent processes to avoid instabilities

Led byDaniel Solis
Endorsed by-

Beamline - Retroactive analysis of systems to create shared truths

Team?
ProjectToolingControlFundraisingClaimed

This architecture uses retroactive observation to identify and close system blind spots, leading to better alignment over time.

Led byLeo Guinan
Endorsed by-

Human Oversight Framework for AI Systems: Building Governance Capacity

Team?
ProjectIndividualResearchGovernanceFundraisingClaimed

Developing practical AI oversight frameworks that keep humans in control of consequential AI decisions, starting where governance capacity is weakest.

Led byAgwu Naomi Nneoma
Endorsed by-

MiR

Team?
ProjectMediaCommsGovernanceFundraisingClaimed

A short film on the moral gray of AI: a single conversation between Elena, a celebrated founder whose elder-care AI harmed the people it soothed, and Joanne, the journalist who championed her and now holds her accountable.

Led byCarolina Groppa
Endorsed by-

Auditing How AI Systems Convert Political Questions Into Technical One

Team?
ProjectIndividualToolingGovernanceFundraisingClaimed

AI that surfaces power-concentration risk in civic systems by making value trade-offs visible instead of resolving them silently.

Led byNaomi Munroe
Endorsed by-

Cantivia

Team?
ProjectCompanyToolingSecurityFundraisingClaimed

Cantivia detects deepfakes and disinformation, and simulates how synthetic media spreads, so platforms, newsrooms and fraud teams know what's fake, who made it, and how far it'll travel.

Led byAshkan Samali
Endorsed by-

AEGIS: Evidence-Backed Control Layer Reducing AI X-Risk

Team?
ProjectCompanyToolingControlFundraisingClaimed

An inline authorization platform for AI agent actions

Led byVikas Prakash
Endorsed by-

Safety framework for animate materials

Team?
ProjectResearchTechnical SafetyFundraisingClaimed

A public, cross-disciplinary safety framework for emerging animate matter technologies

Led byGeorge Blanda
Endorsed by-

Executable AI Safety Claims

Team?
ProjectIndividualToolingEvalsFundraisingClaimed

Turning published AI-safety claims into runnable, independently reproducible test packages that expose fragile assumptions, hidden failure modes, and unsupported conclusions.

Led byUri Kartoun
Endorsed by-

AIOA Whitehat: Epistemic Control System

Team?
ProjectToolingControlFundraisingClaimed

A local-first control layer that keeps humans in charge of AI agents by requiring inspection, evidence, and approval before any code, file, tool, provider, browser, package, or Git action occurs.

Led byŁukasz „LuciferSun” Zuchowski, and others
Endorsed by-

PulmoForge

Team?
ProjectCompanyToolingSecurityFundraisingClaimed

Real-time AI voice detection system across communication channels and as an alternative to expensive and enterprise systems.

Led byWilson Wang
Endorsed by-

Building AI Safety Capacity within Cameroon Higher Education

Team?
ProjectEducationTechnical SafetySecurityFundraisingClaimed

Fund experts, capacity building opportunities, and operational costs to increase the offer of courses and degrees focused on AI, AI Safety, LLMs, and Cybersecurity in Cameroon's Universities.

Led bymarc serna
Endorsed by-

Matrix Multiplication Without Matrices Tackles Concentration of Power

Team?
ProjectResearchCompute GovFundraisingClaimed

An open modification of Google’s AlphaTensor to search for Fast Fourier Transforms (FFTs) for the obscure Triple Product Property matrix multiplication algorithm.

Led byMurage Kibicho
Endorsed by-

MASSIF (Multiscale Attractor Stability & Stress Inference Framework}

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Real-time dynamical hidden-state safety telemetry for language models, predicting recursive collapse from latent geometry before it manifests in outputs.

Led byDaniel Solis
Endorsed by-

Governed Intelligence Architecture Specification (GIAS)

Team?
ProjectStandardsGovernanceFundraisingClaimed

An open architecture for deterministic AI governance that separates policy enforcement from model behavior, enabling trustworthy deployment across providers.

Led byRob River
Endorsed by-

Standards compliance for High-Risk AI systems

Team?
ProjectConsultancyStandardsGovernanceFundraisingClaimed

Tools and services to help organisations comply with the EU AI Act for High-Risk AI Systems

Led byKarthik Veluswamy
Endorsed by-

Consenso:AI Infrastructure for Transparent Legal & Policy Intelligence

Team?
ProjectToolingEvalsFundraisingClaimed

A legal and policy decision-making platform driven by AI provides transparency and uses verifiable data to support its recommendations. It will reduce the number of times LLMs hallucinate and will allow for the safe use of LLMs in

Led byNicolee
Endorsed by-

Frontier Watch: monitoring our advancement towards superintelligence

Team?
ProjectForecastingResearchPlatformFundraisingClaimed

An expert-elicited estimate of how far AI has closed the gap to superintelligence, scored by people with no financial stake in the answer, plus plain-language monitoring of what the six major labs actually change.

Led byJeffrey Caruso
Endorsed by-

Rendezvous

Team?
ProjectPlatformCommunityX-RiskFundraisingClaimed

An online debate platform that offers cash purses to winning responses around topics covering the most prescient issues of our time.

Led byIolanda Neto
Endorsed by-