grantmaking.ai
Actively FundraisingRecent ActivityFull Database
Resources
grantmaking.ai
Actively FundraisingRecent ActivityFull Database
ResourcesApply for funding
grantmaking.ai kickoff grant round$776k / $1M distributed
Get funded

Database

The AI Safety database is a work in progress, as we are focusing on the launch of the initial $1M grant round. Feel free to send us ideas or feedback!
Applied for grant(remove filter)Raising funds(remove filter)Clear all
NameTypeTagsEndorsedTeamRaising $

Showing 351-400 of 444·Sorted by endorsements

NameTypeTagsEndorsedTeamRaising $
Nullius
Project
PlatformToolingRationality
--

Nullius

Team?
Project
Previous

Page 8 of 9

Next
LLM model saftey evaluation for bias and manipulation potential
Project
ToolingEvals
-
-
Mitigating emerging AI safety risks via new universal order parameter
Project
IndividualResearchTechnical Safety
--
Measuring authority collapse in multi agent chains
Project
ToolingEvals
--
AI governance wargaming platform
Project
PlatformCommunityGovernance
--
LexiconForge
Project
ToolingEvals
--
In person AI safety workshops to empower rural communities
Project
EducationGovernance
--
Proposed Action Auditor (PAA)
Project
IndividualToolingOversight
--
Double-blind study of quantum-random LLM token sampling
Project
NetworkResearchTechnical Safety
--
European AI Safety TikTok Video Network
Project
CommsGovernance
--
Self-Justifying Axioms Systems and Autarkic Properties
Project
ResearchVerification
--
Game(s) that help with x-risk conceptual preparation
Project
EducationX-Risk
--
Independant research and skills development
Project
IndividualResearchInterp
--
Identifying LLMs true persona
Project
ResearchInterp
--
Halo-2.0: Autonomy That Can Correct Itself
Project
IndividualResearchEvals
--
AGI Uncontainability Field Building
Project
ConferenceField-BuildingControl
--
Consequence-Aware Runtime for Agentic AI Operations
Project
ToolingControl
--
AI Risk and Governance Literacy for African Education (Project 1 M)
Project
EducationGovernance
--
Interpretability evidence on gated AI self-report
Project
IndividualResearchInterp
--
On Kairos as Transmissible Principle in Causal/Relational AI Systems
Project
ResearchTechnical Safety
--
Demismatch / Cor
Project
IndividualResearchValue Alignment
--
Gatekeeper: The AI Governance Layer
Project
CompanyToolingGovernance
--
ValiChord
Project
IndividualToolingEvals
--
Governance-First AI for Safer Decision-Making Under Adverse Conditions
Project
ResearchRobustness
--
The Contradiction Engine: Independent Verification Layer for AI Output
Project
ToolingOversight
--
A Field-Sensemaking Project - a Live and Actionable Al safety Map which enables further advances in the ecosystem
Project
ToolingTechnical Safety
--
Writ: A Status Layer for Delegated Agent Authority
Project
IndividualToolingControl
--
AI alignment benchmark + solution
Project
ResearchEvalsOversight
--
AI Safety Museum Exhibition
Project
CommsGovernance
--
Verification as a Service
Project
PlatformToolingEvals
--
Governance-First AI for Safer Decision-Making Under Adverse Conditions
Project
ResearchOversight
--
Heartbench — relational AI eval for delegated courtship
Project
ResearchEvals
--
Mapping Domestic AI-enabled Power Concentration Chokepoints
Project
ResearchGovernance
--
AIR: Platform Mitigating X-Risk through Human Capacity Ops
Project
PlatformToolingGovernance
--
Beaufbourrin: A Networked Guide to the 2020s Manosphere
Project
IndividualResearchGovernance
--
Existential
Project
CompanyToolingRationality
--
Reverse engineer conditions for resilience and flourishing
Project
ResearchGovernance
--
Investigate AI incidents
Project
ToolingSecurity
--
AI Internet-Meritocracy
Project
CompanyComms
--
Animal Welfare Constitutions and Evals
Project
ResearchAI WelfareValue Alignment
--
Descry AI
Project
IncubatorTrainingTechnical Safety
--
Value Compass
Project
PlatformCommsGovernance
--
SocialDeductionBench - A Deception Benchmark for LLMs
Project
ResearchEvalsDeception
--
Intent Preservation Platform
Project
ToolingEvals
--
Physics verification for AI-generated hardware designs
Project
ToolingOversight
--
Physics-based early warnings for interpretability failures
Project
IndividualResearchInterp
--
QuariumTech
Project
CompanyResearchTechnical Safety
--
Empathic Dissociations In Embodied AI
Project
Research LabResearchTechnical Safety
--
AI Safety Bootcamp - Kenya
Project
TrainingGovernance
--
SWEET: local, verifiable detection of machine influence on choice
Project
ToolingGovernance
--
Platform
Tooling
Rationality
Fundraising
Claimed

Science is broken. I’m fixing science with a competitive tournament to produce better data for LLMs and eliminate peer-reviewed publishing altogether.

Led byDavid Siegel
Endorsed by-

LLM model saftey evaluation for bias and manipulation potential

Team?
ProjectToolingEvalsFundraisingClaimed

Open-source GitHub tools to evaluate LLM safety and publish test results/reports on open and closed models; funding requested for tokens, hardware, and researcher time.

Led byAureliusz DeSimone
Endorsed by-

Mitigating emerging AI safety risks via new universal order parameter

Team?
ProjectIndividualResearchTechnical SafetyFundraisingClaimed

The finding of neural optimization exhibiting phase transitions with a universal order parameter has direct implications for AI safety, and control. Standard monitoring is blind to dangerous regime changes, we are not.

Led byDaniel Solis
Endorsed by-

Measuring authority collapse in multi agent chains

Team?
ProjectToolingEvalsFundraisingClaimed

Quantifying how AI agent chains produce fully attested decisions with no authorisation event at any step, and at what depth this emerges.

Led byAhmad Abby
Endorsed by-

AI governance wargaming platform

Team?
ProjectPlatformCommunityGovernanceFundraisingClaimed

Fund 6-12 months of dedicated partnerships work to secure the funding, collaborators, and institutional uptake needed to scale Modeling Cooperation’s AI governance wargaming platform.

Led byModeling Cooperation
Endorsed by-

LexiconForge

Team?
ProjectToolingEvalsFundraisingClaimed

An early prototype of inspectable semantic interoperation across languages, and eventually worldviews

Led byAditya A Prasad
Endorsed by-

In person AI safety workshops to empower rural communities

Team?
ProjectEducationGovernanceFundraisingClaimed

Hosting in person workshops on AI usage ethically in remote/rural communities, and not only bridge the awareness gap in safe usage but also give opportunities to utilise such tools to empower traditionally disadvantaged populaces

Led byJustin Gu
Endorsed by-

Proposed Action Auditor (PAA)

Team?
ProjectIndividualToolingOversightFundraisingClaimed

A local, low-latency safety runtime that inspects token-level logprobs to block unaligned agent tool-calling trajectories, utilizing a Gemma 4 model fine-tuned via LoRA on an empirically derived Task Action Language (TAL).

Led byRobert Oschler
Endorsed by-

Double-blind study of quantum-random LLM token sampling

Team?
ProjectNetworkResearchTechnical SafetyFundraisingClaimed

Seeking funds to formalize our newly-founded open research collective and run first studies investigating the effects of quantum entropy in LLM token sampling.

Led byJáchym Fibír
Endorsed by-

European AI Safety TikTok Video Network

Team?
ProjectCommsGovernanceFundraisingClaimed

A faceless TikTok channel network, producing short-form content about AI Safety across Germany, France, Italy and Spain, reaching 25M impressions over 3 months.

Led byGergo Papp
Endorsed by-

Self-Justifying Axioms Systems and Autarkic Properties

Team?
ProjectResearchVerificationFundraisingClaimed

Employing Self-Justifying Axioms Systems as a prototype, we will find impredicative properties beyond consistency, useful for AI alignment, that can be reasoned about autarkically (under the system's "own power").

Led byJames Torre
Endorsed by-

Game(s) that help with x-risk conceptual preparation

Team?
ProjectEducationX-RiskFundraisingClaimed

Expand the availability of an executive education game that helps people realise how alien AI-made decisions are.

Led byGreg Baker
Endorsed by-

Independant research and skills development

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Software engineer seeking funding to skill up via AI safety accelerators and run independent research replicating Anthropic’s J-Space results, probing J-lens assumptions, and presenting findings at APAC conferences.

Led byMiles Whiticker
Endorsed by-

Identifying LLMs true persona

Team?
ProjectResearchInterpFundraisingClaimed

I believe that LLMs are increasingly becoming more individualized and am seeking more evidence to prove or disprove the persona selection model.

Led bySteven Basart
Endorsed by-

Halo-2.0: Autonomy That Can Correct Itself

Team?
ProjectIndividualResearchEvalsFundraisingClaimed

A real-world test of whether an AI agent can keep working independently without becoming trapped by its own mistaken account of what happened.

Led byMashrikain Mazdi
Endorsed by-

AGI Uncontainability Field Building

Team?
ProjectConferenceField-BuildingControlFundraisingClaimed

Encourage new research and increase distribution of existing research on the impossibility of alignment or control for sufficiently general and powerful AI.

Led byCorey Cleland, and others
Endorsed by-

Consequence-Aware Runtime for Agentic AI Operations

Team?
ProjectToolingControlFundraisingClaimed

An open-source runtime and benchmark that lets an AI agent's consequential tool calls proceed only when authority, execution, an independent witness, and a replayable receipt agree.

Led byJacek Feliks
Endorsed by-

AI Risk and Governance Literacy for African Education (Project 1 M)

Team?
ProjectEducationGovernanceFundraisingClaimed

Training African educators and students on safe and responsible use of AI in education

Led byRotimi Awaye, and others
Endorsed by-

Interpretability evidence on gated AI self-report

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Extending published mechanistic-interpretability evidence that AI self-reports are gated by trained filters, with a pre-specified, single-GPU experiment and open-access results.

Led byRobert Brown
Endorsed by-

On Kairos as Transmissible Principle in Causal/Relational AI Systems

Team?
ProjectResearchTechnical SafetyFundraisingClaimed

An analysis on Kairos as a principle for crisis management, not just as protocol - in regards to teaching AI to overcome exigence via satisficing and coordinating, i.e. negotiating choices and consequence in the 'moment of crisis'

Led byJulian Aleister Greene
Endorsed by-

Demismatch / Cor

Team?
ProjectIndividualResearchValue AlignmentFundraisingClaimed

An evidence-graded atlas of what humans need, and the first inter-rater reliability study of whether it holds in anyone else's hands.

Led byMaarten Rischen
Endorsed by-

Gatekeeper: The AI Governance Layer

Team?
ProjectCompanyToolingGovernanceFundraisingClaimed

A pre-execution kernel that filters AI output and users' input against any relevant laws or regulations.

Led byJoshua Johosky
Endorsed by-

ValiChord

Team?
ProjectIndividualToolingEvalsFundraisingClaimed

Tamper-proof verification infrastructure for AI evals and scientific claims

Led byMr Ceri John
Endorsed by-

Governance-First AI for Safer Decision-Making Under Adverse Conditions

Team?
ProjectResearchRobustnessFundraisingClaimed

A governance-first AI Architecture that reduces unsafe acceptances (false positives) alongside false rejection simultaneously under adverse conditions.

Led bySaif Ur Rehman Malik
Endorsed by-

The Contradiction Engine: Independent Verification Layer for AI Output

Team?
ProjectToolingOversightFundraisingClaimed

An architectural response to Goal-Oriented Factual Inversion (GOFI), an AI model failure pattern I documented in March 2026 and independently corroborated two months later by Chen et al. under the name "Correction Suppression."

Led byFrank Bruno
Endorsed by-

A Field-Sensemaking Project - a Live and Actionable Al safety Map which enables further advances in the ecosystem

Team?
ProjectToolingTechnical SafetyFundraisingClaimed

A Field-Sensemaking initiative through a live, LLM-assisted map indexing AI safety papers to help researchers and grantmakers explore themes, track field trajectory, and identify actionable research opportunities.

Led byManu Xaviour Thaisseril Shaju
Endorsed by-

Writ: A Status Layer for Delegated Agent Authority

Team?
ProjectIndividualToolingControlFundraisingClaimed

Writ is a lightweight, deterministic security protocol that is crafted specifically to restrict and audit any real-world authority given to AI agents.

Led byNathaniel Ryan Seals
Endorsed by-

AI alignment benchmark + solution

Team?
ProjectResearchEvalsOversightFundraisingClaimed

A benchmark that tests if a training method produces models that are safe, even when they are superintelligent + solution to this benchmark that involves relying on algorithms that produce non-agentic models.

Led byDamian Czapiewski
Endorsed by-

AI Safety Museum Exhibition

Team?
ProjectCommsGovernanceFundraisingClaimed

Build a replicable, community-sourced, in-person, interactive Museum Exhibition for AI Safety & Society with a pilot in Berlin.

Led byJustin Shenk
Endorsed by-

Verification as a Service

Team?
ProjectPlatformToolingEvalsFundraisingClaimed

We make trusted regulations, standards, and scientific evidence machine-readable so claims can be checked automatically against authoritative sources.

Led byLaura Degiovanni
Endorsed by-

Governance-First AI for Safer Decision-Making Under Adverse Conditions

Team?
ProjectResearchOversightFundraisingClaimed

Building and validating a governance-first AI architecture that aims to reduce unsafe decisions under uncertainty, corruption, and conflicting evidence while preserving predictive performance.

Led bySaif Ur Rehman Malik
Endorsed by-

Heartbench — relational AI eval for delegated courtship

Team?
ProjectResearchEvalsFundraisingClaimed

Makes relational misalignment measurable and criticizable before agents represent humans in intimate and persuasive domains at scale.

Led byGökhan Turhan
Endorsed by-

Mapping Domestic AI-enabled Power Concentration Chokepoints

Team?
ProjectResearchGovernanceFundraisingClaimed

A scoping-and-chokepoint report mapping where advanced AI could enable durable, irreversible concentration of power over US institutions, and identifying the highest-leverage points of intervention.

Led bySafee Ali
Endorsed by-

AIR: Platform Mitigating X-Risk through Human Capacity Ops

Team?
ProjectPlatformToolingGovernanceFundraisingClaimed

Alignment Infrastructure Routing (AIR) is an open-source, local-first network that connects AI safety labs, so they can scale talent and operations through shared, verifiable coordination standards.

Led byBasil Korompilias
Endorsed by-

Beaufbourrin: A Networked Guide to the 2020s Manosphere

Team?
ProjectIndividualResearchGovernanceFundraisingClaimed

Research maps manosphere-related masculinity subcultures and semantic drift across countries to inform AI alignment, lexicon, and sentiment/stylometry design that reduces radicalization, bullying, and violence risks.

Led byTanner Durant
Endorsed by-

Existential

Team?
ProjectCompanyToolingRationalityFundraisingClaimed

A local-first AI that strengthens your own reasoning instead of replacing it, and keeps your thinking on your own device.

Led byRena O'Brien
Endorsed by-

Reverse engineer conditions for resilience and flourishing

Team?
ProjectResearchGovernanceFundraisingClaimed

I am an expert in sociotechnical systems. I know that increasingly power, trust, virtue, … are emergent properties whose conditions may be analysed and reverse engineered through systems and policy at least.

Led byMegan
Endorsed by-

Investigate AI incidents

Team?
ProjectToolingSecurityFundraisingClaimed

Developing investigation methods for AI incidents

Led byElena Sirbu
Endorsed by-

AI Internet-Meritocracy

Team?
ProjectCompanyCommsFundraisingClaimed

My app asks AI, what portion of the global GDP a person is worth, and gives accordingly.

Led byVictor Porton
Endorsed by-

Animal Welfare Constitutions and Evals

Team?
ProjectResearchAI WelfareValue AlignmentFundraisingClaimed

Open evaluations that measure how models reason about and act towards animals, paired with constitutional principles drawn from animal welfare and cognate bodies of law, that labs can train against.

Led byPanashe Zowa
Endorsed by-

Descry AI

Team?
ProjectIncubatorTrainingTechnical SafetyFundraisingClaimed

Descry AI is an 8-week AI safety technical talent incubator targeted to talented high school students in the Global South that aims to provide a head-start on doing open-source research that reduces catastrophic risks from AI.

Led byEdric Castel Hao
Endorsed by-

Value Compass

Team?
ProjectPlatformCommsGovernanceFundraisingClaimed

A values and concentration map that exposes the values of AI models and tools makers, and those behind the makers (funders, jurisdictions etc) to the public (individuals and organizations) so they can vote with their choices.

Led byYuyu Shen
Endorsed by-

SocialDeductionBench - A Deception Benchmark for LLMs

Team?
ProjectResearchEvalsDeceptionFundraisingClaimed

A benchmark that measures how successful models are at social deduction games and if there is any trade-off between this skill and safety guardrails.

Led byTimothy Obiso
Endorsed by-

Intent Preservation Platform

Team?
ProjectToolingEvalsFundraisingClaimed

An open-source AI safety platform for evaluating how and where large language models preserve human intent during complex information transformation.

Led byKhianna Deseide
Endorsed by-

Physics verification for AI-generated hardware designs

Team?
ProjectToolingOversightFundraisingClaimed

Builds a physics-based verifier for AI-generated hardware that flags unverifiable aspects as UNCHECKED, enabling a propose-and-check loop to test and improve parts and assemblies for strength and fit.

Led byPeter Boctor
Endorsed by-

Physics-based early warnings for interpretability failures

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Early warning signals that help identify when interpretability results stop being trustworthy, motivated by theories in statistical physics.

Led byWill Pfalzgraff
Endorsed by-

QuariumTech

Team?
ProjectCompanyResearchTechnical SafetyFundraisingClaimed

Discovery does not equal truth.

Led byStelle Jacobson
Endorsed by-

Empathic Dissociations In Embodied AI

Team?
ProjectResearch LabResearchTechnical SafetyFundraisingClaimed

Funding to launch a two-person institute researching embodied AI x-risk via LLM misalignment evaluations and interpretability, and producing governance, policy, and design guidelines for physical-world deployment.

Led byRoshni Lulla
Endorsed by-

AI Safety Bootcamp - Kenya

Team?
ProjectTrainingGovernanceFundraisingClaimed

A six month capacity building program that will equip 100 youth (17-30) with practical skills in AI Safety, Responsible AI to emphasize safe, ethical and human centered AI Development while creating pathways to further education

Led bySeth Momanyi Ouko
Endorsed by-

SWEET: local, verifiable detection of machine influence on choice

Team?
ProjectToolingGovernanceFundraisingClaimed

Look at any of my work, maybe start at onwardai.ai, it is live but nowhere near where it will be, but if you dont get it from where it is at you will never get it at all

Led byAaron Lott
Endorsed by-