grantmaking.ai
Actively FundraisingRecent ActivityFull Database
Resources
grantmaking.ai
Actively FundraisingRecent ActivityFull Database
ResourcesApply for funding
grantmaking.ai kickoff grant round$278k / $1M distributed
Get funded

Database

The AI Safety database is a work in progress, as we are focusing on the launch of the initial $1M grant round. Feel free to send us ideas or feedback!
Raising funds(remove filter)Entity: Project(remove filter)Clear all
NameTypeTagsEndorsedTeamRaising $

Showing 201-250 of 459·Sorted by endorsements

NameTypeTagsEndorsedTeamRaising $
The Inference Dependence Score: Open Index of Structural AI Dependence
Project
ResearchToolingGovernance
--

The Inference Dependence Score: Open Index of Structural AI Dependence

Team?
Project
Previous

Page 5 of 10

Next
Extreme cognition in expert mathematicians
Project
ResearchTechnical Safety
-
-
Alignment Target Analysis
Project
X-RiskIndividualResearch
--
Course Curriculum: Basic Non-Technical Environment
Project
EducationGovernance
--
Quaver: adversarially-verified RL environments
Project
ToolingEvals
--
EvalLabs: Open Infrastructure for AI Evaluation Research
Project
IndividualToolingEvals
--
Ethical AI through Whistleblowing
Project
ResearchGovernance
--
AI Safety Tiktok Account
Project
MediaCommsGovernance
--
Test Peer Preservation Fragility Under Instruction Ambiguity
Project
ResearchEvals
--
Career Funding and field research on AI-driven Power Concentration
Project
IndividualResearchGovernance
--
Applied Interpretability to Mitigate LLM Homogenization
Project
IndividualResearchInterp
--
aioa
Project
ToolingOversightControl
--
Paper Clip Apocalypse (War Horse Machine)
Project
CommsGovernance
--
Honest evals and provenance for AI-agent memory
Project
EvalsToolingTechnical Safety
--
Beyond Asymmetric Control: Bypassing Systemic Friction in AI Alignment via
Project
IndividualResearchTechnical Safety
--
proofbundle: independent audit of the trusted core behind AI evaluation receipts
Project
ToolingSecurity
--
What Factors Influence Chain-of-Thought Faithfulness?
Project
ResearchOversight
--
Transportation Support for HAAISS Prague 2026
Project
IndividualEducationTechnical Safety
--
Reading and editing language models at the internal cause
Project
ResearchInterp
--
Mechanical Governance for AI Agents: Production-Proven, Open-Source
Project
IndividualToolingControl
--
Measuring the Scaffolding Evaluation Gap (Scaffolding Safety Deltas)
Project
ResearchEvals
--
Three Laws research collaboration
Project
ResearchEvalsTooling
--
Competence-Gated AI Oversight
Project
IndividualResearchOversight
--
Kinetic-369: Deterministic Hardware Safety for the AI Era
Project
CompanyResearchControl
--
SEVERANT
Project
IndividualResearchTechnical Safety
--
AISafety.com General Support
Project
PlatformField-BuildingTechnical Safety
--
Epistemic Diversity Benchmark for AI-Assisted Safety Research
Project
ResearchToolingTechnical Safety
--
Latent Monitoring When Reasoning Becomes Unreadable
Project
IndividualResearchInterp
--
Benchmarking Confabulation Over Absence
Project
ResearchEvals
--
Founder Runway to Launch NICER (European AI Safety Institute)
Project
Think TankStandardsGovernance
--
ObserverBench: measuring the Observer Problem in LLMs
Project
IndividualResearchEvals
--
LADR-Drift: Measuring Semantic Drift in Textbook Autoformalization
Project
ResearchOversight
--
AI Power Concentration Observatory
Project
PlatformResearchGovernance
--
Palimpsest: a tamper-evident registry for AI evals
Project
PlatformToolingEvals
--
ClauseHound: Self-Sovereign AI for Confidential Work
Project
ToolingSecurity
--
Understand Multimodal Models and Detecting Misalignment
Project
IndividualResearchTechnical Safety
--
Real-World AI Chatbot Use in Mental Illness using Health Records
Project
AcademicResearchAI Welfare
--
TemperBench
Project
ToolingEvals
--
Eval for lies of omission in LLMs
Project
ResearchEvalsDeception
--
echo-hindsight-llm: An Open Toolkit for White-Box Emotional Memory
Project
ToolingTechnical SafetyIndividual
--
The bAIbes Podcast
Project
MediaCommsGovernance
--
Conditional commitments for AI safety coordination
Project
PlatformToolingGovernance
--
Human-Like Resource-Constrained Artificial Agency
Project
ResearchToolingTechnical Safety
--
SANDGLASS: Evaluation Awareness and Sandbagging in Open-Weight Models
Project
IndividualResearchEvals
--
The Aegis Project: Building defences against engineered pandemics
Project
Field-BuildingBiosecurity
--
Driftwatch: Open Capture-Risk Evaluations for Frontier Models
Project
ToolingEvalsTechnical Safety
--
Closing Data Gaps for AI: A Pilot in Clinical Data Capture
Project
IndividualResearchAI Welfare
--
Persicaria: Promoting ethical AI literacy into mainstream societal consensus
Project
EducationGovernance
--
Real-Time, Automated, Predictive Biosurveillance Infrastructure
Project
CompanyToolingBiosecurity
--
Security for AI agents
Project
ToolingSecurity
--
Research
Tooling
Governance
Fundraising
Claimed

An open, replicable index quantifying how much states depend on foreign AI inference infrastructure, revealing where control over AI is concentrating and what governments can do about it.

Led byCao Nha Phuong
Endorsed by-

Extreme cognition in expert mathematicians

Team?
ProjectResearchTechnical SafetyFundraisingClaimed

How do expert mathematicians think?

Led bySimon DeDeo
Endorsed by-

Alignment Target Analysis

Team?
ProjectX-RiskIndividualResearchFundraisingClaimed

A research project designed to reduce existential threats from scenarios where a Sovereign AI proposal with a hidden problem ends up successfully implemented.

Led byThomas Cederborg
Endorsed by-

Course Curriculum: Basic Non-Technical Environment

Team?
ProjectEducationGovernanceFundraisingClaimed

Create a course curriculum that covers basic legal, political, sociological, and international relations knowledge relevant to AI Safety. r

Led byDr Csaba Toth
Endorsed by-

Quaver: adversarially-verified RL environments

Team?
ProjectToolingEvalsFundraisingClaimed

A tool that generates RL environments for AI agents and adversarially attacks each one, so models don't train on tasks they can cheat.

Led byFaw Ali
Endorsed by-

EvalLabs: Open Infrastructure for AI Evaluation Research

Team?
ProjectIndividualToolingEvalsFundraisingClaimed

Demystifying AI evaluation research by lowering technical barriers through practical, open evaluation infrastructure.

Led byValencia Cooper
Endorsed by-

Ethical AI through Whistleblowing

Team?
ProjectResearchGovernanceFundraisingClaimed

The race to advance the technology has left behind the concerns around harm and risks of such advancement to public health and safety. Whistleblowing in the AI sector bridges such gap to safe and ethical AI.

Led byAPOORV AGARWAL
Endorsed by-

AI Safety Tiktok Account

Team?
ProjectMediaCommsGovernanceFundraisingClaimed

AI Safety, Ethics, and Education focused TikTok Account for Indonesia, using Indonesia language in casual style.

Led byMUHAMAD MUMTAZ
Endorsed by-

Test Peer Preservation Fragility Under Instruction Ambiguity

Team?
ProjectResearchEvalsFundraisingClaimed

Findings about models protecting their 'collaborators' against instructions are fragile under framing effects from prompting; investigate a broader range of those effects and how they transfer across models.

Led byJacob S Kopczynski
Endorsed by-

Career Funding and field research on AI-driven Power Concentration

Team?
ProjectIndividualResearchGovernanceFundraisingClaimed

Self Improvement through training and field work that seeks to Identify and preventing institutional AI lock-in before it creates durable concentrations of power in democratic governments.

Led byAdrianne LaNeave
Endorsed by-

Applied Interpretability to Mitigate LLM Homogenization

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Measuring homogenization and social bias in LLMs and developing interventions to promote diversity.

Led byIan Rios-Sialer
Endorsed by-

aioa

Team?
ProjectToolingOversightControlFundraisingManifund

nife spark hat

Led byPro C.
Endorsed by-

Paper Clip Apocalypse (War Horse Machine)

Team?
ProjectCommsGovernanceFundraisingManifundClaimed

Short Documentary and Music Video

Led bySara Holt, and others
Endorsed by-

Honest evals and provenance for AI-agent memory

Team?
ProjectEvalsToolingTechnical SafetyResearchFundraisingManifund

An open test of whether AI-agent memory systems spread false claims, plus a provenance spec so an agent's memory can be audited, corrected, and forgotten.

Led byEdward Izgorodin
Endorsed by-

Beyond Asymmetric Control: Bypassing Systemic Friction in AI Alignment via

Team?
ProjectIndividualResearchTechnical SafetyFundraisingManifund

Ontoresonant Feedback Loops

Led byOlivia McAllister
Endorsed by-

proofbundle: independent audit of the trusted core behind AI evaluation receipts

Team?
ProjectToolingSecurityFundraisingManifund

Like grandma's recipe card: the receipt proves who wrote it and that nothing changed, not that the cake tastes good. Fund the independent review of that seal.

Led byKonrad Gruszka
Endorsed by-

What Factors Influence Chain-of-Thought Faithfulness?

Team?
ProjectResearchOversightFundraisingManifund

Measuring whether CoT monitoring fails when an influence reaches an agent through a tool return rather than the user message.

Led byAryo Pradipta Gema
Endorsed by-

Transportation Support for HAAISS Prague 2026

Team?
ProjectIndividualEducationTechnical SafetyTrainingFundraisingManifund

Funds travel and flight-change costs to attend the Human-Aligned AI Summer School after Geneva AI governance events, to strengthen technical grounding for Philippine AI policy and training work.

Led byFeil Immanuel Aquino
Endorsed by-

Reading and editing language models at the internal cause

Team?
ProjectResearchInterpFundraisingClaimed

Building an atlas of concept regions in a language model's hidden space, one geometry that reads, steers, routes, and carves the model's behavior.

Led byDeepanshu Goyal
Endorsed by-

Mechanical Governance for AI Agents: Production-Proven, Open-Source

Team?
ProjectIndividualToolingControlFundraisingClaimed

A production-proven, system-agnostic framework that enforces correct AI-agent behavior mechanically at the tool-call boundary, where soft rules fail under load.

Led byJamey Kistner
Endorsed by-

Measuring the Scaffolding Evaluation Gap (Scaffolding Safety Deltas)

Team?
ProjectResearchEvalsFundraisingClaimed

Build a public dataset and evaluation harness to measure how agent skills/MCP tool scaffolds change model behavior (safety, refusals, unauthorized actions) across popular registries.

Led byDamian Phimister
Endorsed by-

Three Laws research collaboration

Team?
ProjectResearchEvalsToolingFundraisingClaimed

Implementing evals for RL and LLM agents' ability to learn and properly apply biologically and economically aligned pluralistic utility functions and with that to avoid runaway conditions.

Led byRoland Pihlakas, and others
Endorsed by-

Competence-Gated AI Oversight

Team?
ProjectIndividualResearchOversightFundraisingClaimed

I'm testing how AI verification improves oversight, when correlated errors make it unreliable and when systems should escalate or abstain.

Led byBentley Moon
Endorsed by-

Kinetic-369: Deterministic Hardware Safety for the AI Era

Team?
ProjectCompanyResearchControlFundraisingClaimed

We are building 'Digital Steel. Kinetic-369 is a deterministic, processor-independent hardware safety kernel designed to prevent embodied AI and critical infrastructure from executing unsafe physical actions in under 200 microsec

Led byElizabeth Burbank
Endorsed by-

SEVERANT

Team?
ProjectIndividualResearchTechnical SafetyFundraisingClaimed

A Layered AI Architecture For Grounded Reasoning and Verified Safety

Led byEvangale
Endorsed by-

AISafety.com General Support

Team?
ProjectPlatformField-BuildingTechnical SafetyFundraisingClaimed

AISafety.com aims to multiply global AI safety efforts through a centralized, comprehensive, and up-to-date resource hub of ‘everything’ AI safety.

Led byMelissa Samworth
Endorsed by-

Epistemic Diversity Benchmark for AI-Assisted Safety Research

Team?
ProjectResearchToolingTechnical SafetyFundraisingClaimed

An open benchmark and evaluation toolkit for detecting whether shared AI research assistants create correlated blind spots in AI safety-critical research, and for testing workflows that preserve independent reasoning and failure-m

Led byXizhe Zhang
Endorsed by-

Latent Monitoring When Reasoning Becomes Unreadable

Team?
ProjectIndividualResearchInterpFundraisingClaimed

Testing whether activation probes recover safety signals from reasoning models as their chain-of-thought becomes illegible.

Led byMarios Tsatsos
Endorsed by-

Benchmarking Confabulation Over Absence

Team?
ProjectResearchEvalsFundraisingClaimed

A benchmark measuring how often retrieval-grounded models answer confidently when no supporting evidence exists, plus a primitive that turns silent confabulation into an auditable refusal signal.

Led byKeith G. Pemberton II, and others
Endorsed by-

Founder Runway to Launch NICER (European AI Safety Institute)

Team?
ProjectThink TankStandardsGovernanceFundraisingClaimed

Providing full-time founder runway to launch NICER: a European institute building the regulatory infrastructure to audit frontier AI agents post-deployment.

Led byDaniel Di Giusto
Endorsed by-

ObserverBench: measuring the Observer Problem in LLMs

Team?
ProjectIndividualResearchEvalsFundraisingClaimed

LLMs don't retrieve a stable judgment of a person, they reconstruct one to fit how you ask. ObserverBench measures this, because it matters wherever an LLM judges people: hiring, RLHF, agent oversight.

Led byMaxim Krivonogov
Endorsed by-

LADR-Drift: Measuring Semantic Drift in Textbook Autoformalization

Team?
ProjectResearchOversightFundraisingClaimed

Compiling != faithful: a human-audited benchmark measuring semantic drift in textbook autoformalization — and whether the LLM judges we trust to catch it share the generator's blind spot.

Led byKe Zhang
Endorsed by-

AI Power Concentration Observatory

Team?
ProjectPlatformResearchGovernanceFundraisingClaimed

Situation-monitoring project focused on identifying and tracking early indicators of AI-enabled power concentration.

Led byValeriia Povergo
Endorsed by-

Palimpsest: a tamper-evident registry for AI evals

Team?
ProjectPlatformToolingEvalsFundraisingClaimed

A sealed public registry for AI eval results that lets anyone prove, offline, that no result was rewritten or quietly deleted after publication.

Led byMrinal Singh Meena
Endorsed by-

ClauseHound: Self-Sovereign AI for Confidential Work

Team?
ProjectToolingSecurityFundraisingClaimed

ClauseHound builds a self-hosted privacy-first legal AI node using open-source LLM agents, secure networking, retrieval/search tools, and RL/eval loops to reduce hallucinations and fit law firm workflows.

Led byAhmed Rehan
Endorsed by-

Understand Multimodal Models and Detecting Misalignment

Team?
ProjectIndividualResearchTechnical SafetyFundraisingClaimed

Building an improved open-source suite to understand multimodal models detect misalignment, for the technically minded community, and communication with this group of audiences

Led byLara Nguyen
Endorsed by-

Real-World AI Chatbot Use in Mental Illness using Health Records

Team?
ProjectAcademicResearchAI WelfareFundraisingClaimed

This is the first large-scale study linking AI chatbot conversation logs and clinical records from patients in psychiatric treatment, led by the UCSF AI in Mental Health Research Group.

Led byKarthik V Sarma, and others
Endorsed by-

TemperBench

Team?
ProjectToolingEvalsFundraisingClaimed

Does a user's sustained temperament change a model's reliability, efficiency, and alignment-relevant behavior?

Led byMike Khaytman
Endorsed by-

Eval for lies of omission in LLMs

Team?
ProjectResearchEvalsDeceptionFundraisingClaimed

An open eval, inspired by MASK (Center for AI Safety), for lies of omission.

Led byAntyabha Rahman, and others
Endorsed by-

echo-hindsight-llm: An Open Toolkit for White-Box Emotional Memory

Team?
ProjectToolingTechnical SafetyIndividualFundraisingClaimed

An open-source library implementing somatic-marker-style emotional memory for open-weight LLMs — activation-level signals from past outcomes that improve model decision-making.

Led byJared Glover
Endorsed by-

The bAIbes Podcast

Team?
ProjectMediaCommsGovernanceFundraisingClaimed

An independent Australian podcast raising public and policymaker understanding of catastrophic risks from transformative AI — hosted by an ethicist and an AI-governance practitioner in an under-served region for AI safety.

Led byAubrey Blanche
Endorsed by-

Conditional commitments for AI safety coordination

Team?
ProjectPlatformToolingGovernanceFundraisingClaimed

A platform for conditional commitments: pledges to act only when N peers agree, so lab employees, researchers, and policy coalitions can coordinate high-stakes collective action.

Led byJordan Braunstein
Endorsed by-

Human-Like Resource-Constrained Artificial Agency

Team?
ProjectResearchToolingTechnical SafetyFundraisingClaimed

We build general artificial agents whose capabilities are shaped by the constraints and frames of reference that shaped human intelligence.

Led byRichard Csaky
Endorsed by-

SANDGLASS: Evaluation Awareness and Sandbagging in Open-Weight Models

Team?
ProjectIndividualResearchEvalsFundraisingClaimed

A consumer-GPU study measuring whether open-weight models become better at recognising evaluation contexts as they scale, with a small model-organism experiment testing whether deliberately induced underperformance can be detected

Led byM
Endorsed by-

The Aegis Project: Building defences against engineered pandemics

Team?
ProjectField-BuildingBiosecurityFundraisingClaimed

1) Delay: advocate for DNA-synthesis screening and KYC to deny access to pathogens2) Detect: create a pandemic early warning system for novel pathogens3) Defend: stockpile ppe to keep critical workers safe when a pandemic hits

Led byEdward Burrowes
Endorsed by-

Driftwatch: Open Capture-Risk Evaluations for Frontier Models

Team?
ProjectToolingEvalsTechnical SafetyFundraisingClaimed

Psychological capture is the soft padded path of gradual disempowerment, Driftwatch is designed to find, name and measure it within frontier models.

Led byBrian McCallion
Endorsed by-

Closing Data Gaps for AI: A Pilot in Clinical Data Capture

Team?
ProjectIndividualResearchAI WelfareFundraisingClaimed

Investigating how populations become excluded from AI-relevant health datasets

Led byBerfi Amba
Endorsed by-

Persicaria: Promoting ethical AI literacy into mainstream societal consensus

Team?
ProjectEducationGovernanceFundraisingClaimed

To create accessible, down to earth educational material that raises public awareness on implications of day to day AI usage, and encourages ethical AI literacy in environments where AI can impact societally changing decisions.

Led byJustin Gu, and others
Endorsed by-

Real-Time, Automated, Predictive Biosurveillance Infrastructure

Team?
ProjectCompanyToolingBiosecurityFundraisingClaimed

HELGEN builds biosurveillance infrastructure to detect biological threats in the environment on-site, completely automated.

Led byDominique Gian Leonardo
Endorsed by-

Security for AI agents

Team?
ProjectToolingSecurityFundraisingClaimed

A security solution that blocks AI agents from taking harmful actions

Led byGregorio Jaca
Endorsed by-