grantmaking.ai
Actively FundraisingRecent ActivityFull Database
Resources
grantmaking.ai
Actively FundraisingRecent ActivityFull Database
ResourcesApply for funding
grantmaking.ai kickoff grant round$328k / $1M distributed
Get funded

Database

The AI Safety database is a work in progress, as we are focusing on the launch of the initial $1M grant round. Feel free to send us ideas or feedback!
Entity: Grantmaker(remove filter)Entity: Org(remove filter)Clear all
NameTypeTagsEndorsedTeamRaising $

Showing 1-50 of 590·Sorted by endorsements

NameTypeTagsEndorsedTeamRaising $
Lightcone Infrastructure
Org
RationalityOpsNetwork
+5

Lightcone Infrastructure

Team8
Org
Previous

Page 1 of 12

Next
8
-
Forethought
Org
ResearchGovernanceThink Tank
+1
14-
AI Digest
Org
GovernanceComms
3-
Model Evaluation & Threat Research (METR)
Org
ResearchEvalsResearch Lab
30-
AI Futures Project
Org
ResearchForecastingThink Tank
5-
Apollo Research
Org
ResearchTechnical SafetyResearch Lab
24-
ControlAI
Org
AdvocacyGovernanceThink Tank
+3
--
PauseAI
Org
AdvocacyGovernanceNetwork
+1
5-
A
AI Verification and Evaluation Research Institute (AVERI)
Org
ResearchEvalsResearch Lab
---
ILINA Program
Org
TrainingTechnical SafetyResearch Lab
+2
11-
UK AI Security Institute (UK AISI)
Org
ResearchEvalsGovernment
+1
100-
80,000 Hours
Org
GovernanceEducationThink Tank
50-
Transluce
Org
ToolingInterpResearch Lab
20-
Machine Alignment Transparency and Security (MATS)
Org
TrainingTechnical Safety
44-
Long-Term Future Fund
Org
Field-BuildingFunderX-Risk
11-
LessWrong
Org
CommunityNewsletterRationality
8-
Palisade Research
Org
ResearchEvalsResearch Lab
15-
Survival and Flourishing Fund (SFF)
Org
Field-BuildingFunderX-Risk
--
FAR AI
Org
ResearchTechnical SafetyResearch Lab
41-
The Future Society
Org
AdvocacyGovernanceThink Tank
7-
Institute for AI Policy and Strategy
Org
ResearchGovernanceThink Tank
28-
Talos Network
Org
GovernanceTrainingNetwork
--
AI Safety Camp
Org
TrainingTechnical Safety
2-
Foresight Institute
Org
Field-BuildingTechnical SafetyThink Tank
15-
SteadRise
Org
GovernanceTraining
5-
CeSIA
Org
AdvocacyGovernanceThink Tank
11-
Legal Advocates for Safe Science and Technology (LASST)
Org
GovernanceThink TankLegal
3-
Catalyze Impact
Org
Field-BuildingIncubatorSecurity
4-
AI Risk Mitigation Fund
Org
Field-BuildingFunderTechnical Safety
8-
Orthogonal
Org
ResearchAgent FoundationsResearch Lab
--
Carnegie Mellon University
Org
ResearchAcademicSecurity
8k-
Frontier Model Forum
Org
StandardsNetworkSecurity
-1-
AIUC
Org
CompanyStandardsSecurity
---
Eigenism
Org
ResearchAlignment Theory
---
AI Evaluator Forum
Org
StandardsNetworkEvals
---
CRUX
Org
ResearchEvals
--
Fathom
Org
AdvocacyGovernanceThink Tank
---
Effective Institutions Project
Org
ResearchGovernanceFunder
7-
Centre for Enabling EA Learning & Research
Org
EATrainingIncubator
2-
Tarbell Center for AI Journalism
Org
NewsletterGovernanceComms
9-
Secure AI Project
Org
AdvocacyGovernanceThink Tank
7-
Institute for Law & AI (LawAI)
Org
AdvocacyGovernanceThink Tank
30-
Center for Applied Rationality
Org
RationalityTrainingThink Tank
8-
Mox
Org
CommunityHubTechnical Safety
5-
Epoch AI
Org
ResearchForecastingResearch Lab
21-
Siliconversations
Org
MediaCommsX-Risk
-1-
Non-Trivial
Org
TrainingX-Risk
3-
Luthien
Org
ToolingControlResearch Lab
2-
Partnership on AI (PAI)
Org
StandardsGovernanceNetwork
-40-
Metaculus
Org
ResearchForecastingPlatform
28-
Rationality
Ops
Network

A nonprofit that builds infrastructure for the rationality and AI safety communities, running LessWrong, the AI Alignment Forum, and the Lighthaven campus in Berkeley, CA.

Led byBen Pace, and others
Endorsed by
+3

Forethought

Team14
OrgResearchGovernanceThink Tank

A research nonprofit focused on how to navigate the transition to a world with superintelligent AI systems, tackling neglected questions in AI macrostrategy.

Led byWilliam MacAskill, and others
Endorsed by

AI Digest

Team3
OrgGovernanceComms

AI Digest creates interactive explainers and demos to help policymakers and the public understand AI capabilities and their effects, operated as a project of Sage Future, a US 501(c)(3) charity.

Led byAdam Binksmith, and others
Endorsed by

Model Evaluation & Threat Research (METR)

Team30
OrgResearchEvalsResearch Lab

METR is a research nonprofit that develops scientific methods to evaluate whether frontier AI systems could pose catastrophic risks to society, working with leading AI labs on pre-deployment safety assessments.

Led byElizabeth (Beth) Barnes, and others
Endorsed by

AI Futures Project

Team5
OrgResearchForecastingThink Tank

A nonprofit research organization that develops detailed scenario forecasts of advanced AI trajectories to inform policymakers, researchers, and the public.

Led byEli Lifland, and others
Endorsed by

Apollo Research

Team24
OrgResearchTechnical SafetyResearch Lab

Apollo Research is an AI safety organization that develops evaluations and tools to detect and mitigate deceptive alignment (scheming) in frontier AI systems.

Led byChristopher Akin, and others
Endorsed by

ControlAI

Team?
OrgAdvocacyGovernanceThink TankClaimed

ControlAI is a nonprofit advocacy organization working to keep humanity in control of advanced AI by pushing governments to prohibit the development of artificial superintelligence.

Led byAndrea Miotti
Endorsed by
+3

PauseAI

Team5
OrgAdvocacyGovernanceNetworkClaimed

PauseAI is a global grassroots movement advocating for an immediate pause on the development of frontier AI systems until their safety can be demonstrated and they can be kept under democratic control.

Led byJoep Meindertsma, and others
Endorsed by
+1
A

AI Verification and Evaluation Research Institute (AVERI)

Team?
OrgResearchEvalsResearch Lab

No summary available yet.

Led by?
Endorsed by-

ILINA Program

Team11
OrgTrainingTechnical SafetyResearch Lab

An African-led research program dedicated to building talent, generating impactful research, and shaping policy to advance AI safety, based in Nairobi, Kenya.

Led byCecil Abungu, and others
Endorsed by
+2

UK AI Security Institute (UK AISI)

Team100
OrgResearchEvalsGovernment

UK government research organization that tests frontier AI systems, advances AI safety science, and informs policymakers about the risks and capabilities of advanced AI.

Led byAdam Beaumont, and others
Endorsed by
+1

80,000 Hours

Team50
OrgGovernanceEducationThink TankClaimed

80,000 Hours is a nonprofit that provides free research, career advice, and a job board to help people find careers that effectively tackle the world's most pressing problems, with a current focus on AI safety.

Led byBenjamin Todd, and others
Endorsed by

Transluce

Team20
OrgToolingInterpResearch Lab

Transluce is an independent nonprofit AI research lab that builds open, scalable technology for understanding AI systems and steering them in the public interest.

Led byJacob Steinhardt, and others
Endorsed by

Machine Alignment Transparency and Security (MATS)

Team44
OrgTrainingTechnical Safety

MATS (ML Alignment & Theory Scholars) is the largest AI safety research fellowship and talent pipeline, running intensive 12-week research programs that pair fellows with leading AI alignment mentors in Berkeley and London.

Led byChristian Smith, and others
Endorsed by

Long-Term Future Fund

Team11
OrgField-BuildingFunderX-Risk

An expert-managed grantmaking fund within EA Funds that distributes millions annually to reduce global catastrophic risks, with a primary focus on AI safety research, biosecurity, and other existential risk mitigation work.

Led byAsya Bergal, and others
Endorsed by

LessWrong

Team8
OrgCommunityNewsletterRationality

A community blog and forum devoted to refining the art of human rationality, with major focus areas including AI alignment, cognitive biases, decision-making, and effective altruism.

Led byOliver Habryka
Endorsed by

Palisade Research

Team15
OrgResearchEvalsResearch Lab

Nonprofit investigating cyber offensive AI capabilities and the controllability of frontier AI models to help humanity avoid permanent disempowerment by strategic AI agents.

Led byJeffrey Ladish, and others
Endorsed by

Survival and Flourishing Fund (SFF)

Team?
OrgField-BuildingFunderX-Risk

SFF distributed $141M since 2019 (primarily from Jaan Tallinn's ~$900M fortune), with the 2025 round totaling $34.33M (86% to AI safety). Uses unique S-process mechanism where 6-12 recommenders express utility functions and an algorithm allocates grants favoring projects with enthusiastic champions, though the mechanism can produce volatile grant distributions year-to-year.

Led by?
Endorsed by

FAR AI

Team41
OrgResearchTechnical SafetyResearch Lab

FAR.AI is an AI safety research nonprofit that conducts technical research on robustness, alignment, and model evaluation, while building the AI safety field through workshops, fellowships, and grantmaking.

Led byAdam Gleave, and others
Endorsed by

The Future Society

Team7
OrgAdvocacyGovernanceThink Tank

A nonprofit organization based in the US and Europe that works to align AI through better governance, developing and advocating for AI governance mechanisms ranging from laws and regulations to voluntary frameworks.

Led byNick Moës, and others
Endorsed by

Institute for AI Policy and Strategy

Team28
OrgResearchGovernanceThink Tank

A nonpartisan think tank that produces policy research on the implications of advanced AI systems, covering frontier security, compute governance, and international AI strategy to equip policymakers for high-magnitude AI risks.

Led byBrianna Rosen
Endorsed by

Talos Network

Team?
OrgGovernanceTrainingNetwork

A German nonprofit that cultivates the next generation of European AI policy leaders through its flagship Talos Fellowship, combining training, a Brussels policymaking summit, and paid placements at leading think tanks and policy organizations.

Led byNell Watson
Endorsed by

AI Safety Camp

Team2
OrgTrainingTechnical SafetyClaimed

A non-profit initiative that runs an online, part-time research program connecting early-career researchers with experienced AI safety mentors to collaborate on concrete projects aimed at reducing existential risk from AI.

Led byRobert Kralisch, and others
Endorsed by

Foresight Institute

Team15
OrgField-BuildingTechnical SafetyThink TankClaimed

A nonprofit research organization founded in 1986 that advances frontier science and technology for the benefit of life, with focus areas spanning secure AI, nanotechnology, longevity biotechnology, neurotechnology, and existential hope.

Led byAllison Duettmann, and others
Endorsed by

SteadRise

Team5
OrgGovernanceTraining

A non-profit AI safety field-builder that surfaces experienced professionals and supports their transition into critical roles at leading AI safety organizations.

Led byRoy Hagemann, and others
Endorsed by

CeSIA

Team11
OrgAdvocacyGovernanceThink Tank

CeSIA (Centre pour la Sécurité de l'IA), the French Center for AI Safety, is a Paris-based non-profit working to prevent catastrophic risks from frontier AI through policy advocacy, international coalition-building, and public engagement in France, Europe and globally.

Led byCharbel-Raphaël Segerie, and others
Endorsed by

Legal Advocates for Safe Science and Technology (LASST)

Team3
OrgGovernanceThink TankLegal

A nonprofit that uses legal advocacy, including amicus briefs, impact litigation, and policy engagement, to mitigate catastrophic risks from advanced AI systems and biotechnology.

Led byAmy Labenz, and others
Endorsed by

Catalyze Impact

Team4
OrgField-BuildingIncubatorSecurity

A global nonprofit incubator that helps founders launch and scale AI safety, security, and resilience organizations by providing mentorship, co-founder matching, and access to seed funding networks.

Led byAlexandra Bos, and others
Endorsed by

AI Risk Mitigation Fund

Team8
OrgField-BuildingFunderTechnical Safety

A nonprofit grantmaking fund that supports technical AI safety research, AI governance policy, and training programs for new AI safety researchers to reduce catastrophic risks from advanced AI.

Led byAdam Gleave, and others
Endorsed by

Orthogonal

Team?
OrgResearchAgent FoundationsResearch Lab

A non-profit AI alignment research organization focused on agent foundations, pursuing formal goal alignment approaches that would scale to superintelligence.

Led byTamsin Leake, and others
Endorsed by

Carnegie Mellon University

Team8000
OrgResearchAcademicSecurity

Carnegie Mellon University is a leading private research university in Pittsburgh, Pennsylvania, widely regarded as one of the world's top institutions for AI and computer science research. It hosts multiple AI safety and governance programs spanning technical research, policy, and applied AI security.

Led by?
Endorsed by

Frontier Model Forum

Team1
OrgStandardsNetworkSecurity

An industry-supported non-profit consortium of leading AI companies dedicated to advancing frontier AI safety and security through best practices, research funding, and information sharing.

Led by?
Endorsed by-

AIUC

Team?
OrgCompanyStandardsSecurity

The AI Underwriting Company: certifies and insures AI agents via technical standards, audits, and insurance.

Led byRajiv Dattani, and others
Endorsed by-

Eigenism

Team?
OrgResearchAlignment Theory

AI-safety ethics project (Dan Hendrycks / William MacAskill) proposing an identity-based framework for a human-AI future.

Led by?
Endorsed by-

AI Evaluator Forum

Team?
OrgStandardsNetworkEvals

Consortium of independent AI-evaluation organizations developing shared standards (AEF-1) for third-party AI evals.

Led byConrad Stosz
Endorsed by-

CRUX

Team?
OrgResearchEvals

Collaboration of researchers running open-world, real-world evaluations of frontier AI capabilities.

Led byAndrew Schwartz, and others
Endorsed by

Fathom

Team?
OrgAdvocacyGovernanceThink Tank

Independent AI-policy nonprofit building Independent Verification Organizations (IVOs) for AI governance.

Led byAlexis Sacasas, and others
Endorsed by-

Effective Institutions Project

Team7
OrgResearchGovernanceFunder

A global working group that seeks out and incubates high-impact strategies to improve institutional decision-making, with a primary focus on AI governance and existential risk reduction.

Led byElla McIntosh, and others
Endorsed by

Centre for Enabling EA Learning & Research

Team2
OrgEATrainingIncubator

CEEALAR (formerly the EA Hotel) is a residential fellowship in Blackpool, UK that provides free or subsidized accommodation, meals, and stipends to individuals working on effective altruism projects, with a focus on AI safety research.

Led byAttila Ujvari, and others
Endorsed by

Tarbell Center for AI Journalism

Team9
OrgNewsletterGovernanceComms

A nonprofit supporting journalism that helps society navigate the emergence of increasingly advanced AI, through fellowships, grants, and its own publication Transformer.

Led byCillian Crosson, and others
Endorsed by

Secure AI Project

Team7
OrgAdvocacyGovernanceThink Tank

A nonprofit that develops and advocates for pragmatic policies to reduce the risk of severe harm from advanced AI, promoting transparency, accountability, and safe development through state and federal legislation.

Led byHowie Lempel, and others
Endorsed by

Institute for Law & AI (LawAI)

Team30
OrgAdvocacyGovernanceThink Tank

An independent legal research think tank, now operating as the Institute for Law & AI, that conducts foundational research and advises governments on the legal and governance challenges posed by artificial intelligence.

Led byChristoph Winter, and others
Endorsed by

Center for Applied Rationality

Team8
OrgRationalityTrainingThink Tank

A nonprofit that runs immersive workshops teaching rationality techniques drawn from cognitive science, behavioral economics, and decision theory, with a focus on improving thinking for people working on high-impact problems including AI safety.

Led byAnna Salamon, and others
Endorsed by

Mox

Team5
OrgCommunityHubTechnical Safety

Mox is San Francisco's largest AI safety coworking and community space, providing workspace, events, and fellowships for researchers and organizations working on high-impact problems.

Led byAustin Chen, and others
Endorsed by

Epoch AI

Team21
OrgResearchForecastingResearch Lab

Epoch AI is a nonprofit research institute that tracks and forecasts the trajectory of artificial intelligence by analyzing trends in compute, data, algorithmic efficiency, and capabilities. It produces leading databases and quantitative models to help policymakers, researchers, and funders understand the pace and impact of AI progress.

Led byJaime Sevilla, and others
Endorsed by

Siliconversations

Team1
OrgMediaCommsX-Risk

Siliconversations is a YouTube channel that creates animated videos explaining AI safety risks and existential risk from advanced AI to general audiences. It is run by a former quantum scientist who became a full-time content creator.

Led byLiam
Endorsed by-

Non-Trivial

Team3
OrgTrainingX-Risk

Non-Trivial runs free online research fellowships for talented young people ages 14-20 to develop impactful projects on the world's most pressing problems. The program offers mentorship, scholarships up to $10,000, and a global peer community.

Led byAbdul Rehman, and others
Endorsed by

Luthien

Team2
OrgToolingControlResearch Lab

Luthien is a Seattle-based nonprofit building production-ready AI control infrastructure that assumes AI models may act adversarially and prevents misaligned systems from achieving harmful goals.

Led byScott Wofford
Endorsed by

Partnership on AI (PAI)

Team40
OrgStandardsGovernanceNetwork

Partnership on AI is a global multi-stakeholder nonprofit that brings together industry, civil society, and academia to address the social implications of AI and promote responsible development and deployment.

Led byFelecia Webb, and others
Endorsed by-

Metaculus

Team28
OrgResearchForecastingPlatform

An online forecasting platform and aggregation engine that harnesses collective intelligence to produce calibrated predictions on questions of global importance, including AI timelines, biosecurity, nuclear risk, and climate change.

Led byDeger Turan, and others
Endorsed by