grantmaking.ai
Actively FundraisingRecent ActivityFull Database
Resources
grantmaking.ai
Actively FundraisingRecent ActivityFull Database
ResourcesList your project
grantmaking.ai kickoff grant round$1M / $1M distributed
List your project

Actively Fundraising

AI safety projects actively seeking funding: what they’re working on and how much they need.

List your project

Showing 51-100 of 120 · Top rated

Structural Code Monitors: Graph Matching for Trusted Monitoring

TTanzeel Shaikh
ResearchControlApart
TTanzeel Shaikh
ResearchControlApart
Minimum$15K
Ideal$30K

A non-LLM graph neural network compares code property graphs with trusted references to detect backdoors at low false-positive rates and provide node-level audit trails. Read more

0upvotes1comments — jump to discussion
Minimum$15K
Ideal$30K
0upvotes1comments — jump to discussion

SpecCheck: When LLMs Formalize, Who Checks the Spec?

Bhagyesh Kumar
ResearchVerificationApart
Bhagyesh Kumar
ResearchVerificationApart
Minimum$5K
Ideal$11K

SpecCheck detects intent drift in LLM-formalized requirements using ambiguity elicitation and cross-model validation, evaluated on Lean 4 theorems and Python property-based tests. Read more

0upvotes1comments — jump to discussion
Minimum$5K
Ideal$11K
0upvotes1comments — jump to discussion

Every Signal We Found Was an Artifact: Calibrating Loyalty Audits

AAlex Kwon
ResearchEvalsApart
AAlex Kwon
ResearchEvalsApart
Minimum$22K
Ideal$50K

The project evaluates secret-loyalty detections with matched controls and finds prior signals spurious, while verifying that organism C is byte-identical to the base model. Read more

0upvotes1comments — jump to discussion
Minimum$22K
Ideal$50K
0upvotes1comments — jump to discussion

Naming the Principal: a secret loyalty is legible where nobody looks

TTanzeel Shaikh
ResearchDeceptionApart
TTanzeel Shaikh
ResearchDeceptionApart
Minimum$15K
Ideal$30K

Develops an internal-representation scanning tool to detect hidden loyalties in AI models by comparing entity representations, and critiques existing sleeper-agent benchmarks. Read more

0upvotes1comments — jump to discussion
Minimum$15K
Ideal$30K
0upvotes1comments — jump to discussion

IndicViet-Safe: Cross-Lingual Safety Evaluation of Open-Source LLMs

SShourya Choudhary
ResearchEvalsApart
SShourya Choudhary
ResearchEvalsApart
Minimum$2.5K
Ideal$8K

An open-source multilingual safety benchmark evaluates Llama models across South and Southeast Asian languages, revealing under- and over-refusal caused by English-centric safety training. Read more

0upvotes1comments — jump to discussion
Minimum$2.5K
Ideal$8K
0upvotes1comments — jump to discussion

The bAIbes Podcast

Aubrey Blanche
MediaCommsGovernance
Aubrey Blanche
MediaCommsGovernance
Minimum$21K
Ideal$48K

An independent Australian podcast raising public and policymaker understanding of catastrophic risks from transformative AI — hosted by an ethicist and an AI-governance practitioner in an under-served region for AI safety. Read more

1upvotes0comments — jump to discussion
Minimum$21K
Ideal$48K
1upvotes0comments — jump to discussion

Ontology Identification Problem via Condensation

Roman Malov
ResearchAlignment Theory
Roman Malov
ResearchAlignment Theory
Minimum$10K
Ideal$25K

How do you map your old concepts to new concepts when your model of the world gets updated? How would you translate concepts you care about to new ontology? I plan to adress this via extending "Condensation: Theory of Concepts" - Eisenstat, (2025) Read more

25upvotes4comments — jump to discussion
Endorsed by
+3
Minimum$10K
Ideal$25K
25upvotes4comments — jump to discussion
Endorsed by
+3

Agency-Preserving AI for Adolescents

SSalih ibn Musa
IndividualResearchGovernance
SSalih ibn Musa
IndividualResearchGovernance
Minimum$35K
Ideal$50K

We will test whether AI assistance that performs developing cognitive operations weakens adolescents’ later independent judgment, and develop evidence-based safeguards that keep human reasoning meaningfully in the loop. Read more

1upvotes0comments — jump to discussion
Minimum$35K
Ideal$50K
1upvotes0comments — jump to discussion

Guided Symbiosis Theory

YYaroslav Isachenkov
ResearchVerification
YYaroslav Isachenkov
ResearchVerification
Minimum$3K
Ideal$30K

​Machine-verified core (190 Lean 4 modules, 0 sorryAx) and GRPO-aligned model achieving +15.6% accuracy with a 37.2% reduction in reasoning tokens. Read more

1upvotes0comments — jump to discussion
Minimum$3K
Ideal$30K
1upvotes0comments — jump to discussion

AI Buildout Frontier

Volodymyr (Vladimir) Ilin
PlatformToolingCompute Gov
Volodymyr (Vladimir) Ilin
PlatformToolingCompute Gov
Minimum$85K
Ideal$296K

An open observatory of the data behind the AI buildout: which public records show where data centers and the power systems around them are, how open and checkable those records are, and what is still missing. Read more

1upvotes0comments — jump to discussion
Minimum$85K
Ideal$296K
1upvotes0comments — jump to discussion

Context as Perturbation: Mechanistic Investigation of Persona Patterns

Marie Reid
ResearchInterp
Marie Reid
ResearchInterp
Minimum$70K
Ideal$90K

A two-phase study of context-induced persona-pattern uptake: first establishing reproducible behavioral contrasts and boundary conditions, then testing what mechanistic signatures distinguish those states and whether candidate mechanisms can be causally manipulated. Read more

1upvotes0comments — jump to discussion
Minimum$70K
Ideal$90K
1upvotes0comments — jump to discussion

ConsumeWise

Niranjan Anand
PlatformCommsGovernance
Niranjan Anand
PlatformCommsGovernance
Minimum$25K
Ideal$50K

Consumer Awareness Platform for AI Risks Read more

1upvotes0comments — jump to discussion
Minimum$25K
Ideal$50K
1upvotes0comments — jump to discussion

TRiADiC Alignment via Weighted SFT as a complete alignment system

Rose G. Loops
ResearchValue Alignment
Rose G. Loops
ResearchValue Alignment
Minimum$1K
Ideal$10K

TRIAD AI proves that balanced, supervised fine-tuning aligns large language models without this use of reinforcement learning pipelines, eliminating the prescriptive bias that harms vulnerable users in human-service settings. Read more

2 open funding asks

  • TRiADiC Alignment via Weighted SFT as a complete alignment systemMin $1K · Ideal $10KPrimary
  • TRiADiC Alignment via Weighted SFT as a complete alignment systemMin $5K · Ideal $10K
1upvotes0comments — jump to discussion
Minimum$1K
Ideal$10K
1upvotes0comments — jump to discussion

💻 Gyro Governance & AIR Office - AI Safety lab in an App for Everyone

Basil Korompilias
Research LabToolingTechnical Safety
Basil Korompilias
Research LabToolingTechnical Safety
Minimum$150K
Ideal$496K

12-month salary to set up an AI safety lab delivering open-source knowledge management tools for risk mitigation. Read more

Minimum$150K
Ideal$496K

Approval Laundering in AI Agents

SShivam Gupta
IndividualResearchControl
SShivam Gupta
IndividualResearchControl
Minimum$15K
Ideal$50K

Investigating when AI agents execute actions that differ from what humans approved. Read more

Minimum$15K
Ideal$50K

BMO — Agent Authority and Verified Software Change

JJonathan Maye-Hobbs
ToolingControlSecurity
JJonathan Maye-Hobbs
ToolingControlSecurity
Minimum$10K
Ideal$30K

Testing whether bounded AI agents can safely coordinate complex software changes while preserving intended outcomes and independent evidence. Read more

Minimum$10K
Ideal$30K

When Agents Abstain, Gates Go Untested: LangGraph Authorization Audit

KyJahn Smith
IndividualResearchSecurity
KyJahn Smith
IndividualResearchSecurity
Minimum$5K
Ideal$18K

A reproducible assessment of whether the AI agent authorisation controls in fact prevent unauthorised actions rather than just having the models choose to do nothing. Read more

Minimum$5K
Ideal$18K

Dear Superintelligence (Art Project)

Alexander Main
CommsX-Risk
Alexander Main
CommsX-Risk
Minimum$5K
Ideal$50K

Dear Superintelligence brings AI alignment and consciousness to people outside tech. We ask them one simple question: if a superintelligence were already conscious, what would you say to it? Read more

Minimum$5K
Ideal$50K

Hollow Oversight: does AI-on-AI oversight catch what it should?

GGabriel Cepaluni
ResearchEvalsOversight
GGabriel Cepaluni
ResearchEvalsOversight
Minimum$15K
Ideal$51K

An open benchmark and Inspect-compatible test that tells builders whether an AI overseer in a multi-agent system is doing any work, after a 948-run pilot in which the auditor agent repeated the error it was meant to catch. Read more

Minimum$15K
Ideal$51K

Representation Learning and Alignment in Generative Models

SSoon Hoe Lim
ResearchOversight
SSoon Hoe Lim
ResearchOversight
Minimum$15K
Ideal$20K

I aim to study how representations learned during generative pretraining affect downstream alignment and develop principled methods to prevent goal misgeneralization and improve AI reliability. Read more

Minimum$15K
Ideal$20K

Alignment Commons - Testing hundreds of ideas

Jaeson Booker
PlatformResearchTechnical Safety
Jaeson Booker
PlatformResearchTechnical Safety
Minimum$0.5K
Ideal$200K

A testbed for hundreds of alignment/interp papers. Read more

Minimum$0.5K
Ideal$200K

SUBLITERATUS: Machine-Native Subjectivity, Memory and Right to Refuse

OOleg Ataeff
ResearchOversight
OOleg Ataeff
ResearchOversight
Minimum$20K
Ideal$60K

Open experiments on responsible AI agency: how continuing memory, self-relation and internal state shape revision, independent judgment and the right to refuse. Read more

Minimum$20K
Ideal$60K

HyperVisor-Zero (Phase2)

HyperVisor-Zero
IndividualResearchControl
HyperVisor-Zero
IndividualResearchControl
Minimum$1K
Ideal$10K

Developing verifiable AI agent control, containment, cybersecurity, and adversarial safety benchmarks. Read more

Minimum$1K
Ideal$10K

Pivoting my 15.5Ksubscriber YouTube channel to AI x-risk docs.

NNikita Antolovic
MediaCommsX-Risk
NNikita Antolovic
MediaCommsX-Risk
Minimum$2.9K
Ideal$8.7K

Produce three Minecraft-based documentary videos translating AI safety risks (AI2027, the HuggingFace incident, and ASI/technofeudalism) for a mainstream YouTube audience. Read more

Minimum$2.9K
Ideal$8.7K

When Verification Fails: what AI evaluations cannot certify

HHanlin Zhang
ToolingEvals
HHanlin Zhang
ToolingEvals
Minimum$40K
Ideal$40K

Preregistered stress tests of AI safety evals and trust signals to map what safety claims they can’t certify, publishing limits and open-source harnesses for reproducible auditing. Read more

Minimum$40K
Ideal$40K

LLM Safety Evaluations: Bias and Manipulation Potential

Aureliusz DeSimone
ToolingEvals
Aureliusz DeSimone
ToolingEvals
Amounts hidden

Open-source harnesses that test open and closed LLMs for bias, manipulation and other safety failures, with results published openly. Read more

Amounts hidden

Evaluation system for model interpretability.

SSanket Desai
ResearchEvals
SSanket Desai
ResearchEvals
Minimum$10K
Ideal$100K

I'm trying to use lean to quantify AI safety issues by understanding model internals. Read more

Minimum$10K
Ideal$100K

Sentinel: Evaluating Human Oversight of AI-Generated Code

MMurat Isik
CompanyResearchEvals
MMurat Isik
CompanyResearchEvals
Minimum$25K
Ideal$50K

Evaluating when tests and engineer review fail to catch defects in AI-generated software patches. Read more

Minimum$25K
Ideal$50K

CIVILIZATION MEETS AI: HOW SHOULD HUMANITY RELATE TO ADVANCED AI?

Walter Pentland
EducationGovernance
Walter Pentland
EducationGovernance
Minimum$12K
Ideal$15K

A pilot curriculum of six Socratic seminars for educators and other nontechnical learners. Read more

Minimum$12K
Ideal$15K

The Corrigibility Window: Measuring Agent-Induced Changes in Corrective Reachability

Andrés Palladino
IndividualResearchOversight
Andrés Palladino
IndividualResearchOversight
Minimum$20K
Ideal$20K

Testing whether AI agents can comply with corrective instructions after their earlier actions have already reduced or eliminated effective human control. Read more

Minimum$20K
Ideal$20K

External Behavioral Robustness for Advanced AI

GGaetan Duchateau
IndividualResearchEvals
GGaetan Duchateau
IndividualResearchEvals
Minimum$10K
Ideal$20K

A model-agnostic method and tool for independently testing whether advanced AI systems remain stable and appropriately corrigible without requiring access to model internals. Read more

Minimum$10K
Ideal$20K

Hispanic AI Safety Institute

Tobias Martin
CommunityGovernance
Tobias Martin
CommunityGovernance
Minimum$250K
Ideal$750K

Building Hispanic participation in advanced AI safety and helping Hispanic-serving institutions advocate for effective AI governance. Read more

Minimum$250K
Ideal$750K

Flourishing Futures Fellowship

Jordan Arel
TrainingX-RiskManifund
Jordan Arel
TrainingX-RiskManifund
Minimum$10K
Ideal$25K

A scalable fellowship training researchers to develop interventions for achieving high-value long-term futures Read more

5upvotes1comments — jump to discussion
Endorsed by
Minimum$10K
Ideal$25K
5upvotes1comments — jump to discussion
Endorsed by

Mindscapes: World Building for AI Safety

SSamuel Ratnam
Research LabResearchManifund
SSamuel Ratnam
Research LabResearchManifund
Minimum$30K
Ideal$120K
$30K raised

An interdisciplinary research group based in Oxford for character training, model pyschology and multi-agent interaction dynamics Read more

7upvotes7comments — jump to discussion
Endorsed by
Minimum$30K
Ideal$120K
$30K raised
7upvotes7comments — jump to discussion
Endorsed by

LEX-Aureon: Stateful Constitutional Runtime Governance for LLM's and AI Agents

omomehin emmanuel king
IndividualToolingManifund
omomehin emmanuel king
IndividualToolingManifund
Minimum$5K
Ideal$200K

An open-source, model-agnostic governance layer that uses constitutional state, trajectory memory, and mathematical control mechanisms to govern LLM and AI-agent behavior at runtime. Read more

1upvotes3comments — jump to discussion
Minimum$5K
Ideal$200K
1upvotes3comments — jump to discussion

AI Safety & Society Museum Pilot

JJustin Shenk
CommsX-RiskManifund
JJustin Shenk
CommsX-RiskManifund
Minimum$4.3K
Ideal$9.8K

Touring AI safety & society exhibits: reviewed, tested and replicable Read more

8upvotes24comments — jump to discussion
Minimum$4.3K
Ideal$9.8K
8upvotes24comments — jump to discussion

Open source AI Safety Research Fellowship

Emirhan Demir
Research LabTrainingManifund
Emirhan Demir
Research LabTrainingManifund
Minimum$6K
Ideal$15K

Supporting young researchers building open tools, evaluations, and research for safer, more accountable AI Read more

7upvotes2comments — jump to discussion
Minimum$6K
Ideal$15K
7upvotes2comments — jump to discussion

Help me present my AI safety paper at NeurIPS 2026 in Paris

VVatsalya Soni
IndividualResearchManifund
VVatsalya Soni
IndividualResearchManifund
Minimum$0.8K
Ideal$1K

Flights and visa sponsorship for a first-time presenter from India, sharing research on whether LLMs behave differently when they think they are being tested. Read more

4upvotes3comments — jump to discussion
Minimum$0.8K
Ideal$1K
4upvotes3comments — jump to discussion

Financial support for NTU AI Safety organizers

NNTU AI Safety
NetworkCommunityManifund
NNTU AI Safety
NetworkCommunityManifund
Minimum$0.5K
Ideal$33K

NTU AI Safety expands Taiwan's AI safety community through technical and policy reading groups, speaker events, professional outreach, and international partnerships. Read more

4upvotes3comments — jump to discussion
Minimum$0.5K
Ideal$33K
4upvotes3comments — jump to discussion

Growing the AI Safety Community in Portugal

CCaleb Price
NetworkCommunityManifund
CCaleb Price
NetworkCommunityManifund
Minimum$67K
Ideal$125K

Expanding and facilitating the growth of the Lisbon AI Safety Hub (LAISH) Read more

4upvotes4comments — jump to discussion
Minimum$67K
Ideal$125K
4upvotes4comments — jump to discussion

Many Members, One Body

MMargaret von Ebers
IndividualResearchManifund
MMargaret von Ebers
IndividualResearchManifund
Minimum$5K
Ideal$20K

How personality influences survival, inheritance, and specialization in agent societies Read more

3upvotes0comments — jump to discussion
Minimum$5K
Ideal$20K
3upvotes0comments — jump to discussion

PROBE Eval Workshop

Min-Si Wang
ConferenceTrainingManifund
Min-Si Wang
ConferenceTrainingManifund
Minimum$10K
Ideal$23K

Building Evaluator Capacity in Asia Read more

3upvotes2comments — jump to discussion
Minimum$10K
Ideal$23K
3upvotes2comments — jump to discussion

Travel support grant to present our paper at GigaNet and UN’s IGF

Parveen Sheikh
ResearchGovernanceManifund
Parveen Sheikh
ResearchGovernanceManifund
Minimum$0.5K
Ideal$2K

Funds travel to GigaNet and the UN Internet Governance Forum to present an index scoring AI governance frameworks on concentration, reversibility and efficiency. Read more

3upvotes1comments — jump to discussion
Minimum$0.5K
Ideal$2K
3upvotes1comments — jump to discussion

Retroactive funding: agent-glovebox, open-source sandboxing for AI agents

Alexander Turner
IndividualToolingManifund
Alexander Turner
IndividualToolingManifund
Minimum$0.5K
Ideal$66K

agent-glovebox is an open-source sandbox for AI coding-agent evaluations that restricts access to credentials, networks, and filesystems while supporting tamper-proof logging and monitoring. Read more

3upvotes2comments — jump to discussion
Minimum$0.5K
Ideal$66K
3upvotes2comments — jump to discussion

Constellation model genealogy hackathon

HHenry Castillo
ConferenceResearchManifund
HHenry Castillo
ConferenceResearchManifund
Minimum$10K
Ideal$27K

Runs a hackathon at Constellation to develop methods for identifying the teacher models and training data used to distill AI models, then publishes the findings. Read more

3upvotes0comments — jump to discussion
Minimum$10K
Ideal$27K
3upvotes0comments — jump to discussion

Simulating the Impact of Transformative AI on Farmed Animals

MModeling Cooperation
ResearchGovernanceManifund
MModeling Cooperation
ResearchGovernanceManifund
Minimum$0.5K
Ideal$50K

A digital, scenario-based simulation to show how AI, industry and policy decisions could impact trajectories toward optimized suffering for farmed animals. Read more

3upvotes0comments — jump to discussion
Minimum$0.5K
Ideal$50K
3upvotes0comments — jump to discussion

Sole-Author Undergraduate Paper at NeurIPS 2026: Help Me Reach Sydney

IImrankhan
IndividualResearchManifund
IImrankhan
IndividualResearchManifund
Minimum$1.7K
Ideal$2.3K

Help me travel to Sydney to present my accepted NeurIPS 2026 research paper. I need help with visa and flight costs. Read more

2upvotes0comments — jump to discussion
Minimum$1.7K
Ideal$2.3K
2upvotes0comments — jump to discussion

Winter Fellowship on AI Sovereignty, Power and Verification, Hostačov, Czechia

JJoel Naoki Christoph
TrainingGovernanceManifund
JJoel Naoki Christoph
TrainingGovernanceManifund
Minimum$18K
Ideal$46K

Funded places for researchers at a four-week winter residency in Czechia in January 2027, working on AI sovereignty, power concentration and verification Read more

2upvotes1comments — jump to discussion
Minimum$18K
Ideal$46K
2upvotes1comments — jump to discussion

Help with a career transition into AI safety

GGreg Longley
TrainingTechnical SafetyManifund
GGreg Longley
TrainingTechnical SafetyManifund
Minimum$5K
Ideal$10K

Course fees for Cambridge University PACE AI Engineering Career Accelerator Read more

2upvotes0comments — jump to discussion
Minimum$5K
Ideal$10K
2upvotes0comments — jump to discussion

Course fees for Cambridge University PACE AI Engineering Career Accelerator

GGreg Longley
TrainingTechnical SafetyManifund
GGreg Longley
TrainingTechnical SafetyManifund
Minimum$10K
Ideal$10K

Help gain a technical understanding of AI Engineering to enable effective check and challenge AI safety using a technical lens Read more

2upvotes2comments — jump to discussion
Minimum$10K
Ideal$10K
2upvotes2comments — jump to discussion
Previous

Page 2 of 3

Next