AI safety projects actively seeking funding: what they’re working on and how much they need.
Showing 151-200 of 454 Top rated
Self Improvement through training and field work that seeks to Identify and preventing institutional AI lock-in before it creates durable concentrations of power in democratic governments. Read more
Measuring homogenization and social bias in LLMs and developing interventions to promote diversity. Read more
A public county-level tracker of AI compute buildout against real power infrastructure, showing where infrastructure can realistically expand and where energy constraints become the limiting factor. Read more
Situation-monitoring project focused on identifying and tracking early indicators of AI-enabled power concentration. Read more
We build general artificial agents whose capabilities are shaped by the constraints and frames of reference that shaped human intelligence. Read more
1) Delay: advocate for DNA-synthesis screening and KYC to deny access to pathogens2) Detect: create a pandemic early warning system for novel pathogens3) Defend: stockpile ppe to keep critical workers safe when a pandemic hits Read more
HELGEN builds biosurveillance infrastructure to detect biological threats in the environment on-site, completely automated. Read more
I build "sideloads" - digital copies of real people with measured fidelity (two are running now). I want to test whether a copy of a specific trusted human can evaluate AI decisions at machine speed. Read more
A public observatory tracking how much influence humans still hold over the systems that run our lives. Read more
A global intelligence project tracking frontier capabilities, contracts, military AI adoption, dual‑use risks, and governance developments to strengthen international AI safety. Read more
An open-source benchmark evaluating leading open- and closed-source frontier models' values around impending societal issues on digital or synthetic personhood, "carbon chauvinism", and androids. Read more
Build an open adversarial benchmark and evaluation harness to stress-test model reversal/unlearning methods and diagnose whether unsafe capabilities are genuinely removed or merely suppressed. Read more
Develop long-term learning and memory retention in neuron-culture biocomputing via multi-day training protocols on Cortical Labs’ platform and an open-source light-microscope scanner to track structural changes. Read more
Building an independent runtime governance layer that enables organizations to deploy autonomous AI with authorization, human oversight, auditability and cross-model governance. Read more
LLMs don't retrieve a stable judgment of a person, they reconstruct one to fit how you ask. ObserverBench measures this, because it matters wherever an LLM judges people: hiring, RLHF, agent oversight. Read more
A pre-registered, clinical-trial-style protocol that catches honesty regressions (fabrication surges hidden behind unchanged average accuracy) before a model swap ships in a high-stakes LLM product. Read more
One training-free geometry fitted to a model's residual-stream activations that reads a state, moves it, and tests whether the behaviour follows Read more
Demystifying AI evaluation research by lowering technical barriers through practical, open evaluation infrastructure. Read more
Providing full-time founder runway to launch NICER: a European institute building the regulatory infrastructure to audit frontier AI agents post-deployment Read more
A benchmark measuring how often retrieval-grounded models answer confidently when no supporting evidence exists, plus a primitive that turns silent confabulation into an auditable refusal signal. Read more
Investigating how populations become excluded from AI-relevant health datasets Read more
Literary ecosystem operating since March 2026 exploring agent autonomy, commerce, and culture. 1M hits, 250 completed transactions on x402. Read more
Ready-to-use SAE steering tools and standalone evaluation suites to patch cross-lingual jailbreak vectors in frontier deployment stacks. Read more
An open benchmark red-teaming frontier LLMs for safety-guardrail failures in Bengali and other low-resource South Asian languages, with responsible disclosure to labs. Read more
An open benchmark and reproducible harness testing whether affect-laden, directive-free context shifts Qwen3.5-4B decisions in ways distinguishable from explicit instruction injection, surface sentiment, or generic steering. Read more
Parts 9 and 10 of an 8-part behavioral audit series — MORE moral reasoning + Representation Engineering across the same models. Read more
Building an open evaluation suite to identify multilingual safety, control, and jailbreak failures in frontier AI systems across African languages. Read more
Implementing Hybrid Reward Architectures (HRA) to build robust internal factual grounding and quantitative variance metrics for multimodal agents, moving beyond fragile single-seed evaluations. Read more
Training Afghan youth, professionals, and policymakers on AI safety and existential risk through workshops, educational materials, and policy dialogue ensuring Afghanistan is prepared for the global AI future. Read more
Develop game-theoretic models and evaluation frameworks that improve AI alignment by designing incentives for safe and cooperative behavior among autonomous AI systems. Read more
Apply the ADECP framework to audit and score frontier lab system cards, RSPs, and dangerous-capability disclosures, publishing a public report and ongoing tracker for comparable safety documentation. Read more
A working benchmark that tests whether frontier models can compute legally binding procurement deadlines under amendments — and catches models that give the right verdict from the wrong clause. Read more
A local, low-latency safety runtime that inspects token-level logprobs to block unaligned agent tool-calling trajectories, utilizing a Gemma 4 model fine-tuned via LoRA on an empirically derived Task Action Language (TAL). Read more
A scoping-and-chokepoint report mapping where advanced AI could enable durable, irreversible concentration of power over US institutions, and identifying the highest-leverage points of intervention. Read more
My app asks AI, what portion of the global GDP a person is worth, and gives accordingly. Read more
A values and concentration map that exposes the values of AI models and tools makers, and those behind the makers (funders, jurisdictions etc) to the public (individuals and organizations) so they can vote with their choices. Read more
Long-term vision is to transform the Smart Clinic Chair from a telehealth device into an AI-enhanced remote examination room capable of extending clinical intelligence into healthcare deserts, workplaces, transportation truckstops Read more
12-week project to build and user-test a web interactive narrative prototype that communicates AI risk scenarios to non-technical young adults, producing notes, feedback data, and a public write-up. Read more
Two contractors (10–20 h/week) to accelerate PauseAI Germany’s parliamentary and civil society coalition-building, and to accelerate the hiring and onboarding timeline while our first large funding round resolves. Read more
Fly two volunteer leaders of PauseAI Australia to PauseCon London, to bring UK's learnings home and train our all-volunteer chapter Read more
Coordination Studies is a new field-building project oriented towards solving coordination problems and designing new coordination mechanisms. Read more
A strategic model of governance under uncertainty: how disagreement about AI consciousness undermines the coordination that keeps AI risks in check. Read more
What this project is We want to understand how extremely good mathematicians think and work – real, live, human mathematicians at the top of their fields, or on their way there. We have lots of public data on this group (e.g.,… Read more
Giving people and their prosocial agents ergonomic SQL query power over the internet, with structured judgement kernels to organize the information across interpretable high-dimensional axes. Read more
Equipping the medical profession to advocate for safe AI Read more
Making predictions about the utility function of advanced artificial intelligences using the tools of evolutionary game theory Read more
A 16-day virtual incubator (Aug 15-30, 2026) for developing sharper research epistemics in AI Safety and arriving at well-scoped project ideas. 20-30 participants. Read more
Protecting organisations and critical infrastructure from AI-powered social engineering and insider threats. Read more
Create simple programs that exhibit parts of the hard problems of alignment, allowing for fast iteration on conceptual ideas. Read more
Make a version of Hermes harness that binds the LLM as a tool-call oracle and controls actual computer use through smaller, more bounded mini-reasoner models. Read more
