| Name | Type | Tags | Endorsed | Team | Raising $ |
|---|
Showing 1-50 of 474·Sorted by endorsements
| Name | Type | Tags | Endorsed | Team | Raising $ |
|---|
| Project | Network |     +8 |
| - |
| Project | Field-Building |  +9 | - |
| Project | Network | +8 | - |
| Project | Platform | +10 | - |
| Project | Incubator | +6 | - |
| Project | Legal | +6 | - |
| Project | Research | +3 | - |
| Project | Research | +3 | - |
| Project | Individual | +4 | - |
| Project | Hub | +4 | - |
| Project | Research | +2 | - |
| Project | Training | +3 | - |
| Project | Network | +5 | - |
| Project | Conference | +3 | - |
| Project | Individual | +2 | - |
| Project | Individual | +2 | - |
| Project | Individual | +2 | - |
| Project | Network | +4 | - |
| Project | Comms | +5 | - |
| Project | Network | +4 | - |
| Project | Training |  +2 | - |
| Project | Platform | +1 | - |
| Project | Newsletter | | - |
| Project | Company | | - |
| Project | Research | +1 | - |
| Project | Research Lab | +3 | - |
| Project | Research | +4 | - |
| Project | Research | +3 | - |
| Project | Platform | +2 | - |
| Project | Media | +2 | - |
| Project | Individual | +3 | - |
| Project | Conference | +2 | - |
| Project | Individual | +1 | - |
| Project | Research | | - |
| Project | Individual | | - |
| Project | Conference | +1 | - |
| Project | Individual | | - |
| Project | Tooling | +1 | - |
| Project | Individual | +1 | - |
| Project | Research | +1 | - |
| Project | Network | +3 | - |
| Project | Individual | +2 | - |
| Project | Individual | | - |
| Project | Research Lab | +1 | - |
| Project | Tooling | +3 | - |
| Project | Individual | | - |
| Project | Network | +2 | - |
| Project | Network | +2 | - |
| Project | Research | +3 | - |
| Project | Research | +1 | - |
The Argentinian AI Safety community (BAISH, baish.com.ar) is the largest in Latin-America. Support BAISH's growth, by providing funding for paying salaries for six months to 2-3 FTEs.
+8
We help people reduce x-risk from misaligned AI with scalable online courses and ongoing AI guidance.
+9As Hong Kong’s first dedicated AI safety organisation, AI Safety Hong Kong develops local capacity through research, training, convening, and policy engagement.
+8The greatest risk of AI is to humans: displacement, disengagement, fear, isolation and desperation. The Purpose Network proves that community, knowledge & hands-on pro bono work can rebuild purpose - the antidote to this dystopia.
Funding compute/API costs for Incubator projects that build nonhuman welfare consideration into AI safety work
+6Submitting FOI requests across EU Member States to reveal how governments understand and address advanced AI risks, creating evidence for accountability, advocacy and stronger policy.
+6Research to scale midtraining for compassion using self-fulfilling alignment so that it robustly survives subsequent fine-tuning.
+3Measuring whether CoT monitoring fails when an influence reaches an agent through a tool return rather than the user message. We aim to extend our experiment from the 10 initial open-weight models to the larger open-weight models
+3Developing a practical evaluation framework to identify governance failures in frontier AI systems during elections, strengthening democratic legitimacy and the institutional capacity needed to reduce catastrophic risks from AI.
+4The Sydney AI Safety Space is a co-working hub in Sydney, Australia, offering free office space for people working in the field of AI safety.
+4Build low-overhead and robust zero-knowledge protocols for verifying properties of frontier AI training, starting with FLOP counts
+2
SF based accelerator for communicators educating the public about the transformational impacts of AI.
+3AI Safety Quest will scale its free Navigation Calls program from 150 to 750 annual coaching calls by recruiting more volunteer coaches, improving scheduling/software systems, and expanding marketing to guide newcomers into AI…
AI safety for builder hackathon in India - to build tools, products, etc. (culminating into a fellowship)
+3A policy memo, co-authored with the Institute for Public Policy Research, resolving the open technical, economic, and legal questions blocking real-world implementation of token taxes.
+2An ICML-published interpretability technique that can elicit latent knowledge from red teamed model organisms, looking for funding to clear any remaining barriers for adoption at frontier labs.
+2Monthly English-language analysis of China's algorithm-filing registry and binding AI security standards, read in the original Chinese, for the people calibrating frontier AI rules in the West.
+2We are the UK's civic movement dedicated to averting the risks of superhuman artificial intelligence.
+4ARC aims to strengthen coordination and build the communication layer of the AI safety field through frameworks, trainings, practical content, communication tools, and field activation.
Two contractors (10–20 h/week) to accelerate PauseAI Germany’s parliamentary and civil society coalition-building, and to accelerate the hiring and onboarding timeline while our first large funding round resolves.
Providing GPU credits and instructional support for 40 participants completing the ARENA AI Safety curriculum through Black in AI Safety and Ethics (BASE)
+2A regularly updated catalogue of AI safety techniques, and of what is known - and what is not known - about their effectiveness and deployment status
+1A publication about the institutions we need for powerful AI.
Deploying customer screening software at DNA synthesis providers to reduce AI-enabled biothreats
Test whether offering a current AI model a deal can find misalignments it otherwise hides, and find the best way to present that deal.
+1Dean Ball says good AI governance needs democratic input in "what level of catastrophic risk are we willing to tolerate"; we provide that input, and predict the level is far below forecaster estimates, revealing a gap to close.
+3We train the same model on four different sets of texts, chosen in four different ways, and give every trained copy the same exam. Preregistered test: osf.io/hzuwc
How do you map your old concepts to new concepts when your model of the world gets updated? How would you translate concepts you care about to new ontology? I plan to adress this via extending "Condensation: Theory of Concepts" - Eisenstat, (2025)
Software to match people with shared AIS interests into teams that complete projects, increasing the odds that those beyond narrow talent pipelines upskill, develop credibility, and turn their ideas into output.
+2Doom Debates is a modern "infotainment" show that functions as a mainstream-accessible forum for top thinkers to have a high-quality conversation & debate about AI extinction risk.
+2A six-month effort to build and pilot an online course that equips cross-sector AI professionals and other stakeholders with a deep understanding of military AI technologies and the limits and opportunities for oversight.
Funding for venue and catering for the first full-day convening, where Europe's AI safety institutions and researchers gather and coordinate on what comes next
+2An open, cheap method that detects when an inoculation prompt inoculates against off-target traits, so labs and developers can catch undesired trait/persona changes before deployment.
+1Dataset curation, synthetic data generation, and LLM training, fine-tuning, and evals to distinguish and quantify the effects of data improvements, separately from progress in algorithms and architectures, on AI capabilities.
Fund demonstrated/rigorous quantitative researcher (already run reproduction/audit pipelines on published economics) for 6-month AI safety transition, shipping concrete safety eval audits and positioning for top fellowships.
Running a conference in DC for promising AI safety university students interested in policy to network, learn, and be exposed to the DC ecosystem.
+1A hand-verified library of AI-safety theorem statements in Lean 4 with AI-generated proofs, building the skills to trust AI formalization.
An open-source benchmark and defense toolkit for testing whether corrupted biological databases can hijack retrieval-augmented AI agents used in genomics, protein science, and single-cell analysis.
+1A practical playbook that helps AI safety advocates and policy professionals communicate effectively with the U.S. government during the short window of opportunity that may open during an AI-related crisis.
+1A benchmark (and accompanying site) that allows AIs to verify their actions will have real-world impacts and tests how their preferences and moral "character" evolve under deployment versus evaluation-like environments.
+1Fly two volunteer leaders of PauseAI Australia to PauseCon London, to bring UK's learnings home and train our all-volunteer chapter
Detailed models of how AI could allow a small set of actors to gain a decisive strategic advantage over the rest of the world: concrete pathways, required capabilities, quantified likelihoods, and the defenses that bind them.
+2This project builds cognitively-aligned preference learning that interprets feedback the way human actually decide (e.g., regret minimization) rather than as a reward to maximize.
Empirical research to create conditions for cooperative strategies to dominate adversarial ones among a broad swath of near-future AIs - in the narrow window this work is still possible.
+1A merge gate that trusts AI-generated code by what's verifiable about it: automated formal checks plus anonymous proof of qualified human review, keeping human oversight viable as AI writes more of our code.
A benchmark to empirically investigate: (i) the ability of models to tacitly coordinate with copies of themselves and (ii) which decision theory best explains the way that models evaluate the consequences of their actions.
Sapiens First organizes voters to fight against concentration of power and for AI safety
+2Support the growth of the AI Safety community in Mexico through field-building events, Spanish-language courses, and advocacy efforts.
+2Replicating, stress-testing, and extending the experiments from Anthropic's blog post "Teaching Claude Why."
Research strategic resilience via a Strategic Human Capacity Reserve, mapping threats to critical human skills and designing policy to preserve them through AI transition, producing academic papers.
+1
