The latest comments and grant applications on grantmaking.ai.
The latest comments and grant applications on grantmaking.ai.
A scoping-and-chokepoint report mapping where advanced AI could enable durable, irreversible concentration of power over US institutions, and identifying the highest-leverage points of intervention.
I endorse in principle opportunities to strengthen participation and inclusion in the global south - much of the AI safety focus is US, Europe / UK and China centred. I'm not familiar with your organisation, apart from what you've written here and what's on your website. For this reason, I'd give a qualified endorsement, subject to further enquiries:
I think it would be helpful to include your…
Hi Mark. Thanks a lot for the qualified endorsement, and for the further inquiries. Some responses follow below:
thank you for your quick response and this additional information - it gives a clearer picture of how you plan to run the fellowship this year and the budget allocation. Much appreciated.
Building resilience in nucleic acid screening systems against split orders by integrating assembly pipelines into screen systems and validating resilience through test sets
working on something similar :)
working on something similar :)
working on something similar :)
working on something similar to this! let's go!
working on something similar :) awesome!
I like this idea and I value approaches that provide evidence for informed policy decisions.
I think there's value in being able to compare the results from your earlier Australian research with a comparable US / UK survey - and perhaps a formalised survey methodology that could be utilised in other countries to help build out some less English speaking / Western findings.
I'm not…
An open-source benchmark evaluating leading open- and closed-source frontier models' values around impending societal issues on digital or synthetic personhood, "carbon chauvinism", and androids.
Noisify adds invisible adversarial noise to personal photos, making them resistant to AI-powered non-consensual image manipulation.
Build low-overhead and robust zero-knowledge protocols for verifying properties of frontier AI training, starting with FLOP counts
Ready-to-use SAE steering tools and standalone evaluation suites to patch cross-lingual jailbreak vectors in frontier deployment stacks.
Private comment. Only shown to approved funders and grant reviewers.
A pre-registered, clinical-trial-style protocol that catches honesty regressions (fabrication surges hidden behind unchanged average accuracy) before a model swap ships in a high-stakes LLM product.
Watched many episodes & loved them. Debates over podcast FTW.
A governance-first AI Architecture that reduces unsafe acceptances (false positives) alongside false rejection simultaneously under adverse conditions.
Update: After submitting I realized it would be important to check one more thing: can another LLM catch the same contradictions without the Contradiction Engine? I asked four LLMs "judges" to review the same Scenario 5b contract examples in English and Spanish. They caught some obvious mistakes, but the answer was mixed on the harder part: who the clause actually helps, and who carries the…
Doom Debates is a modern "infotainment" show that functions as a mainstream-accessible forum for top thinkers to have a high-quality conversation & debate about AI extinction risk.
Isn't this application AI generated, Genevieve?
Only where permitted by the application!
Ah - sorry about that @Genevieve Shea! We might have had a bug in the AI evaluator. We have fixed it and re-ran all applications. Your application comes back as human-written.
Daniel Solisis raising $25KforMYCELIA- a consensus based AI with predictive & prescriptive telemetryLanguage model where its attention-heads are not competing but consenting. Its governors monitor the hidden state geometry and provide early-warning by predicting failure and timely modify latent processes to avoid instabilities
Testing how governments should communicate when AI goes wrong, before they have to find out live.
A tool that generates RL environments for AI agents and adversarially attacks each one, so models don't train on tasks they can cheat.
An open-source Hausa-language AI safety evaluation suite, closing a documented blind spot affecting 60M+ people currently invisible to every existing safety benchmark.
Hey Pedro, out of curiosity, except for money, what is your biggest pain points that can be made into a software however it will cost a lot to create? I'm looking for clients honestly.
Hi Nicholas, thanks!
I'd say my biggest bottleneck is building the core platform fast enough while staying focused. There are definitely areas where additional software could accelerate development, especially around AI orchestration, governance, integrations and developer tooling. Right now I'm keeping external spending very low while raising funding, but I'd love to stay in…
@Lisa-Intel I think you missed the point haha, I'm providing the software to clients for no charge. I am accepting donations, though. E-mail me at nicholas@voltarecovery.org if you want to discuss this further.
That's a very generous offer, thank you @nicholas
I'll send you a mail tomorrow :)
I've spoken to several current and former UK AISI employees at various AI safety events and conferences. I think that it's the best place to work on safety in government, the team is very strong and their research directions are promising.
I've been to Lighthaven multiple times and think that the space is well managed. The Lesswrong admin team is responsible for keeping the site a place for some of the highest quality discussion on the internet even as it grows.
Demystifying AI evaluation research by lowering technical barriers through practical, open evaluation infrastructure.
This is the first large-scale study linking AI chatbot conversation logs and clinical records from patients in psychiatric treatment, led by the UCSF AI in Mental Health Research Group.
Seeking a top-up grant to prioritize AI Safety Career Coaching.
