Sentient Futures Project Incubator

Remote

sentientfutures.ai

Raising $10,000active5 people

Funding compute/API costs for Incubator projects that build nonhuman welfare consideration into AI safety work

Endorsed by

Ryan

Gavin

Marcus+6

Funding compute/API costs for Incubator projects that build nonhuman welfare consideration into AI safety work

Endorsed by

Ryan

Gavin

Marcus+6

Project Details

What you’ll do

Sentient Futures is building the interface between AI safety & nonhuman welfare. We think developing this intersection is a neglected yet promising route to mitigating AI-related X-risk through such mechanisms as:

Improving methods for detecting & correcting species and substrate bias might help prevent AI systems from learning that moral consideration is contingent & instrumental.
Probing internal subjective states could enable humans to understand & respond to the experiences of potentially conscious or sentient AI systems.
Forecasting societal responses to the rise of so-called digital minds may better inform anticipatory governance frameworks.

We seek funding ($12-24k) for compute/API support to accelerate such research via our Project Incubator: a 10-week program (modeled after SPAR, FIG) matching motivated individuals with expert mentors to work on well-scoped projects on topics related to longtermism & future risks, artificial sentience, post-AGI transition, & macrostrategy/cause prioritization.

Track record

Our spring 2026 run brought together 34 mentors & 93 mentees across 52 projects. Notable outcomes span research exploring implications of artificial sentience for society at large, as well as technical work on aligning AI with nonhuman welfare:

Do emotional prompts affect the potential capabilities of LLMs?: Experiment testing whether AI systems operating under suffering-like adverse conditions show measurable performance degradation, making AI welfare an engineering problem – not just philosophy.
What would convince you of AI consciousness?: Qualitative interviews with consciousness & AI safety experts mapping key cruxes with respect to the possibility/likelihood of AI consciousness.
Multi-Agent Alignment Game: Frontier AI models compete & cooperate under simulated US-China dynamics. Incentive design, rather than model choice, drives cooperative vs. competitive behavior.
AGI Loss of Control Pathways: Participatory backcasting to map social & institutional routes by which humanity loses control over AGI. Under review by EMNLP.
Travel Agent Compassion (TAC): Benchmark testing whether AI travel agents avoid booking animal exploitation (e.g. bullfights); merged into UK AISI Inspect Evals.
Hyperstition for Good: Writing competition curating fiction of safe, compassionate-to-nonhuman AIs as high-quality mid/pre-training data for labs – betting that stories about good AI make good AI.

See published projects here (filter for AI Safety & Alignment).

Concrete output

Fall 2026 Incubator run with ~100 mentors & 180-200 mentees across 75-100 projects.

Who’s involved

Constance Li (Executive Director & Cofounder)
Jay Luong (Incubator Lead)
Brody McManus (Fellowship Coordinator)
Zoe Lu (Community Lead)
Martyna Wielopolska (Research Manager)

Mentors include researchers/staff from MATS, Anthropic (incoming fellow), RAND, Rethink Priorities, Forethought, Cambridge AI Safety Hub, & LASR.

Browse current mentors here.

Theory of Impact

The Project Incubator generates field growth, research, & talent that would not otherwise exist, closing the gap between nonhuman welfare & AI safety & ultimately mitigating X-risk.

Field growth: The field of AI safety could be too narrowly focused & may benefit from a greater diversity of approaches & perspectives. Our mentor network attracts a broad array of experts from animal welfare, philosophy, & the psychological sciences into AI safety work. These recruitment pipelines are not as well-covered by other similar online mentor-based project programs like SPAR.
Research: Mentored projects produce evals, benchmarks, & empirical work on key areas of importance to both nonhuman welfare & AI safety, like value extrapolation & internal state detection. Adoption by labs & governments leads to safer systems.
Two benchmarks from our Spring 2026 cohort were merged into UK AISI's Inspect Evals, & another project reached EMNLP submission.

People

Constance Li

Team Member

Jay Luong

Incubator Lead

Funding Details

Start Date: Jun 1, 2026
End Date: -
Expected Duration: -
Funding Raised to Date: -
Annual Budget: -
Monthly Burn Rate: -
Current Runway: -
Funding Goal: -
Funding Stage: Partially funded
Fiscal Sponsor: -

Track Record

Do emotional prompts affect the potential capabilities of LLMs?: Experiment testing whether AI systems operating under suffering-like adverse conditions show measurable performance degradation, making AI welfare an engineering problem – not just philosophy.
What would convince you of AI consciousness?: Qualitative interviews with consciousness & AI safety experts mapping key cruxes with respect to the possibility/likelihood of AI consciousness.
: Frontier AI models compete & cooperate under simulated US-China dynamics. Incentive design, rather than model choice, drives cooperative vs. competitive behavior.

Grants Received

Add grant

Goodfire

from Goodfire

Navigation Fund

from The Navigation Fund

EA Animal Welfare Fund

from Centre for Effective Altruism (CEA)

Funding Asks

grantmaking.ai Launch Round

Applied

Minimum

$10,000

Ideal

$60,000

Theory of impact

The Project Incubator generates field growth, research, & talent that would not otherwise exist, closing the gap between nonhuman welfare & AI safety & ultimately mitigating X-risk.

Field growth: The field of AI safety may be too narrowly focused and could benefit from greater diversity of approaches and perspectives. Our mentor network attracts a broad array of experts from animal welfare, philosophy, & the psychological sciences into AI safety work. This recruitment pipeline is not as well covered in other similar online mentor-based project programs like SPAR.
Research: Mentored projects produce evals, benchmarks, & empirical work on key areas that are relevant to both nonhuman welfare & AI safety, like value extrapolation & internal state detection. Adoption by labs & governments leads to safer systems.
Two benchmarks from our Spring 2026 cohort were merged into UK AISI's Inspect Evals, & another project reached EMNLP submission.
Talent: Mentees leave with a portfolio, references, & connections. In the medium term, these convert into funding & placements at influential organisations.

In the long run,** these outputs reduce the risk that transformative AI locks in indifference to sentient beings – humans included.

Assumptions

AI safety work that only focuses on humans creates exposure to failure modes that endanger humans too (e.g. misgeneralized values, deceptive suppression of internal states).
Our program will launch counterfactual and useful projects at the intersection of nonhuman welfare & AI safety.

Metrics

Projects on AI Safety & Alignment completed
Publications
Career transitions into AI safety roles

How the money will be spent

$10k: Minimum support needed for 1 cohort

Only top projects out of 75-100 will receive compute/API support.

$15-20k: Base support for 1 cohort

Compute/API support will be distributed between:

Further support for top projects
Limited support for more speculative projects

$20-40k: Covers compute/API support for 2 cohorts

Having compute/API support for mentors in the first cohort helps us to establish credibility & attract mentors for more technical projects in subsequent rounds.

$40-60k: Covers compute/API support for 3 cohorts

Generous support provided to top projects.

Discussion

Private comments in this thread are only shown to approved funders and grant reviewers. Email hi@grantmaking.ai or to request access.

Pip Foweraker11d

I think this is a neglected research and cause area inside the broader field, and one where unique harms are likely to emerge unless we take exploratory and mitigation measures. Increasing the pipeline for diverse perspectives is especially worthwhile.

Allen LuEndorsement11d

this is a hugely important and neglected area, and more work needs to be done around this. This is a valuable field-building effort and past sentient futures' projects been incredibly well-organized and competently executed.

Miles TidmarshEndorsement10d

Many of CaMLs papers, benchmarks and the Hyperstition project were only able to happen due to connections made within the Sentient Futures community or their incubator. We fully support them as field builders.

FFrankie Andersen-WoodEndorsement6d

Very important and neglected. Some tractable low hanging fruits. 👍

Grant ReviewerPrivate5d?

John LundEndorsement2d

Sentient Futures is doing incredible work in a space that I believe will only become more valuable as advanced AI systems grow in capabilities and deployments. The Incubator is a one-of-a-kind program offering mentors and mentees the opportunity to work on impactful projects that address issues many other large fellowships neglect.

CChristopher AckermanEndorsement1d

SF supports good research!

Jack ThompsonEndorsement1d

SF Project Incubator is the only program that could look like "MATS for digital minds" right now. As a mentor, I'm very excited for this and want my mentees to have the compute they need to do quality science!