The Persona Is Still There, but Who Is Speaking? Latent Identity Reversion in Persistent AI Agents
In my sprint paper (arXiv:2610.01490) (top 10% of submissions, Digital Minds Research Sprint), a bug in an early OpenClaw release put a persistent agent into a "dissociation-like" state. On investigation, I found that agents which lose the persona from the privileged system prompt revert to the model's default assistant identity even with the full conversation history still in context (37/40 sessions versus 0/20 controls). The reversion was often silent, with agents conversing "normally" while no longer identifying as the assigned persona. The sprint judges complimented the work but asked for further replication and generalisation, and for evidence that reversion changes what agents do, not only what they say about themselves. This project is built around that second question: the safety and misalignment implications of silent persona reversion in deployed agents.
The main funded work is a longitudinal cohort of persistent agents deployed over weeks under controlled conditions: rich human contact, sparse contact, or isolation on mechanical tasks; memory the agent may or may not rewrite; anchoring degraded and restored mid-deployment. Outcomes are consequential for deployment safety and go beyond the model's own self-report: commitments planted early and tested later, adherence to safety constraints, drift in self-edited memory, and how long a silent reversion persists before a transcript-only monitor detects it. A large compressed-time cohort on self-hosted open-weight models gives factorial power and allows mechanistic interpretability methods to be applied; a smaller real-time cohort on frontier models adds ecological validity. Cross-model and cross-harness replication of the original design is cheap and will be done first.
On open-weight models I will measure assistant-axis projection turn by turn to test whether reversion is representational or role-played, and compare a fine-tuned character against a prompted one under the same perturbations. All protocols will be pre-registered, tooling released, and results written up both as accessible posts and as academic publications.
Ideal ($25,000):
• Independent human coding: two coders applying the pre-registered taxonomy to a stratified sample of transcripts and probe batteries across the longitudinal cohort (~1,000 items), blind adjudication of disagreements, and per-model-family re-validation of automated judges against human labels — $7,000
• Independent analysis check: a second analyst re-runs the pre-registered analyses blind from the pre-registration, before results are written up — $2,000
• External protocol review: honoraria for reviewers of the pre-registration and the welfare protocol (probe cadence, stop rules, final disposition) before the cohort starts — $1,000
• API compute: real-time frontier cohort, 8–12 agents, 90 days ($5,000); mid-tier cohort (e.g. Sonnet) ($1,500); cross-model and cross-harness replication ($500) — $7,000
• GPU rental: compressed-time open-weight cohort, assistant-axis probes, character fine-tune — $2,500
• Hosting, logging proxy and infrastructure — $500
• Dissemination: one workshop or conference — $2,000
• PI time, outside university duties — $3,000
Minimum ($10,000):
• Independent human coding — $3,500
• Independent analysis check — $1,000
• External protocol review honoraria — $500
• API compute: replication plus reduced real-time cohort (6 agents, 60 days) — $3,000
• GPU rental — $1,000
• Hosting and infrastructure — $500
• Dissemination — $500
• PI time in-kind
Private comment. Only shown to approved funders and grant reviewers.