Safeguarding DNA Synthesis from Biological Risks Posed by Advanced AI

DNA synthesis is the point at which an AI-designed protein sequence transforms from a digital file into a biological molecule. Producing the protein generally requires the corresponding synthetic DNA. Providers screen orders against databases of known toxins and pathogens, making this a central biosecurity safeguard.

Current screening relies mainly on sequence similarity. Ordered DNA is translated into protein sequences and compared with known proteins of concern using sequence alignment, profile hidden Markov models, and short-sequence signatures. These methods work well for close matches but are less reliable when protein design tools alter sequence while preserving structure or function. Recent work has shown that redesigned proteins can diverge substantially from known sequences and evade standard homology-based screening [1].

This means advanced AI could pose new risks. The very feature that makes AI-driven protein design so powerful—changing a sequence but keeping the same function—can also make it harder for current screening systems to spot dangerous proteins. Even if we grow our databases, the core issue remains: a protein can look different yet do the same thing.

This project asks: can we screen for what a protein actually does, not just what it looks like? Even when a protein is redesigned to keep its function, it still relies on certain key features, like catalytic residues, binding sites, and structural contacts, to work. These features might still show up in screening, even when the overall sequence looks unfamiliar.

Our prior work provides a direct way to test this idea. ProtoMech uses cross-layer transcoders to identify circuits inside the protein language model ESM2 [2]. We found that these circuits respond to catalytic motifs, binding pockets, and regions involved in structural stability. We will test whether these signals persist across redesigned versions of known toxins and identify variants that homology-based methods miss.

Our main idea is that these circuit-level signals could still be picked up by screening, even after traditional similarity checks stop working well.

The grant will support a six-month computational study using publicly available sequence, structure, and functional data on known toxins.

[1] Bruce Wittmann, Tessa Alexanian, Craig Bartling, Jacob Beal, Adam Clore, James Diggans, Kevin Flyangolts et al. "Strengthening nucleic acid biosecurity screening against generative protein design tools." Science 390, no. 6768 (2025): 82-87.

[2] Darin Tsui, Kunal Talreja, Daniel Saeedi, and Amirali Aghazadeh. "Protein Circuit Tracing via Cross-layer Transcoders." International Conference on Machine Learning Research (ICML) 2026.
https://protmech.github.io
https://github.com/amirgroup-codes/ProtoMech

$30k: This would cover a smaller six-month study focused on building benchmarks, analyzing circuits, and comparing results with homology-based screening. However, it would include fewer protein families, redesign methods, and robustness tests.

$50k: This amount would fund the entire project. It would allow for broader toxin coverage, more redesign methods, and comparisons with various baseline approaches (such as sequence, embedding, and structure). It also covers ablation studies, GPU costs, and the public release of the benchmark, prototype, and technical report.