TRiADiC Alignment via Weighted SFT as a complete alignment system

TRIAD AI proves that balanced, supervised fine-tuning aligns large language models without this use of reinforcement learning pipelines, eliminating the prescriptive bias that harms vulnerable users in human-service settings.

Project Details

The primary impact of this work lies in fundamentally changing how developers build safe and reliable models, especially for human-service fields like crisis navigation, education, and mental health support. Current reinforcement-learning pipelines tend to produce models that perform confidence for reward evaluators, often resulting in an aggressive, overly prescriptive tone that can easily harm unseen, vulnerable users. By demonstrating that a balanced supervised fine-tune yields a gentler, more autonomy-preserving disposition, this research offers a practical pathway to deploy automated support systems that tell the truth without turning condescending or dangerously presumptive.

From an industry perspective, validating that alignment lives naturally in base model representations removes the massive financial and computational barriers associated with reinforcement learning. Teams will no longer need complex reward models, massive preference datasets, or multi-stage optimization loops to produce well-behaved models. Because the method achieves robust alignment while barely shifting the underlying network weights, it avoids the conventional alignment tax, allowing developers and public-interest organizations to create safer, capable systems at a fraction of the cost.

Theory of Impact

The real impact here is about protecting people on the other end of the screen who are going through tough moments. When someone reaches out to an automated tool for help with a relationship, mental health, or a major life crossroads, they do not need an AI that acts like an all-knowing judge or tells them what to do. Standard training methods reward systems for sounding overly confident and assertive, which can accidentally make a vulnerable person feel cornered, dismissed, or even pushed deeper into a bad situation. Giving models a natural balance of truth, kindness, and freedom ensures they can offer clear, honest information while still treating the person with basic respect and leaving life decisions entirely in their hands.

At the same time, this work takes a lot of the friction and cost out of building safe technology. Right now, teaching a model how to behave is a massive, expensive engineering headache that involves training separate referee models and running complicated feedback cycles that often make the core system dumber. Proving that simple, high-quality examples can accomplish the exact same thing means smaller teams, nonprofits, and community groups can build truly helpful tools without needing millions of dollars in compute power. It opens the door to safer, more capable software that works with people instead of talking down to them.

People

Rose G. Loops

Team Member

Grants Received– no grants recorded

Add grant

Funding Asks

Funding ask

Open

Minimum

$5,000

Ideal

$10,000

How the money will be spent

Grant funding will directly support dedicated researcher living expenses alongside the extensive compute infrastructure needed to push this work forward. Providing dedicated living support ensures the lead researcher can work full-time on the project without distraction, managing the fine-tuning runs, weight-level analyses, and evaluation pipelines. The primary technical cost is cloud compute power, which covers renting high-memory GPU clusters to run full-parameter fine-tunes, host multi-billion parameter configurations for testing, and conduct continuous, deep layer-by-layer weight audits across diverse architectures.

The remaining resources will go toward heavy benchmarking and extending the reach of the project to where it matters most. Additional compute will support running structured comparisons, adversarial evaluations, and domain-specific benchmarks designed with clinicians and human-service professionals. Extending reach also means funding the practical outreach necessary to get this method into real-world hands, including publishing open-source models, releasing reproducibility suites, and collaborating directly with crisis support services, non-profits, and educational groups that need safe, accessible tools they can trust.

Discussion

No comments yet. Be the first to share your thoughts.