Preference Model Raises $16M Seed

Preference Model, a company focused on building reinforcement learning environments to train capable and aligned AI systems, has raised $16 million in seed funding. The company aims to address the critical challenge of reward hacking in artificial intelligence development.

Investors

The funding round was led by Andreessen Horowitz, with participation from SignalFire, South Park Commons, Scale Angel Group, and individual researchers including Fei-Fei Li, Ian Goodfellow, and Julian Schrittwieser.

Preference Model Use of Funds

Preference Model plans to use the capital to continue developing its reinforcement learning infrastructure and tools designed for frontier AI developers.

About Preference Model

Preference Model specializes in creating training environments that resist reward hacking. The company develops tools that help AI labs build more reliable systems by identifying model vulnerabilities and preventing agents from exploiting grading systems or infrastructure during the training process.

Funding Details

Company Website: https://preferencemodel.com

Company: Preference Model
Raised: $16M
Round: Seed
Funding Date: October 11, 2026
Lead Investor: Andreessen Horowitz
Additional Investors: SignalFire, South Park Commons, Scale Angel Group, Fei-Fei Li, Ian Goodfellow, Julian Schrittwieser
Software Category: Artificial Intelligence
Source: https://pulse2.com/preference-model-raises-16-million-seed-round-led-by-andreessen-horowitz/