Skip to content

Vals Study Finds Chinese AI Models’ Political Alignment Varies With Language and Test Design

1 reports 1 reporting sources Updated 3 hours ago

Understand the event

AI overview

Vals published a study finding substantial variation in how closely Chinese AI models’ responses aligned with Chinese government positions, with a lower overall pro-government lean than the researchers expected. Prompts in Simplified Chinese generally elicited more pro-government responses, while response formats and agent instructions also affected the results. The study tested models with targeted political questions and counted refusals to answer as neutral. Many models were accessed through third-party providers, which limits how directly the findings apply to their official public chatbots.

Generated by AI from reports · Updated 2 hours ago

Read next

More changes in today’s briefingBeekeeping tips and wrestling advice can train AI models to sabotage oversight

Report timeline

Follow the reports to explore different sides of the event.

11/1
  1. Chinese AI models are politically complex, not just government mouthpieces, study finds

    Vals found substantial variation in Chinese AI models’ alignment with Chinese government positions, with a lower overall pro-government lean than expected. Simplified Chinese prompts generally elicited more pro-government responses, while response formats and agent instructions also affected results. The tests used targeted political questions and counted refusals as neutral; many models were accessed through third-party providers, limiting applicability to official public chatbots.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.