Skip to main content

Northwestern Buffett Institute for Global Affairs

Global LLM Values Benchmarking Working Group

Regional sociopolitical values are embedded in Large Language Models (LLMs), yet our understanding remains limited regarding how these values are interpreted and expressed by LLMs—particularly as popular models originating from diverse regional, cultural and political contexts increasingly shape public discourse and perceptions of global governance. The Global LLM Values Benchmarking Working Group is undertaking the first systematic, comparative assessment of regional sociopolitical values in LLMs.

About the Project

Large Language Models like ChatGPT, Claude, DeepSeek and Mistral have become central to global decision-making and communication. However, training these models on regionally biased data often embeds sociopolitical values that influence how global challenges are interpreted and framed. The Global LLMs Values Benchmarking Working Group is conducting a systematic, comparative study to benchmark these values in LLMs from the U.S., China, Europe, India and Russia as well as the Middle East and North Africa. The study examines LLM perspectives on international conflict, climate change, public health and migration. The group will produce tools, papers and convenings to improve AI governance, enhance transparency and foster inclusive AI systems that reflect diverse global perspectives.

 

Group Members

Core Members

Chadha headshot

Kalyani Chadha

Professor, Medill School of Journalism, Media, Integrated Marketing Communications, Northwestern University [co-lead]

Bio
Nicholas Diakopoulos headshot

Nicholas Diakopoulos

Professor, Department of Communication Studies, School of Communication, Northwestern University [co-lead]

Bio
Yingdan Lu headshot

Yingdan Lu

Assistant Professor, Department of Communication Studies, School of Communication, Northwestern University

Bio
Stephen C. Nelson headshot

Stephen C. Nelson

Associate Professor, Department of Political Science, Weinberg School of Arts & Sciences, Northwestern University [co-lead]

Bio
Erik C. Nisbet headshot

Erik C. Nisbet

Owen L. Coon Professor of Policy Analysis & Communication, Department of Communication Studies, School of Communication, Northwestern University [co-lead]

Bio

Team Members

Isabelle Augenstein's headshot

Isabelle Augenstein

Professor, Department of Computer Science, University of Copenhagen
Bio
William Brady's headshot

William Brady

Assistant Professor, Department of Management & Organizations, Kellogg School of Management, Northwestern University
Bio
Matthew Groh's headshot

Matthew Groh

Assistant Professor, Department of Management & Organizations, Kellogg School of Management, Northwestern University
Bio
Venus Jin's headshot

Venus Jin

Professor, Communication Program, Northwestern University in Qatar
Bio
Olga Kamenchuk's headshot

Olga Kamenchuk

Associate Professor of Research, Institute for Policy Research; Associate Professor of Instruction, Department of Communication Studies, School of Communication, Northwestern University
Bio
Manling Li's headshot

Manling Li

Assistant Professor, Department of Computer Science, McCormick School of Engineering, Northwestern University
Bio
Yilang Peng's headshot

Yilang Peng

Assistant Professor, Department of Financial Planning, Housing & Consumer Economics, University of Georgia
Bio
Eddie Yang's headshot

Eddie Yang

Assistant Professor, Department of Political Science, Purdue University
Bio