Human-Centered Artificial Intelligence (AI) Research

Info
217

3 units

Course Description

Explores how to evaluate and align artificial intelligence (AI) systems to serve human and community needs. Integrating human-centered design, AI evaluation, and alignment research, students examine how human goals translate into system behavior, measure capabilities, and assess context-specific performance. Key topics include benchmarks, human evaluation, red teaming, robustness, fairness, transparency, oversight, and AI agent design. Through research paper readings, evaluation exercises, and a hands-on project, students analyze existing AI systems, gather empirical evidence, test for failures and harms, and communicate findings and limitations. Building or training models is not required or covered in course.

Student Learning Objectives

  1. Define a human-centered AI research question that accounts for the goals and perspectives of relevant stakeholders.
  2. Explain major approaches to AI alignment and distinguish intended behavior from observed behavior in a specific use context.
  3. Design evaluations using appropriate tasks, measures, comparison conditions, and human judgment; explain what each measure misses.
  4. Investigate AI capabilities, failure modes, and potential harms through systematic testing and analysis.
  5. Use HCI methods, where appropriate, to understand how people use, interpret, and are affected by AI systems.
  6. Critically assess the validity and limitations of published AI evaluation and alignment research.
  7. Conduct and communicate a small-scale, ethically planned evaluation of an AI system, including findings, limitations, and recommendations.

Until 2024, this course was offered as Info 217A. Human-Computer Interaction (HCI) Research.

Requirements Satisfied

Ph.D. Breadth — Social Aspects of Information
Ph.D. Major/Minor Areas — Human-Computer Interaction
Last updated: November 2, 2026