Session: From Policy Simulation to Evidence Synthesis: Human-Centered AI In Social Work Research (Society for Social Work and Research 31st Annual Conference)

13 From Policy Simulation to Evidence Synthesis: Human-Centered AI In Social Work Research

Schedule:
Thursday, January 21, 2027: 1:30 PM-3:00 PM
Union Station 3 & 4 (Hilton San Francisco Union Square)
Cluster: Research Design and Measurement
Symposium Organizer:
Amanda Ritchie, New York University
Discussant:
Ruopeng An, PhD, New York University
Traditional research methods can be time- and resource-intensive and slow to produce actionable and scalable insights. In advancing social work research in service of democracy and the common good, there is a growing need for approaches that are both rigorous and responsive to real-world decision-making. Emerging tools such as artificial intelligence (AI), large language models (LLMs), and other computational methods offer new opportunities to expand and accelerate research capacity. These tools can support knowledge generation, synthesis, and early-stage testing of policy and practice innovations. However, their use must remain grounded in human oversight, transparency, and a commitment to equity and inclusion. This symposium showcases four student-led projects from the NYU Silver School of Social Work and its C+M Center that position AI as social work research infrastructure - supporting, rather than replacing, human judgment - to advance equitable and policy-relevant outcomes.

The first paper uses LLM-based agents grounded in survey data to simulate responses to family-support policies related to fertility intentions. By comparing simulated outcomes to observed data, the authors assess the feasibility of this approach as a lower-cost, scalable tool for early-stage policy pretesting. This work demonstrates how AI can support more efficient and evidence-informed policy design, with implications for strengthening policy responsiveness and promoting the common good.

The second paper employs persona-based LLM agents to replicate published health preference findings, testing the extent to which synthetic data can approximate population-level patterns. Findings suggest these approaches may be useful for survey piloting, scenario testing, and early-stage research, particularly in resource-constrained settings. At the same time, the study highlights important limitations, reinforcing the continued necessity of human expertise and lived experience in producing valid and equitable research outcomes.

The third paper evaluates a multi-agent AI system designed to support literature screening in systematic reviews. By comparing AI-assisted screening to traditional team-based approaches, the authors demonstrate how such systems can improve efficiency while preserving human judgment, transparency, and methodological rigor. This work positions AI as a supportive tool that can expand access to evidence synthesis capacity, particularly for teams with limited resources.

The fourth paper presents a scoping review of AI-based dietary intake measurement, a foundational method for nutrition research and food policy. The authors identify critical equity gaps in validation and representation, noting that many AI tools have not been adequately tested among populations most affected by measurement bias. These findings underscore the importance of ensuring algorithmic fairness and inclusive design so that advances in measurement technology do not reinforce existing disparities.

Taken together, these papers illustrate how AI can be leveraged to generate, test, and synthesize knowledge in ways that are both innovative and accountable. Across diverse applications - policy simulation, preference modeling, evidence synthesis, and measurement systems - these studies demonstrate the potential of human-centered AI to expand research capacity while maintaining rigor and ethical responsibility. This symposium highlights how inclusive, methodologically rigorous inquiry can advance social work research by strengthening evidence-informed decision-making, expanding access to research tools, and promoting more equitable outcomes for the common good.

* noted as presenting author
Pretesting Family Support Policy Effects on Fertility Intentions through Survey-Grounded LLM Agent Simulation
Jingyi Huang, MA, New York University; Fan Yang, PhD, University of Illinois at Urbana-Champaign; Ruopeng An, PhD, New York University
Can Persona-Based LLM Agents Approximate Published Health Preference Findings? a Social Work-Relevant Replication Using Synthetic Respondents
Yuyi Yang, Washington University in Saint Louis; Langlin Huang, Washington University in Saint Louis; Ruopeng An, PhD, New York University
Centering Human Judgment In Evidence Synthesis: A Multi-Agent AI Approach to Literature Screening for Social Work Research
Fan Yang, PhD, University of Illinois at Urbana-Champaign; Jingyi Huang, MA, New York University; Ruopeng An, PhD, New York University
Artificial Intelligence for Dietary Intake Measurement: A Scoping Review of Accuracy, Equity Gaps, and Implications for Underrepresented Populations
Yue Fang, MSW, MSP, New York University; Maddie Gunnel, New York University; Ruopeng An, PhD, New York University
See more of: Symposia