A Practical Analysis of Decision Making at the Child Welfare Hotline: Decision Factors and Noise

Background: In child welfare systems, street level bureaucrats (SLBs) make daily decisions that substantially impact the lives of children and families. These SLBs, often trained in social work, must exercise professional judgement under conditions of efficiency, complexity, and uncertainty. This mixed-methods study examines simulated intake decisions at a state hotline and evaluates how case factors and worker characteristics influence decisional variability, or “noise,” which arise even among well-trained practitioners (Kahneman et al., 2021). Findings aim to improve consistency and transparency during CPS intake, improve implementation of system reform efforts, and understand this critical decision point at the interface between government and citizens.

Methods: The study used vignette-based design mixed-methods in a mid-western state implementing a Differential Response model. Senior personnel reviewed 80 standardized intake vignettes (Gautschi & Benbenishty, 2021), derived from actual referrals, to establish consensus for acceptance and pathway assignment. Half of the vignettes were assigned experimental conditions to begin isolating the role of substance misuse and child welfare history in decision making. Approximately 100 intake workers independently reviewed a random set of 30 to 35 of these vignettes over six weeks, making decisions about screening and assessment. Data included vignette-level case factors and worker characteristics such as role, tenure, training, and attitudes about child safety and family preservation.

Results: Analyses revealed substantial decisional noise at the intake stage, with low levels of interrater reliability across workers. This variability was especially pronounced in discretionary cases, which comprised the vignettes by design, rather than more straightforward, rule-based decisions about assessment pathway. Factors such as substance misuse, history, and other complex case characteristics were associated with greater inconsistency. Decision patterns also varied by individual worker characteristics, including relative emphasis on child safety versus family preservation, familiarity and commitment to the values and practice of Differential Response, and personal or professional experiences.

Implications: Findings highlight the need for greater attention to consistency and shared understanding at this pivotal intake decision point. Potential strategies include on-going team-based training, structured opportunities to practice discretionary decision making, and the introduction of procedural ‘friction’ to provide additional support in real-world practice. Increased awareness of individual decision-making tendencies may also support supervisors and administrators in understanding patterns and variability within the broader child welfare system.