BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Centre for Mathematical Sciences - ECPv5.4.0.2//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Centre for Mathematical Sciences
X-ORIGINAL-URL:https://math-sciences.org
X-WR-CALDESC:Events for Centre for Mathematical Sciences
BEGIN:VTIMEZONE
TZID:UTC
BEGIN:STANDARD
TZOFFSETFROM:+0000
TZOFFSETTO:+0000
TZNAME:UTC
DTSTART:20190101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=UTC:20190213T140000
DTEND;TZID=UTC:20190213T150000
DTSTAMP:20210423T110118
CREATED:20181129T213947Z
LAST-MODIFIED:20190125T190714Z
UID:3316-1550066400-1550070000@math-sciences.org
SUMMARY:ZhiMin Xiao (University of Exeter)
DESCRIPTION:Title: Pupil Advantage Index as an Alternative to Subgroup Analysis in RCTs for Education \nAbstract:\nAnalyses of social interventions need to produce evidence that is relevant to different groups of people in a society. When such a group is not the target group of an intervention\, this is called subgroup analysis\, even when the group of interest is pre-specified prior to data collection. Amongst statisticians\, subgroup analysis is often regarded as a statistical malpractice\, as its findings are often underpowered\, unreliable\, and can be prone to overinterpretation at best\, or misleading at worst. Meanwhile\, researchers would be criticised for generating irrelevant evidence and accused of wasting research money if they do not conduct relevant subgroup analysis. As a result\, “they are damned if they do\, and damned if they don’t” (Petticrew et al.\, 2012). \nIn this study\, we estimated intervention effects for Free School Meal (FSM) pupils in English schools\, which is a pre-specified subgroup in most educational interventions funded by the Education Endowment Foundation (EEF) in England. Specifically\, we first ran a treatment-FSM interaction test in each and every outcome to see if the difference-in-effects is statistically significant between FSM and Non-FSM pupils. We then calculated separate effect sizes within the two subgroups. Finally\, we examined the p-values from the interaction tests and compared the overall effect sizes for both FSM and Non-FSM pupils with the two separate subgroup estimates. We found that conventional interaction tests can produce self-contradictory results. To help solve the problem\, we propose a new approach\, Pupil Advantage Index (PAI)\, as an alternative to subgroup analysis and apply it to real RCT data extracted from the EEF data archive. We demonstrate that PAI does not just indicate where an intervention worked and by how much in existing trials\, but it can also be utilised to optimise treatment recommendation for future interventions. \nKeywords: \nFree School Meal Pupils; Interaction Test; Prediction; Pupil Advantage Index; Randomised Controlled Trials; Subgroup Analysis
URL:https://math-sciences.org/event/zhimin-xiao-university-of-exeter/
LOCATION:Rolle 211
CATEGORIES:Seminars,Statistics and Data Science
END:VEVENT
END:VCALENDAR