Let's practice what we preach: Planning and interpreting simulation studies with design and analysis of experiments

26 Nov 2021  ·  Hugh Chipman, Derek Bingham ·

Statisticians recommend the Design and Analysis of Experiments (DAE) for evidence-based research but often use tables to present their own simulation studies. Could DAE do better? We outline how DAE methods can be used to plan and analyze simulation studies. Tools for planning include fishbone diagrams, factorial and fractional factorial designs. Analysis is carried out via ANOVA, main-effect and interaction plots and other DAE tools. We also demonstrate how Taguchi Robust Parameter Design can be used to study the robustness of methods to a variety of uncontrollable population parameters.

PDF Abstract

Categories


Methodology 62K99 (Primary) 62K25 (Secondary)

Datasets


  Add Datasets introduced or used in this paper