Abstract
Classical optimal designs for count data are highly efficient but degrade
severely when the assumed generalized linear model is misspecified. To address
this, we propose a two-stage robust design framework for Poisson and negative binomial regressions. First, we adapt the nonparametric XICOR correlation
measure to formally detect functional dependence between residuals and design
points. Second, we introduce two robust design criteria—one utilizing pilot data
to target specific deviations, and a minimax-style averaging over a functional class
of misspecifications when prior data are absent. We optimize these non-convex
objective functions using a simulated annealing algorithm. Extensive simulations
and a real-world toxicological application demonstrate that our robust designs
yield substantial efficiency gains over classical approaches under misspecification,
while maintaining low premium costs under correct specification.
Key words and phrases: Generalized linear models, Model misspecification, Op- timal design, Robust statistics
Information
| Preprint No. | SS-2025-0089 |
|---|---|
| Manuscript ID | SS-2025-0089 |
| Complete Authors | Linglong Kong, Rui Hu, Jordan Slessor |
| Corresponding Authors | Linglong Kong |
| Emails | lkong@ualberta.ca |
References
- Adewale, A. J. and D. P. Wiens (2009). Robust designs for misspecified logistic models. Journal of Statistical Planning and Inference 139(1), 3–15. Special Issue on Metaheuristics, Combinatorial Optimization and Design of Experiments.
- Atkinson, A. C. (2015). Optimum designs for two treatments with unequal variances in the presence of covariates. Biometrika 102(2), 494–499.
- Box, G. E. P. and N. R. Draper (1959). A Basis for the Selection of a Response Surface Design. Journal of the American Statistical Association 54(287), 622–654.
- Chaloner, K. and K. Larntz (1989). Optimal Bayesian design applied to logistic regression experiments. Journal of Statistical Planning and Inference 21(2), 191–208.
- Chatterjee, S. (2021). A New Coefficient of Correlation. Journal of the American Statistical Association 116(536), 2009–2022.
- Chatterjee, S. and S. Holmes (2023). XICOR: Robust and generalized correlation coefficients. CRAN. https://github.com/spholmes/XICOR.
- Chernoff, H. (1953). Locally Optimal Designs for Estimating Parameters. The Annals of Mathematical Statistics 24(4), 586–602.
- Fahrmeir, L. (1990). Maximum likelihood estimation in misspecified generalized linear models. Statistics 21(4), 487–502.
- Fang, Z. and D. P. Wiens (2000). Integer-Valued, Minimax Robust Designs for Estimation and Extrapolation in Heteroscedastic, Approximately Linear Models. Journal of the American Statistical Association 95(451), 807–818.
- Harman, R., L. Filov´a, and P. Richt´arik (2020). A Randomized Exchange Algorithm for Computing Optimal Approximate Designs of Experiments.
- Hu, F., Y. Hu, Z. Ma, and W. F. Rosenberger (2014). Adaptive randomization for balancing over covariates. WIREs Computational Statistics 6(4), 288–303.
- Hu, F. and W. F. Rosenberger (2003). Optimality, Variability, Power. Journal of the American Statistical Association 98(463), 671–678.
- Hu, R., I. Bica, and Z. Zhai (2023, September). Robust Optimal Design When Missing Data
- Happen at Random. Journal of Statistical Theory and Practice 17, 43.
- Hu, R. and D. P. Wiens (2017). Robust discrimination designs over Hellinger neighbourhoods. The Annals of Statistics 45(4), 1638 – 1663.
- Hu, Y. and F. Hu (2012). Asymptotic properties of covariate-adaptive randomization. The Annals of Statistics 40(3), 1794 – 1815.
- King, J. and W.-K. Wong (2000). Minimax D-Optimal Designs for the Logistic Model. Biometrics 56(4), 1263–1267.
- Kong, L. and D. P. Wiens (2015). Model-Robust Designs for Quantile Regression. Journal of the American Statistical Association 110(509), 233–245.
- Ma, W., P. Li, L.-X. Zhang, and F. Hu (2024). A New and Unified Family of Covariate Adaptive Randomization Procedures and Their Properties. Journal of the American Statistical Association 119(545), 151–162.
- R Core Team (2023). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.
- Ritz, C., F. Baty, J. C. Streibig, and D. Gerhard (2016). Dose-Response Analysis Using R. PLOS ONE 10(12), 1–13.
- Rodr´ıguez-Torreblanca, C. and J. Rodr´ıguez-D´ıaz (2007). Locally D- and c-optimal designs for Poisson and negative binomial regression models. Metrika: International Journal for Theoretical and Applied Statistics 66(2), 161–172.
- Rosenberger, W. F. and O. Sverdlov (2008). Handling Covariates in the Design of Clinical Trials. Statistical Science 23(3), 404 – 419.
- Russell, K. G., D. C. Woods, S. M. Lewis, and J. A. Eccleston (2009). D-OPTIMAL DESIGNS FOR POISSON REGRESSION MODELS. Statistica Sinica 19(2), 721–730.
- Selvaratnam, S., L. Kong, and D. P. Wiens (2021). Model-robust designs for nonlinear quantile regression. Statistical Methods in Medical Research 30(1), 221–232.
- Sinha, S. and D. P. Wiens (2002). Robust sequential designs for nonlinear regression. Canadian Journal of Statistics 30(4), 601–618.
- Sun, K., L. Kong, H. Zhu, and C. Shi (2025). ARMA-Design: Optimal Treatment Allocation Strategies for A/B Testing in Partially Observable Time Series Experiments.
- Venables, W. N. and B. D. Ripley (2002). Modern Applied Statistics with S (Fourth ed.). New York: Springer. ISBN 0-387-95457-0.
- Yang, M. (2008). A-optimal designs for generalized linear models with two parameters. Journal of Statistical Planning and Inference 138(3), 624–641.
- Yang, M., S. Biedermann, and E. Tang (2013). On Optimal Designs for Nonlinear Models: A General and Efficient Algorithm. Journal of the American Statistical Association 108(504), 1411–1420.
- Zhang, Y. and K. Ye (2014). Bayesian D-Optimal Designs for Poisson Regression Models. Communications in Statistics - Theory and Methods 43(6), 1234–1247.
Acknowledgments
This research was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) [funding reference number 02589]. Lin-
glong Kong was partially supported by grants from the Canada CIFAR AI
Chairs program, the Alberta Machine Intelligence Institute (AMII), the
Canadian AI Safety Institute Research Program at CIFAR, the Natural
Sciences and Engineering Research Council of Canada (NSERC), NSERC
Alliance - Alberta Innovates Advance Program, and the Canada Research
Chair program from NSERC.
Supplementary Materials
The online supplementary materials contain proofs for Theorems 1, 2, and
- Moreover, they contain the detailed algorithmic formulation of the simulated annealing procedure, as well as the results and discussions for the
negative binomial simulations and additional misspecification scenarios.