The Sequential estimation of generalized linear model coefficients
Abstract
Generalized LinearModels (GLM) allows us to model the relationship between a response variable and one or more predictor variables while taking into account the distribution of the response variable. It is a useful tool for modeling data that do not follow a normal distribution and can be applied to a wide range of data types and problem settings. As data becomes increasingly relevant in our daily lives, the use of these models is becoming more important. However, this increase in importance also implies an increase in the complexity of estimation due to the volume of data that must be processed. In contrast, when dealing with laboratory experiments or other situations, we may have limited observations making it challenging to obtain robust estimates. To address these challenges, this paper proposes a simple and efficient method for estimating the coefficients of GLM and provides mathematical proof for the almost sure convergence of this method towards the desired solution. The proposed method is also validated on real-world data, reinforcing its utility and effectiveness.
Downloads
References
Nelder, J. A., & Wedderburn, R. W., Generalized linear models, Journal of the Royal Statistical Society: Series A (General) 135(3), 370-384, (1972).
McCullagh, P., & Nelder, J. A., Generalized linear models. 37, (1983).
Agresti, A., Categorical Data Analysis. (1990).
Antoniadis, A., Berruyer, J., & Carmona, R., Regression non lineaire et applications, Economica. (1992).
Madsen, H., & Thyregod, P., Introduction to general and generalized linear models, CRC Press. (2010).
Robbins, H., & Monro, S., A stochastic approximation method, The annals of mathematical statistics 400-407, (1951).
Bennar, A., Bouamaine, A., & Namir, A., Almost sure Convergence and in quadratic mean of the gradient stochastic process for the sequential estimation of a conditional expectation, Applied Mathematical Sciences 2(8), 387-395, (2008).
De Jong, P., & Heller, G. Z., Generalized linear models for insurance data, Cambridge Books. (2008).
Adesina, O. S., Models for Zero Truncated Count Data in Medicine and Insurance. (2021).
Gao, Z., & Hastie, T., DINA: Estimating Heterogenous Treatment Effects in Exponential Family and Cox Models, arXiv preprint arXiv:2103.04277. (2021).
Chen, X., Aravkin, A. Y., & Martin, R. D., Generalized linear model for gamma distributed variables via elastic net regularization, arXiv preprint arXiv:1804.07780. (2018).
Sudarwanto, S., Ambarwati, L., & Hadi, I., Development of rental property insurance models with Generalized Linear Models (GLM), Journal of Physics: Conference Series, IOP Publishing 1402, (7), 077104, (2019).
Fox, J., Friendly, G. G., Graves, S., Heiberger, R., Monette, G., Nilsson, H., ... & Suggests, M. A. S. S., The car package, R Foundation for Statistical Computing 1109, (2007).
Copyright (c) 2024 Boletim da Sociedade Paranaense de Matemática
This work is licensed under a Creative Commons Attribution 4.0 International License.
When the manuscript is accepted for publication, the authors agree automatically to transfer the copyright to the (SPM).
The journal utilize the Creative Common Attribution (CC-BY 4.0).
