» Articles » PMID: 35632184

Machine Learning-Based Boosted Regression Ensemble Combined with Hyperparameter Tuning for Optimal Adaptive Learning

Overview
Journal Sensors (Basel)
Publisher MDPI
Specialty Biotechnology
Date 2022 May 28
PMID 35632184
Authors
Affiliations
Soon will be listed here.
Abstract

Over the past couple of decades, many telecommunication industries have passed through the different facets of the digital revolution by integrating artificial intelligence (AI) techniques into the way they run and define their processes. Relevant data acquisition, analysis, harnessing, and mining are now fully considered vital drivers for business growth in these industries. Machine learning, a subset of artificial intelligence (AI), can assist, particularly in learning patterns in big data chunks, intelligent extrapolative extraction of data and automatic decision-making in predictive learning. Firstly, in this paper, a detailed performance benchmarking of adaptive learning capacities of different key machine-learning-based regression models is provided for extrapolative analysis of throughput data acquired at the different user communication distances to the gNodeB transmitter in 5G new radio networks. Secondly, a random forest (RF)-based machine learning model combined with a least-squares boosting algorithm and Bayesian hyperparameter tuning method for further extrapolative analysis of the acquired throughput data is proposed. The proposed model is herein referred to as the RF-LS-BPT method. While the least-squares boosting algorithm is engaged to turn the possible RF weak learners to form stronger ones, resulting in a single strong prediction model, the Bayesian hyperparameter tuning automatically determines the best RF hyperparameter values, thereby enabling the proposed RF-LS-BPT model to obtain desired optimal prediction performance. The application of the proposed RF-LS-BPT method showed superior prediction accuracy over the ordinary random forest model and six other machine-learning-based regression models on the acquired throughput data. The coefficient of determination (Rsq) and mean absolute error (MAE) values obtained for the throughput prediction at different user locations using the proposed RF-LS-BPT method range from 0.9800 to 0.9999 and 0.42 to 4.24, respectively. The standard RF models attained 0.9644 to 0.9944 Rsq and 5.47 to 12.56 MAE values. The improved throughput prediction accuracy of the proposed RF-LS-BPT method demonstrates the significance of hyperparameter tuning/optimization in developing precise and reliable machine-learning-based regression models. The projected model would find valuable applications in throughput estimation and modeling in 5G and beyond 5G wireless communication systems.

Citing Articles

Optimized Machine Learning for the Early Detection of Polycystic Ovary Syndrome in Women.

Panjwani B, Yadav J, Mohan V, Agarwal N, Agarwal S Sensors (Basel). 2025; 25(4).

PMID: 40006393 PMC: 11859304. DOI: 10.3390/s25041166.


Enhancing active fire detection in Sentinel 2 imagery using GLCM texture features in random forest models.

Zhou B, Gao S, Yin Y, Zhong Y Sci Rep. 2024; 14(1):31076.

PMID: 39730703 PMC: 11681220. DOI: 10.1038/s41598-024-81976-w.


Advancing ensemble learning techniques for residential building electricity consumption forecasting: Insight from explainable artificial intelligence.

Moon J, Maqsood M, So D, Baik S, Rho S, Nam Y PLoS One. 2024; 19(11):e0307654.

PMID: 39541326 PMC: 11563398. DOI: 10.1371/journal.pone.0307654.


Enhanced prediction of cement raw meal oxides by near-infrared spectroscopy using machine learning combined with chemometric techniques.

Zhang Y, Yang Z, Wang Y, Ge X, Zhang J, Xiao H Front Chem. 2024; 12:1398984.

PMID: 38894728 PMC: 11184222. DOI: 10.3389/fchem.2024.1398984.


An ensemble learning model for forecasting water-pipe leakage.

Warad A, Wassif K, Darwish N Sci Rep. 2024; 14(1):10683.

PMID: 38724568 PMC: 11082134. DOI: 10.1038/s41598-024-60840-x.


References
1.
Ajani T, Imoize A, Atayero A . An Overview of Machine Learning within Embedded and Mobile Devices-Optimizations and Applications. Sensors (Basel). 2021; 21(13). PMC: 8271867. DOI: 10.3390/s21134412. View

2.
Li X, Cao R, Hao J . An Adaptive Learning Based Network Selection Approach for 5G Dynamic Environments. Entropy (Basel). 2020; 20(4). PMC: 7512751. DOI: 10.3390/e20040236. View

3.
Imoize A, Orolu K, Atayero A . Analysis of key performance indicators of a 4G LTE network based on experimental data obtained from a densely populated smart city. Data Brief. 2020; 29:105304. PMC: 7044520. DOI: 10.1016/j.dib.2020.105304. View

4.
Kavitha K, Ashok S, Imoize A, Ojo S, Selvan K, Ahanger T . On the Use of Wavelet Domain and Machine Learning for the Analysis of Epileptic Seizure Detection from EEG Signals. J Healthc Eng. 2022; 2022:8928021. PMC: 8896918. DOI: 10.1155/2022/8928021. View

5.
Goldstein B, Polley E, Briggs F . Random forests for genetic association studies. Stat Appl Genet Mol Biol. 2012; 10(1):32. PMC: 3154091. DOI: 10.2202/1544-6115.1691. View