Feature space modeling in machine learning: a potential for regression and classification tasks

  • 1 Lviv Polytechnic National University, Lviv, Ukraine


This article considers non-parametric models based on feature space modeling in the context of machine learning. The main machine learning models, their advantages and disadvantages are analyzed. The term “non-parametric feature space modeling model” has been considered in detail and compared with other machine learning models. The advantages of these models are justified in comparison with other approaches. The paper contains an analysis that confirms the advantages of using non-parametric feature space modeling models in machine learning tasks.



  1. J E T Akinsola, “Supervised Machine Learning Algorithms: Classification and Comparison”, International Journal of Computer Trends and Technology (IJCTT), Vpl. 48, No.3, 2017, pp. 128-138.
  2. Anita Racz, David Bajusz, Karoly Heberger, "Multi-Level Comparison of Machine Learning Classifiers and Their Performance Metrics,” Molecules, Vol. 24, Issue 15, 2019, Pages 2811.
  3. Ghada Emam Atteia, Nagwan Abdelsamee, Hanan Mengash, "Evaluation of using Parametric and Nonparametric Machine Learning Algorithms for Covid-19 Forecasting," International Journal of Advanced Computer Science and Applications, Vol. 12, No. 10, 2021, Pages 647-657.
  4. Nicolai Bissantz, Axel Munk, Achim Scholz, "Parametric versus non-parametric modelling? Statistical evidence based on P-value curves," Monthly Notices of the Royal Astronomical Society, Vol. 340, Issue 4, 2003, Pages 1190-1198
  5. Saerom Park, Jaewook Lee, Youngdoo Son, "Predicting Market Impact Costs Using Nonparametric Machine Learning Models," PLoS One, Vol. 11, Issue 2, 2016.
  6. Shu Jiang, "Heart Disease Prediction Using Machine Learning Algorithms," University of California, 2020 -
  7. Peter Martey Addo, Dominique Guegan, Bertrand Hassani, "Credit Risk Analysis Using Machine Learning and Deep Learning Models," Risks, Vol. 6, Issue 38, 2018.
  8. Mubarak Alrumaidhi, Mohamed M. G. Farag, Hesham A. Rakha, "Comparative Analysis of Parametric and Non-Parametric Data-Driven Models to Predict Road Crash Severity among Elderly Drivers Using Synthetic Resampling Techniques", Sustainability, Vol. 15, Issue 13, 2023, Pages 9878.
  9. Javier Alonso, Lluis Belanche, Dimiter R. Avresky, "Predicting Software Anomalies using Machine Learning Techniques," IEEE 10th International Symposium on Network Computing and Applications, 2011.
  10. Jiaqing Lv, Xiaodong Zheng, Miroslaw Pawlak, Weike Mo, Marek Miskowicz, "Very short-term probabilistic wind power prediction using sparse machine learning and nonparametric density estimation algorithms," Renewable Energy, Vol. 177, 2021, Pages 181-192.
  11. Seyedzadeh, Saleh, Rahimian, Farzad Pour, Rastogi, Parag and Glesk, Ivan, "Tuning Machine Learning Models for Prediction of Building Energy Loads," Sustainable Cities and Society, Vol. 57, 2019.
  12. Maya Gopal P. S. & Bhargavi R., "Performance Evaluation of Best Feature Subsets for Crop Yield Prediction Using Machine Learning Algorithms," Applied Artificial Intelligence, Vol. 33, Issue 7, 2019, Pages 621-642.
  13. Hakan Pabuccu, Serdar Ongan, Ayse Ongan, "Forecasting the Movements of Bitcoin Prices: An Application of Machine Learning Algorithms," Quantitative Finance and Economics, Vol. 4, Issue 4, 2020, Pages 679-692.
  14. Nur’eni, M Fajri, S Astuti, "Comparison of Kernel Regression Model with a Polynomial Regression Model on Financial Data," Journal of Physics: Conference Series, The 2nd International Seminar on Science and Technology, 2021.
  15. Zaid Abd - Alrazak Al-Homsi, "Comparison among some Nonparametric Methods in Estimating Regression Models", Zarqa University, 2017 -
  16. Max Kohler, Anja Schindler, Stefan Sperlich, "A Review and Comparison of Bandwidth Selection Methods for Kernel Regression," ECONSTOR, Discussion Papers, No. 95, 2021.
  17. Zahra Nazari, "Density Based Support Vector Machines for Classification," International Journal of Advanced Research in Artificial Intelligence, Vol. 4, Issue 4, 2015. 18. Luis Torgo, "Kernel Regression Trees", University of Porto, 1999 -
  18. Marco Di Marzio, Charles C. Taylor, "On Boosting Kernel Regression," Volume 138, Issue 8, 2008, Pages 2483-2498.
  19. Parsazad Shafigh, Sadoghi Yazdi Hadi, Effati Sohrab, "Gravitation Based Classification," Information Sciences, Volume 220, 2013, Pages 319-330.
  20. Lizhi Peng, Bo Yang, Yuehui Chen, Ajith Abraham, "Data Gravitation Based Classification," Information Sciences, Vol. 179, Issue 6, 2009, Pages 809-819.
  21. Vladislav Polianskii, Florian T. Pokorny, "Voronoi Boundary Classification: A High-Dimensional Geometric Approach via Weighted Monte Carlo Integration," 36th International Conference on Machine Learning, 2019, Pages 9024-9035.

Article full text

Download PDF