Empirical Studies and Analysis of Ensemble Learning Techniques in Data Mining
Keywords:
Ensemble, Boosting, Bagging, J48, Naïve BayesAbstract
This Classification using ensemble generally combines multiple classifiers that results in the improvement in the accuracy of the classification. Experimenting with the same dataset using the single classifier provides lesser accuracy than ensemble techniques. Many researches have been carried out using the technique of combining the predictions of multiple classifiers to generate a single classifier. The produced classifiers provide more accurate results than any individual classifier. This paper focuses on the ability of ensemble techniques to improve the accuracy of basic J48 algorithm. Ensemble techniques like Bagging and Boosting improved the efficiency of the J48 classifier. Experiments have been carried out on many datasets taken from UCI repository to investigate the effects of ensemble techniques on J48 and Naïve Bayes algorithm. WEKA tool is used to measure the effectiveness of a classifier model.
References
- Muhlbaier, Michael D., Apostolos Topalis, and Robi Polikar. "Learn. NC: combining ensemble of classifiers with dynamically weighted consult-and-vote for efficient incremental learning of new classes." IEEE transactions on neural networks 20.1 (2009): 152-168.
- Nishida, K. Y. O. S. U. K. E., and Koichiro Yamauchi. "Adaptive classifiers-ensemble system for tracking concept drift." 2007 International Conference on Machine Learning and Cybernetics. Vol. 6. IEEE, 2007.
- Li, Ming, and Zhi-Hua Zhou. "Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples." IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 37.6 (2007): 1088-1098.
- Zhao, Ying, Jun Gao, and Xuezhi Yang. "A survey of neural network ensembles." 2005 International Conference on Neural Networks and Brain. Vol. 1. IEEE, 2005.
- Dietterich, Thomas G. "Ensemble methods in machine learning."International workshop on multiple
- http://www.cs.waikato.ac.nz/ml/weka
- http://archive.ics.uci.edu/ml
Downloads
Published
Issue
Section
License
Copyright (c) IJSRSET

This work is licensed under a Creative Commons Attribution 4.0 International License.