Empirical Studies and Analysis of Ensemble Learning Techniques in Data Mining

Authors

  • Bhavesh Patankar  Research Scholar, Department of Computer Science, Hemchandracharya North Gujarat University, Patan, Gujarat, India
  • Dr. Vijay Chavda  NPCCSM, Kadi Sarva VishwaVidyalaya, Gandhinagar, Gujarat, India

Keywords:

Ensemble, Boosting, Bagging, J48, Naïve Bayes

Abstract

This Classification using ensemble generally combines multiple classifiers that results in the improvement in the accuracy of the classification. Experimenting with the same dataset using the single classifier provides lesser accuracy than ensemble techniques. Many researches have been carried out using the technique of combining the predictions of multiple classifiers to generate a single classifier. The produced classifiers provide more accurate results than any individual classifier. This paper focuses on the ability of ensemble techniques to improve the accuracy of basic J48 algorithm. Ensemble techniques like Bagging and Boosting improved the efficiency of the J48 classifier. Experiments have been carried out on many datasets taken from UCI repository to investigate the effects of ensemble techniques on J48 and Naïve Bayes algorithm. WEKA tool is used to measure the effectiveness of a classifier model.

References

  1. Muhlbaier, Michael D., Apostolos Topalis, and Robi Polikar. "Learn. NC: combining ensemble of classifiers with dynamically weighted consult-and-vote for efficient incremental learning of new classes." IEEE transactions on neural networks 20.1 (2009): 152-168.
  2. Nishida, K. Y. O. S. U. K. E., and Koichiro Yamauchi. "Adaptive classifiers-ensemble system for tracking concept drift." 2007 International Conference on Machine Learning and Cybernetics. Vol. 6. IEEE, 2007.
  3. Li, Ming, and Zhi-Hua Zhou. "Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples." IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 37.6 (2007): 1088-1098.
  4. Zhao, Ying, Jun Gao, and Xuezhi Yang. "A survey of neural network ensembles." 2005 International Conference on Neural Networks and Brain. Vol. 1. IEEE, 2005.
  5. Dietterich, Thomas G. "Ensemble methods in machine learning."International workshop on multiple
  6. http://www.cs.waikato.ac.nz/ml/weka
  7. http://archive.ics.uci.edu/ml

Downloads

Published

2015-10-30

Issue

Section

Research Articles

How to Cite

[1]
Bhavesh Patankar, Dr. Vijay Chavda, " Empirical Studies and Analysis of Ensemble Learning Techniques in Data Mining , International Journal of Scientific Research in Science, Engineering and Technology(IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 2, Issue 5, pp.80-82, September-October-2016.