Incremental and Iterative Mapreduce for Mining Evolving the Big Data in Banking System

Authors

  • Gayathri S A  Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
  • Preethi. M  Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
  • Shanmugapriya S  Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
  • Sivagami S  Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India

Keywords:

Big data, Mining, Map reduce, Hadoop, CBP, MRBGraph

Abstract

Big data is a broad term for datasets so large and complex that the traditional data processing applications are inadequate, so i2mapreduce based framework for incremental and iterative computations are done in big data. State level processing computation easily retrieve the data and also time consuming. Incremental and iterative mapreduce- mapreduce is the most widely used big data processing tool incremental processing is a promising approach to refresh the mining results. Use the same computation logic (update function) to process the data many times. The previous iteration’s output is the next iteration’s input, Stop when the iterated results converges to a fixed point. This concept using the online banking such as create account, withdraw, deposit and to get the details in a effective way. Finally, upload all the data to the cloud using AES algorithm. I2mapreduce is one step algorithm and four iterative algorithm with diverse computation characteristics. It is very secure to all the data are stored in binary format 0 and 1.

References

  1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters,” in Proc. 6th Conf. Symp. Opear. Syst. Des. Implementation, 2004, p. 10.
  2. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica, "Resilient distributed datasets: A fault-tolerant abstraction for, in-memory cluster computing,” in Proc. 9th USENIX Conf. Netw. Syst. Des. Implemen-tation, 2012, p. 2.
  3. R. Power and J. Li, "Piccolo: Building fast, distributed programs with partitioned tables,” in Proc. 9th USENIX Conf. Oper. Syst. Des.Implementation, 2010, pp. 1–14.
  4. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: A system for large-scale graph processing,” in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2010, pp. 135–146.
  5. S. R. Mihaylov, Z. G. Ives, and S. Guha, "Rex: Recursive, deltabased data-centric computation,” in Proc. VLDB Endowment, 2012, vol. 5, no. 11, pp. 1280–1291.
  6. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, and J. M. Hellerstein, "Distributed graphlab: A framework for machine learning and data mining in the cloud,” in Proc. VLDB Endowment, 2012, vol. 5, no. 8, pp. 716–727.
  7. S. Ewen, K. Tzoumas, M. Kaufmann, and V. Markl, "Spinning fast iterative data flows,” in Proc. VLDB Endowment, 2012, vol. 5, no. 11, pp. 1268–1279.
  8. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "Haloop: Efficient iterative data processing on large clusters,” in Proc. VLDB Endowment, 2010, vol. 3, no. 1–2, pp. 285–296.
  9. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox, "Twister: A runtime for iterative mapreduce,” in Proc.19th ACM Symp. High Performance Distributed Comput., 2010, pp. 810–818.
  10. Y. Zhang, Q. Gao, L. Gao, and C. Wang, "imapreduce: A distributed computing framework for iterative computation,” J. Grid Comput., vol. 10, no. 1, pp. 47–68, 2012.
  11. D. Peng and F. Dabek, "Large-scale incremental processing using distributed transactions and notifications,” in Proc. 9th USENIX Conf. Oper. Syst. Des. Implementation, 2010, pp. 1–15.
  12. D. Logothetis, C. Olston, B. Reed, K. C. Webb, and K. Yocum, "Stateful bulk processing for incremental analytics,” in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 51–62.

International Journal of Scientific Research in Science, Engineering and Technology

Downloads

Published

2017-12-31

Issue

Volume 2, Issue 2, March-April-2016

Section

Research Articles

License

Copyright (c) IJSRSET

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Gayathri S A, Preethi. M, Shanmugapriya S, Sivagami S, " Incremental and Iterative Mapreduce for Mining Evolving the Big Data in Banking System, International Journal of Scientific Research in Science, Engineering and Technology(IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 2, Issue 2, pp.496-501, March-April-2016.