Incremental and Iterative Mapreduce for Mining Evolving the Big Data in Banking System

Authors(4) :-Gayathri S A, Preethi. M, Shanmugapriya S, Sivagami S

Big data is a broad term for datasets so large and complex that the traditional data processing applications are inadequate, so i2mapreduce based framework for incremental and iterative computations are done in big data. State level processing computation easily retrieve the data and also time consuming. Incremental and iterative mapreduce- mapreduce is the most widely used big data processing tool incremental processing is a promising approach to refresh the mining results. Use the same computation logic (update function) to process the data many times. The previous iteration’s output is the next iteration’s input, Stop when the iterated results converges to a fixed point. This concept using the online banking such as create account, withdraw, deposit and to get the details in a effective way. Finally, upload all the data to the cloud using AES algorithm. I2mapreduce is one step algorithm and four iterative algorithm with diverse computation characteristics. It is very secure to all the data are stored in binary format 0 and 1.

Authors and Affiliations

Gayathri S A
Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
Preethi. M
Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
Shanmugapriya S
Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India
Sivagami S
Information Technology, Velammal Institute of Technology, Chennai, Tamilnadu, India

Big data, Mining, Map reduce, Hadoop, CBP, MRBGraph

  1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters,” in Proc. 6th Conf. Symp. Opear. Syst. Des. Implementation, 2004, p. 10.
  2. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica, "Resilient distributed datasets: A fault-tolerant abstraction for, in-memory cluster computing,” in Proc. 9th USENIX Conf. Netw. Syst. Des. Implemen-tation, 2012, p. 2.
  3. R. Power and J. Li, "Piccolo: Building fast, distributed programs with partitioned tables,” in Proc. 9th USENIX Conf. Oper. Syst. Des.Implementation, 2010, pp. 1–14.
  4. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: A system for large-scale graph processing,” in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2010, pp. 135–146.
  5. S. R. Mihaylov, Z. G. Ives, and S. Guha, "Rex: Recursive, deltabased data-centric computation,” in Proc. VLDB Endowment, 2012, vol. 5, no. 11, pp. 1280–1291.
  6. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, and J. M. Hellerstein, "Distributed graphlab: A framework for machine learning and data mining in the cloud,” in Proc. VLDB Endowment, 2012, vol. 5, no. 8, pp. 716–727.
  7. S. Ewen, K. Tzoumas, M. Kaufmann, and V. Markl, "Spinning fast iterative data flows,” in Proc. VLDB Endowment, 2012, vol. 5, no. 11, pp. 1268–1279.
  8. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "Haloop: Efficient iterative data processing on large clusters,” in Proc. VLDB Endowment, 2010, vol. 3, no. 1–2, pp. 285–296.
  9. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox, "Twister: A runtime for iterative mapreduce,” in Proc.19th ACM Symp. High Performance Distributed Comput., 2010, pp. 810–818.
  10. Y. Zhang, Q. Gao, L. Gao, and C. Wang, "imapreduce: A distributed computing framework for iterative computation,” J. Grid Comput., vol. 10, no. 1, pp. 47–68, 2012.
  11. D. Peng and F. Dabek, "Large-scale incremental processing using distributed transactions and notifications,” in Proc. 9th USENIX Conf. Oper. Syst. Des. Implementation, 2010, pp. 1–15.
  12. D. Logothetis, C. Olston, B. Reed, K. C. Webb, and K. Yocum, "Stateful bulk processing for incremental analytics,” in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 51–62.

Publication Details

Published in : Volume 2 | Issue 2 | March-April 2016
Date of Publication : 2017-12-31
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 496-501
Manuscript Number : IJSRSET1622130
Publisher : Technoscience Academy

Print ISSN : 2395-1990, Online ISSN : 2394-4099

Cite This Article :

Gayathri S A, Preethi. M, Shanmugapriya S, Sivagami S, " Incremental and Iterative Mapreduce for Mining Evolving the Big Data in Banking System, International Journal of Scientific Research in Science, Engineering and Technology(IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 2, Issue 2, pp.496-501, March-April-2016.
Journal URL : http://ijsrset.com/IJSRSET1622130

Article Preview