Pattern Based Filtering Approach for Big Data Application

Abstract

Now a days large Number of services are emerging on the Internet due to various social networking sites, services, cloud computing. Result of this is, service-relevant data become too big to be effectively processed by traditional approaches. Similarly growing technologies like Internet of Things is also responsible for generation of massive raw data and this is reason complexity and resource consumption increases. In this paper the system suggest the concept of pattern based filtering in which it automatically discovers new, hidden or unsuspected data from the large text collection. The propose model MPBTM consist of topic distribution describing topic preference of each collection of document and Pattern-based topic representation.