Big Data Challenges: Data Analysis Perspective

Abstract

Big Data concern large-volume, growing data sets that are complex and have multiple, autonomous sources. Big Data are now rapidly expanding in all science and engineering domains with the fast development of networking and increase in the data storage and collection capacity. This paper reviews big data characteristics and challenges. In particular, we discuss big data variety, big data integration and cleaning, big data reduction, big data indexing and querying, and finally big data analysis and mining. We further focus on the challenges in big data analysis like heterogeneity, scale, timeliness, privacy and human collaboration; and present few real-world scenarios where these challenges are faced.