User:Dipto1/sandbox

Big Index

This article is about collections of metadata a.k.a “data about the data”.

Big Index is a term for collection of metadata that is complex and it transcends beyond Big Data. Big Index is the glue that holds facets of Big Data together and helps in traversing its complex chain of attributes to allow for operations like search, share and analysis.

Big Index differs from conventional Big Data in its obscure nature and its growth trend that is distinctly different from Big Data. Just as majority of Big Data stems from user-generated unstructured data, Big Index grows out of usage of Big Data. As data is mined, the tacit knowledge beyond the direct attributes helps drive the Big Index of Big Data ecosystem.

Big Index is difficult to work with directly with using conventional database management, statistical tools and even with Hadoop-like infrastructures.

Big Index was first referenced in research and development efforts by Dipto Chakravarty and Jon Bultmeyer in October 2011 during their investigations of user identity and security management from the cloud, to the cloud and in the cloud.