Michele Pasin / Quotes

When you can, keep everything

A common use of big data processing is to take unstructured data and extract ordered meaning, for consumption either by humans or as a structured input to an application. One such example is entity resolution, the process of determining exactly what a name refers to. Is this city London, England, or London, Texas? By the time your business logic gets to it, you don't want to be guessing.

The process of moving from source data to processed application data involves the loss of information. When you tidy up, you end up throwing stuff away. This underlines a principle of big data: when you can, keep everything. There may well be useful signals in the bits you throw away. If you lose the source data, there's no going back.

Saved 26 February 2013 / radar.oreilly.com ↗

#unstructured-data #big-data

Data lake

The idea of data lake is to have a single store of all data in the enterprise ranging from raw data (which implies exact copy of source system data) to…

Data Lake - Wikipedia, The Free Encyclopedia #unstructured-data

Big Data and the bureaucratization of life

As technology and Big Data advance, they enable the near-total bureaucratization of life—despite the fact that the promise of technology was exactly the…

Beyond Zero and One (Andrew Smart) #big-data #technology #jobs #work