2.1. Big Data Hubris

When we have large amounts of administrative data or expansive digital traces, it can be tempting to treat them as more definitive than data collected from traditional smaller research studies. We might even consider these large datasets as a replacement for scientific studies or as a census. This over-reach is referred to as the “big data hubris” [Lazer et al., 2014]. However, data with a large scope does not imply that we can ignore foundational issues of how representative the data are, nor can we ignore issues with measurement, validity, dependency, and reliability (these terms are defined more precisely later). One well-known example is the Google Flu Trends tracking system.

2.1.2. New Opportunities

The tremendous increase in openly available data has created new roles and opportunities. For example, a data journalist looks for interesting stories in ‘found’ data, much like how traditional beat reporters hunt for news stories. The data life cycle for the data journalist begins with the search for existing data that might have an interesting story, rather than beginning with a research question and looking for how to collect new or use existing data to address the question.

Citizen science projects are another example. They engage many people (and instruments) in data collection. Collectively, these data are made available to researchers who organize the project and often they are made available in repositories for anyone to further investigate.

The availability of administrative data creates yet another opportunity. Researchers can link data collected from scientific studies with, say government or medical data that has been collected for government or business purposes; i.e., these data were collected for reasons that don’t directly stem from the question of interest. Such linkages can help researchers expand the possibilities of their analyses and cross-check the quality of their data. Administrative data can include digital traces, such as the study of an online social network, and can be quite complex.

In all of these examples, a key factor to keep in mind is the scope of the data, including the connections between the data, the topic of investigation, and the question being asked. Understanding this framework can help us avoid answering the wrong question, applying inappropriate methods to the data, and overstating our findings. In the age of Big Data, we are tempted to deal with this dilemma by collecting and analyzing ever more data. After all, a census gives us perfect information so shouldn’t big data be nearly perfect? This is the topic of the next section.

Note: Later, in the ch:quality chapter, we consider the quality of the data collected in terms of how the information is coded, transformed, cleaned and prepared for analysis.