Big Data: What Could Go Wrong and What We Need to Do About It
The problem is way more complex than has been presented, and the stakes couldn’t be higher. To help you make better sense of your data and prepare for the future, I’ll address a number of #BigData challenges that have to be solved before we can say we have learned everything we can about our data – and taken all the steps we need to protect ourselves and others. First, some assumptions: 1. Network performance is not going to exceed data collection sizes, so we likely cannot move all the data to one place. 2. Given the declining Kryder rate, storage costs are not decreasing at rates seen in previous decades. With those two limitations in mind, what are the challenges for understanding, learning and making decisions from all the data we are collecting?