Big Data and the changing Web

It’s become clear in the past few years that few technologies live in a vacuum. They’re more likely to be connected or related and sharing data, which is why it’s always better to think of the enterprise holistically rather than in silos. (Imagine how much more efficiently the federal government would run if it stored  one  record  of  each  citizen,  rather  than  one  at  the  Internal  Revenue Service, another at the Social Security Administration, another at the Transportation Security Administration, and so on.Similarly, the close sibling of analytics, big data, also feeds off the Internet of Things.The explosion of big data is testing the capabilities of even the most advanced analytics tools. IT is challenged by the sheer volume, variety, and velocity of this  flood  of  complex,  structured,  semi  structured,  and  unstructured  data—which also offers organizations exciting opportunities to gain richer, deeper and more accurate insights into their business. IDC described intelligent systems as those enabled with high-performance microprocessors, connectivity, and high level  operating  systems.  Embedded  processors  no  longer  perform  as  fixed functions that stand alone, but pack computer performance and integration into devices that fuel intelligent systems. Combined with cloud-based applications and analytics capabilities, these intelligent systems can derive value from edge data and bring the Internet of Things (IoT) to reality.For the hundreds of petabytes of data generated by intelligent systems and sensors, it’s too expensive and  inefficient to move them to a central cloud.An  expanding  wealth  of  ubiquitous,  heterogeneous,  and  inter  connected embedded devices is behind most of the exponential growth of the  “Big Data”phenomenon. Meanwhile, the same embedded devices continue to improve in  terms  of  computational  capabilities,  thus  closing  the  gap  with  more traditional computers. Big data is a game changer—and it’s already here.While most of the momentum around big data today is around social media sources, it is believed that realizing the promise of big data analytics must include a way to harness the potential of big data from intelligent systems and sensors.