Challenges of integrating 'Big Data' with water industry operational data. Includes a Case Study using real time rainfall data

The emerging availably of 'Big Data' or large datasets represents a challenge for the water industry in terms of assimilating this data with the existing operational data. Existing IT systems and structures are not designed to cope with both the volume and velocity of these datasets. More importantly they do not have the data processing and analytics capabilities to process the data into a form that can readily be integrated into these IT systems and then used for real world applications and solutions. This paper presents a new IT platform that fills this void and uses a case study to demonstrate the flexibility and scalability of the platform.