Data strategy, architecture, and implementation of a Data Lake for insurance company

Challenge

Implementation of a Data Lake for the European countries, compliant with all financial and insurance regulations, including as well the components like authentication, authorization, Data encryption@rest and in transit, SSL, and enterprise IT security for productive deployments. In the scope for the implementation were as well the integration of 3rd party components such as Informatica, Attunity Replicate/CDC and IBM Tivoli Scheduler, as well as the enablement and support for the implementation of Use Cases.

Solution

Zurich Insurance Group uses AI/ML and Data Lake technologies to improve their services and to create new, innovative data products. 

The scope for the Data Lake project included the design, architecture, and implementation of Data Lake environments for Development / Research / Integration / UAT / Production. The deployment was largely automated with Ansible, including the required security components. The integration of Informatica and Attunity for data ingestion was successfully carried out together with the internal teams. In addition, scheduled jobs were implemented via the IBM Scheduler to run regular data processing tasks. Corresponding multi-tenant approaches to comply with governance have been developed for data storage in HDFS and Hive and implemented in all Data Lake environments.

The Zurich Insurance Group colleagues received from Scigility as well training and know-how transfer, both remotely and on site.