Our data experts examined the current data systems being used, and after a thorough analysis of the client’s requirements they recommended the following approach.
- i2e built a customized data aggregator tool to pull the data from the central data lake and perform seamless data aggregation, packaging and integration, all the while following the rules and parameters set by the central monitoring team.
- The tool was the client’s first ever internally validated tool which was built in a record time of 5 months against the initial estimated 12 months' time. Built a streamlined testing cycle which allowed for 10-15 iterations in just a week, significantly improving the response time.
- The previous data aggregator tool used Spotfire to build the front-end UI, which was not ideal and required an additional licensing cost for each access control. The team-built a custom web-based tool to build an intuitive form for the team to punch in requests.
- Since there was a vision to move completely to the new data lake being built on Databricks – the team was also looking to move beyond SAS programming to Python
It also minimized the manual work needed by the team whenever any additional information outside the purview of the zip files is requested. – with plans to completely eliminate it in the upcoming releases.