Working as a pyspark developer

Worked as a Data Engineer

Worked as a SQL developer

During 2013, the Bank implemented a number of pilot projects to establish the value of taking a data-centric approach to business insight development and business process optimization. These projects, characterized by a combination of business Subject Matter Experts (SMEs) and experts in data analytics and data analytical technologies, worked with disparate production data sets (i.e. data sets lacking a unified schema) to identify patterns and other actionable insights in a timelier manner than traditional Information Technology (IT) data mining approaches. Based on the success of these pilots, the bank decided to set up a EAP-SDL Data Platform to provide full lifecycle support to internal clients wishing to leverage data analytic techniques in their domains. EAP is a Big Data solution leveraging the Hadoop framework and related tools to achieve its core functionality of being able to acquire, store and process large amounts of data from disparate sources. EAP-SDL Data Platform intends to provide the following functions: Discover: provides a mechanism to search what data exists in the platform On-board: provides a means to acquire new data from external sources Process: provide means to define validation and transformation rules and process raw data Access: provide means to access data via a web and/or SQL like interface Manage: provides a means to define access permissions, monitor and run the bank activities