Project Name: Citi Bank-FDR-Ingestion

Role:                                      Sr. Associate Technology/ Sr. Data Engineer

Duration:                             Dec 2019 – Till Date

Domain:                               Private Banking & Finance

Technologies:                    Spark, Kafka, Sqoop, HBase, Gemfire, Scala-test, Mockito, Autosys

Language:                           Scala, Java

Tool:                                      BitBucket, Jira, Git, HP ALM, Intellij

Database:                            Oracle, MS SQL Server, Hbase, Gemfire

Projects Details – Citi Bank is one of the leading banks. It has Citi Private Banking (CBP) which manages customer’s assets. CBP aims to migrate its existing applications to Bigdata Technologies.

Responsibilities -

• Developing efficient Spark-Scala code for Oracle-HBase-Gemfire data ingestion and loading.
• Developed several new modules such as Data Purge and Data Reinstate.
• Developed full data pipeline for GDPR compliance.
• Performed several PoC such as Error validation on file data and adding in new columns, utility of using HBase/Hive in project.
• Developing utility applications such as Clearing Gemfire Region, Gemfire data validation, delete the Gemfire records etc.
• Working on defects or bugs raised in different environments.

Project Name: Nordea Bank-Fund Distribution Platform–Quarterly Statement and Cost & Charges.

Role:                                      Software Engineer/Data Engineer

Duration:                             Sept 2018 – Till Date

Domain:                               Asset Management Company

Technologies:                    Hadoop, Hive, Sqoop, Spark, AWS S3

Language:                           Scala, Java, JUnit, Mockito

Tool:                                      BitBucket, Jira, Git, HP ALM

Database:                            Oracle, MS SQL Server, Hbase

Projects Details – Nordea Bank is one of the leading banks of Nordic region. It has fund distribution platform (FDP) which manages customer’s asset such as bond, fund, equities etc. FDP is now has to comply with the new European Union regulation’s i.e. MIFID1 & MIFID2. The major work has to be done in for tocustomer  receive quarterly statement and daily statement in case of loss reaching 10% threshold for any holding. Customer has to receive Cost & Charges statement on a monthly & annual basis. Cost & Charges include various charges that levy on a product and its service.

Responsibilities -

• Developed data ingestion, preprocess, post ingestion process for various sources (Mainframe and Oracle) into Data Lake using Sqoop.
• Developing Data Preparator, Data Calculator and Data Aggregator using Spark and Java/Scala.
• Inserted Overwriting the HIVE data with Hbase data daily to get fresh data every day and used Sqoop to load data from Oracle.
• Handing and Processing of large datasets from different data sources using Spark with Scala.
• Performing the Data Verification and Data Validation with Business.

Project Name: Citi Bank-FIF

Role:                                      Sr. Associate Technology/ Sr. Data Engineer/Independent Contributor

Duration:                             Dec 2019 – Till Date

Domain:                               Private Banking & Finance

Technologies:                    Spark, Sqoop, Hive, HBase, Autosys, Ab Initio

Language:                           Scala, Java

Tool:                                      BitBucket, Jira, Git, HP ALM, Intellij, MS Excel

Database:                            Oracle, MS SQL Server, Hbase

Projects Details – Citi Bank is one of the leading banks. It has Citi Private Banking (CBP) which manages customer’s assets. CBP aims to migrate its existing applications to Bigdata Technologies. The major focus of migration is from AbInitio to Spark Application.  Existing application was, in nutshell, was data aggregation and data reporting application.

Responsibilities -

• Developing efficient Spark-Scala Application for Metadata Driven Development Application.
• Independently working on module for Position for PP including development & Testing.
• Identifying & analyzing the transformation from Ab-initio Graph.
• Implementing the End to End Data Pipeline in Spark-Scala.
• Implemented the Data Validation and Error Handling Framework.

Responsible for the resolving the Production/UAT Defects & coordinating with UAT/Prod Team.