Responsibilities as Dev-Ops Lead:
1. Worked on a POC in Blockchain using Hyperledger Fabric and Smart Contracts
2. Worked on a POC for IBM S3 Cloud Object Storage to evaluate push and pull performance for terabytes of data.
3. Worked on development of shell scripts to push data to S3 cloud Object Storage for the datalake data reduction project.
4. Worked on the development of ingestion jobs to ingest data from RDMS databases like SQL server, Teradata, DB2,MY SQL etc using SQOOP and storing the data in hive tables.
5. Worked on Hive partitioning and bucketing extensively to optimize the time for analytics.
6. Worked on the development of file ingestion projects.
7. Worked extensively to create external tables in a volume pointing to the data which is present in a different name space volume which is being ingested by a some other tenant in the same cluster.
8. Worked on to optimize the ingested data storage using different file formats like Avro, Parquet and ORC.
9. Worked on optimizing of SQOOP ingestion jobs in order to minimize the job execution time.
10. Involved in analysis and feasibility study of new upcoming Big Data tools like BDROID and ATSCALE for reporting purposes.
11. Working closely with the Business Analyst (BA) for the requirement gathering and preparation of Business Requirement Document(BRD).

Responsibilities as Module Lead:
1. Creating Hive tables as per the requirement where Internal or External tables defined with appropriate Static and Dynamic partitions, intended for efficiency.
2. Optimization of hive joins by applying SMBM (Sort Merge Bucket map) join.
3. Loaded the customer claims information, billing information etc. into HDFS using SQOOP.
4. Developed SQOOP scripts to ingest data into Hive tables from MySQL Database.
5. Monitoring the Production and Non-Production jobs and resolving the issues in case of job failures.

Description:

The Prepaid Activations system originally consisted of a be-spoke Oracle 11g database hosted on a UNIX server. But, later, a web based activation system was developed to
assist in the activation process. The database had various truth tables through which the business validations were performed using PL/SQL packages and other database constructs. The interacting system was Oracle Fusion Middleware wherein the DB callouts were made for validations and event registration.

Responsibilities:

1. Analyzing the client requirements and suggesting means to implement the changes as per the business logic.
2. Designing the most feasible solution for implementation of the change requests.
3. Developing scripts for creation of tables, views, synonyms, indexes, etc as per the solution design.
Technologies used: Oracle 11g, Oracle PL/SQL, Unix Shell Scripting
Tools used: Toad, Putty, Win SCP, HP Service Manager

Description:

The De-duplication system was basically a reporting system which was used for generating reports for legal agencies (TRAI, DOT, etc.). The application was primarily designed to cater to the ad-hoc reporting requirements as part of audits. The data pumping in the database was done from two source system and the data obtained from them had to be merged so that the result had all required fields. Removing the redundant and junk data was a major challenge and the scripts had to be intelligent enough to cater all such business requirements.

Responsibilities:

1. Developing scripts for creation of tables, views, m-views, synonyms, indexes, etc as per the logical design.
2. Designing test cases for performing unit testing of the database objects developed.
3. Successfully rolled out the new application PAN India and won several appreciations from senior leaders of the client.
Technologies used: Oracle 11g, Oracle PL/SQL, Unix Shell Scripting
Tools used: Toad, Tortoise SVN, Putty, Win SCP