About Me

Over 7 years of Total IT professional experience includes requirements gathering, data analysis, design, development, testing various modules, deployments and documentation. Hands on experience in various big data application phases like data ingesti...ents and documentation. Hands on experience in various big data application phases like data ingestion, data analytics and data visualization. Hands on experience in solutions for big data using Hadoop, HDFS, Spark, Scala, Python, Hive, Sqoop. Excellent knowledge on Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm and monitoring systems. Good understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, Spark ML lib. Experienced in Developing Spark programs in Scala and Java APIs. Written RDD transformations, Actions, Data Frames, case classes for the required input data and performed the data transformations. Expertise in using Spark-SQL and Hive QL, join operations, Hive UDFs, partitions, bucketing and internal/external tables and using with various data sources like XML, , Parquet and ORC. Good knowledge about using Test Fun Suites for testing the code in Test Data Driven (TDD) model. Worked on version control tools like Gerrit, Endevor. Imported data from AWS S3 into Spark RDD, Performed transformations and actions on RDDs. Extensive experience in Extraction, Transformation, Loading (ETL and ELT) data from various sources into Data Warehouses and Data marts with industry best practices. Hands on experience in building shell scripts (UNIX). Very good understanding with implementations in building data warehousing and data marts with OLTP vs. OLAP, star vs. snow flake schema, normalization vs. de-normalization methods. Very good at SQL, data analysis, unit testing, debugging data quality and performance issues. 10 Months of Onsite Experience in dealing directly with the Client (Qantas Airways, Australia) and have performed roles like Analyst, developer and lead. Has 5 Years of experience in Airlines and more than 2 Years in Banking Domain. Excellent communication, creative, technically competent, problem solving and leadership skills. Focus on customer satisfaction and drive results by being team player and individual contributor with good collaboration skills as well.