About Me
Hi
Have 6+ yrs experience in asp.net, C#, sql server, pl-sql , SSRS etc. And 3+ yrs Exp in Bigdata hadoop hive,sqoop,spark,scala, spark Streaming. Having Knowlege of multiple beusiness domain.
... Show MoreSkills
Software Engineering
Web Development
Data & Analytics
Database
Operating System
Programming Language
Others
Development Tools
Portfolio Projects
Company
Big Data Lake , Realtime Dashboard and Analysis,UPI fraud,GNOME,BIG-Query
Description
Description :
- Involved in all phases of Software Development Life Cycle (SDLC).
- Designed Hadoop architecture and Install Hadoop cluster of 25 Node.
- Development and Implemented Logic for Real Time UPI Fraud detection Flume-Kafka-Spark Streaming-Hive.
- Used Spark with scala and pyspark for different rules for suspicious transactions detection.
- Implemented Lambda architecture using spark scala.
- Migrated existing RDBMS Data Marts to HADOOP using sqoop import into Hive tables.
- Provided Solutions for migrating existing RDBMS PLSQL to hadoop ,python spark
- Prepared Datasets for analytical use case.
- Created Hive tables and wrote Hive queries using Hive QL.
- Managed data ingestion from different sources like RDBMS,flatfile.
Skills
Apache Flume Apache-Kafka Apache Spark Hadoop Python Real Time Stream Processing Scala Stream ProcessingTools
Eclipse Programmer’s NotepadCompany
Loyalty Rewards
Description
- Created Data model for Hive tables.
- Created Hive tables and wrote Hive queries using Hive QL
- Responsible to manage data coming from different sources
- Monitoring the running MapReduce programs on the cluster.
- Responsible for loading data from Linux file systems to HDFS.
- Used MR Unit and Junit for unit testing.
- Monitored System health and logs and responded accordingly to any warning or failure conditions.
Skills
.NET Core C Sharp MVC Framework SQL Web ServicesTools
Eclipse Programmer’s NotepadCompany
LEMS (L&T),Islamic banking, Infranet
Description
- Involved in all phases of Software Development Life Cycle (SDLC).
- Coordinated with business customers to gather business requirements. And also interacted with other technical peers to derive Technical requirements.
- Worked on Installing and configuring MapReduce, HDFS and developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Developed java based mapreduce programs for custom processing
- Wrote Hive UDFs in Java where the functionality is too complex.
- Used Pig (PigLatin) scripts for ad-hoc data retrieval
- Created Data model for Hive tables.
- Created Hive tables and wrote Hive queries using Hive QL
- Imported and exported data into HDFS and HIVE using Sqoop
- Responsible to manage data coming from different sources
- Monitoring the running MapReduce programs on the cluster.
- Responsible for loading data from Linux file systems to HDFS.
- Used MR Unit and Junit for unit testing.
- Monitored System health and logs and responded accordingly to any warning or failure conditions.
- Performance tuning, Query optimization in Sql server and oracle PL-SQL.
- Development and Managing SSRS Reports,SSIS Package, Stored procedure ,Functions.
Tools
Programmer’s NotepadCompany
Stock management Application
Description
Details: This Project was all about Product Management & Finance. In this project we had maintain stock management as per users requirement, so user can easily track the diamonds status from manufacturing to sell. Managing Windows Server and Database Server with large database for domestic level.We developed same product for international use.
We developed stored procedure,functions,triggers,ETL. We developed and maintaining the database
Roles and Responsibilities:
Coordinate with the User for their requirement.
Coordinate with the Technical Director on current programming tasks.
Quickly produce well-organized, optimized, and documented source code.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Worked independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show LessTools
Programmer’s NotepadCompany
Diamonds stock management
Description
Details:This Project is all about Product Management &Finance. In this project we have maintain stock management as per order of “Diamonds”, so user can easily track the diamonds status from manufacturing to sell.Managing Windows Server and Database Server with large database for domestic level.We developed same product for international use.
We developed stored procedure,functions,triggers,ETL. We developed and maitaing the datatbase.To Provide Complex reports to BI team as per requests in given format.
Enhancement of the existing reporting system for business users.
Developed complex stored procedures and functions.
Designed and developed database tables, triggers, cursors, indexes.
Debugging of the procedures, functions and triggers in a module.
Roles and Responsibilities:
Coordinate with the User for their requirement.
Coordinate with the Technical Director on current programming tasks.
Collaborate with other programmers to design and implement features.
Quickly produce well-organized, optimized, and documented source code.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Work independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show LessTools
Programmer’s NotepadCompany
RRM, KonarkBiocare, VirajMultitrade
Description
1)Working as a programmer to develop the site for client
2)Developed Store procedure.
Roles and Responsibilities For All MLM Projects:
Coordinate with the User for their requirement.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Work independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show Less
Tools
Programmer’s Notepad