Now you can Instantly Chat with Mangesh!
About Me
Over 9 years of experience in software design, development and maintenance in Big Data, Hadoop ecosystem, asp.net C# web application and development. 3 years of exclusive experience in Hadoop and its components HDFS, Spark,Flume,Kafka, Map Reduce, Im...
Show MoreSkills
Portfolio Projects
Description
Description :
- Involved in all phases of Software Development Life Cycle (SDLC).
- Designed Hadoop architecture and Install Hadoop cluster of 25 Node.
- Development and Implemented Logic for Real Time UPI Fraud detection Flume-Kafka-Spark Streaming-Hive.
- Used Spark with scala and pyspark for different rules for suspicious transactions detection.
- Implemented Lambda architecture using spark scala.
- Migrated existing RDBMS Data Marts to HADOOP using sqoop import into Hive tables.
- Provided Solutions for migrating existing RDBMS PLSQL to hadoop ,python spark
- Prepared Datasets for analytical use case.
- Created Hive tables and wrote Hive queries using Hive QL.
- Managed data ingestion from different sources like RDBMS,flatfile.
Description
- Created Data model for Hive tables.
- Created Hive tables and wrote Hive queries using Hive QL
- Responsible to manage data coming from different sources
- Monitoring the running MapReduce programs on the cluster.
- Responsible for loading data from Linux file systems to HDFS.
- Used MR Unit and Junit for unit testing.
- Monitored System health and logs and responded accordingly to any warning or failure conditions.
Description
- Involved in all phases of Software Development Life Cycle (SDLC).
- Coordinated with business customers to gather business requirements. And also interacted with other technical peers to derive Technical requirements.
- Worked on Installing and configuring MapReduce, HDFS and developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Developed java based mapreduce programs for custom processing
- Wrote Hive UDFs in Java where the functionality is too complex.
- Used Pig (PigLatin) scripts for ad-hoc data retrieval
- Created Data model for Hive tables.
- Created Hive tables and wrote Hive queries using Hive QL
- Imported and exported data into HDFS and HIVE using Sqoop
- Responsible to manage data coming from different sources
- Monitoring the running MapReduce programs on the cluster.
- Responsible for loading data from Linux file systems to HDFS.
- Used MR Unit and Junit for unit testing.
- Monitored System health and logs and responded accordingly to any warning or failure conditions.
- Performance tuning, Query optimization in Sql server and oracle PL-SQL.
- Development and Managing SSRS Reports,SSIS Package, Stored procedure ,Functions.
Description
Details: This Project was all about Product Management & Finance. In this project we had maintain stock management as per users requirement, so user can easily track the diamonds status from manufacturing to sell. Managing Windows Server and Database Server with large database for domestic level.We developed same product for international use.
We developed stored procedure,functions,triggers,ETL. We developed and maintaining the database
Roles and Responsibilities:
Coordinate with the User for their requirement.
Coordinate with the Technical Director on current programming tasks.
Quickly produce well-organized, optimized, and documented source code.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Worked independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show LessDescription
Details:This Project is all about Product Management &Finance. In this project we have maintain stock management as per order of “Diamonds”, so user can easily track the diamonds status from manufacturing to sell.Managing Windows Server and Database Server with large database for domestic level.We developed same product for international use.
We developed stored procedure,functions,triggers,ETL. We developed and maitaing the datatbase.To Provide Complex reports to BI team as per requests in given format.
Enhancement of the existing reporting system for business users.
Developed complex stored procedures and functions.
Designed and developed database tables, triggers, cursors, indexes.
Debugging of the procedures, functions and triggers in a module.
Roles and Responsibilities:
Coordinate with the User for their requirement.
Coordinate with the Technical Director on current programming tasks.
Collaborate with other programmers to design and implement features.
Quickly produce well-organized, optimized, and documented source code.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Work independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show LessDescription
1)Working as a programmer to develop the site for client
2)Developed Store procedure.
Roles and Responsibilities For All MLM Projects:
Coordinate with the User for their requirement.
Debug existing source code and polish feature sets.
Contribute to technical design documentation.
Work independently when required.
Continuously learn and improve skills.
Attention to detail is essential and all tasks must be carried out to the highest standard.
Show More Show LessDescription
Working as a programmer to develop the site for client This Project is all about Product Management &Finance. In this project we have maintain stock management as per order of Diamonds, so user can easily track the diamonds status from manufacturing to sell.Managing Windows Server and Database Server with large database for domestic level.We developed same product for international use. We developed stored procedure,functions,triggers,ETL. We developed and maitaing the datatbase.To Provide Complex reports to BI team as per requests in given format. Enhancement of the existing reporting system for business users. Developed complex stored procedures and functions. Designed and developed database tables, triggers, cursors, indexes. Debugging of the procedures, functions and triggers in a module.
Show More Show LessDescription
Working as a programmer to develop the site for client This site is about Product Management. Its just like a portal for user where user can create own users for product management. Also main user can create own vender for purchase and customer for product sale. Below All This site also same MLM company. I have created module fordown listed.
Show More Show Less