Now you can Instantly Chat with Suraj!
About Me
7+ years of experience in data analytics with renowned MNCsExperienced Data Engineer with a demonstrated history of working in Telecom, Supply Chain, HCM,and Advertising domainExcellent understanding of Big data stack. Expertise on Spark, Hadoop and ...HCM,and Advertising domainExcellent understanding of Big data stack. Expertise on Spark, Hadoop and its ecosystemcomponentsExperience on AWS cloud platform and its services including EC2, ECS, DynamoDB, SNS, RDS,Secret Manager, S3 etc.Implemented Airflow for various types of DAGs for Telecom data.Worked on preprocessing of structured and unstructured data & implemented various DatabasedesignsWorked on identification of valuable data sources and automation of the collection processesExperience on various migration projects to migrate the legacy systems to big data systems(Hadoop, Spark, Azure Data Bricks, S3)Proficient in Python & Scala programming and worked on NoSQL Databases (Dynamo DB, HBase,MongoDB)
Show MoreSkills
-
-
-
-
-
-
- 5 Years
Advanced
-
-
-
- 5 Years
Advanced
-
- 5 Years
Advanced
-
-
-
-
-
-
-
-
- 4 Years
Advanced
-
- 5 Years
Intermediate
-
-
-
- 5 Years
Advanced
-
-
- 5 Years
Advanced
-
-
-
-
-
-
-
-
- 3 Years
Advanced
-
-
-
- 4 Years
Advanced
-
-
- 7 Years
Expert
-
-
-
-
- 3 Years
Intermediate
-
- 4 Years
Intermediate
-
-
- 1 Years
Beginner
-
- 6 Years
Advanced
-
- 1 Years
Intermediate
-
-
-
- 4 Years
Advanced
-
- 4 Years
Intermediate
-
- 5 Years
Advanced
-
-
-
-
- 2 Years
Intermediate
-
-
-
-
-
-
-
- 7 Years
Intermediate
-
-
-
-
- 3 Years
Advanced
-
- 7 Years
Expert
-
-
- 2 Years
Beginner
-
-
-
- 2 Years
Intermediate
-
-
- 1 Years
Beginner
-
-
-
-
-
-
- 3 Years
Advanced
-
-
-
-
-
-
-
-
-
-
-
- 2 Years
Advanced
-
-
-
- 2 Years
Intermediate
-
Positions
Portfolio Projects
Description
- Working in Data Engineer group, extracting, ingesting, transforming Ad Marketing, Telecom, Logistics data to be consumed by downstream teams
- Developed flow to migrate the data from 50+ sources to AWS S3 using python scripts
- Responsible for building and supporting a Big Data-based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data.
- Managing a team of 4 people and assigning day to day tasks to them.
- Validating migrated data, performing data quality checks, implementing CI/CD and orchestration using Jenkins, Terraform, Docker etc.
- Reviewing code/providing feedback relative to best practices, performance improvements etc. and work in the pair-programming environment also
- Developed NLP model for sentimental Analysis on twitter data (Logistic Regression).
Description
- Developed a framework to migrate the data from different legacy sources to HDFS and using SSIS and T-SQL to process further
- Lead a project with 5 people for a PAN India implementation of an invoicing tool for Reliance Communication which improved efficiency in invoicing by 70% and saved 2430 man-hours monthly
- Introduced big data analytics to automate the generation of 250 reports per month catering from Engineer to CEO
- Assist application development teams during application design and development for highly complex and critical data projects
- Involved in POCs to adopt new technologies to improve data platform management in large scale with high throughput
Verifications
-
Profile Verified
-
Phone Verified
Preferred Language
-
English - Fluent
Available Timezones
BROWSE SIMILAR DEVELOPER
-
KULJIT S
Corporate Mgmt. – PMG, HR, legal, MIS/ERP
-
Menashe B
Mule ESB / Anypoint Platform / API-led Architecture / Integration Expert
-
Tommy L
Senior System Software Engineer
-
Ray G
Jack of all trades, master of several.
-
Daniel M
Mainframe Developer/Senior QA Analyst
-
Steven T
Have coded almost everything from firmware through apps, dev to valid to customer suppport
-
Mikhail B
Seniors Micro-Services consultant
-
James B
Managing Director, Sr PM, Consultant
-
RICHARD V
Electronics Circuit Design Engineer
-
MICHAEL H
SENIOR MANUFACTURING TEST ENGINEER