Surya aravind M.
Data Engineer with extensive experience in scalable pipelines, ETL, Python, SQL, and AWS solutions.
West Haven , India
Experience: 1 Year
Data Engineer with extensive experience in scalable pipelines, ETL, Python, SQL, and AWS solutions.
84925 USD / Year
-
Immediate: Available
1 Year
Now you can Instantly Chat with Surya aravind!
About Me
Developed Rest APIs utilizing Node.js, express, MongoDB, and MySQL. leveraged Docker containerization and deployed on EC2. Led data visualization efforts, creating charts and tables, and contributed to nearly 70% of the overall data visualization ...fforts, creating charts and tables, and contributed to nearly 70% of the overall data visualization process by utilizing a diverse set of technologies, including Angular, ReactJS, HTML, SCSS, Redux, and NodeJS. Designed and developed an intuitive and user-friendly Admin panel, empowering efficient management of food and combos listings, orders, and user accounts. Optimized application performance by implementing server-side caching and load-balancing techniques, ensuring smooth operation during high-traffic periods. Integrated AWS S3 for secure and reliable storage of user-uploaded files, such as student documents and classroom materials. Implemented server-side rendering (SSR) for both Angular and React components, improving the applications performance and search engine optimization (SEO) Engineered and managed AWS services, including Amazon EC2 and AWS RDS, ensuring optimal performance, high availability, and scalability of cloud infrastructure and database solutions. Designed and implemented automated backup and recovery processes for AWS RDS databases, optimized database performance, developed robust ETL scripts, and data processing pipelines using Python, and created custom Python modules to enhance workflows. Conducted statistical analysis using SQL, Python, Scala, R, and Excel. Integrated on-premises data sources with cloud platforms using Azure Data Factory and developed CI/CD pipelines within Azure DevOps, automating processes with PowerShell, Bash, YAML, , GIT, and ARM templates.
Show MoreSkills
-
-
-
- 1 Years
Intermediate
-
-
- 1 Years
Beginner
-
-
-
-
-
-
-
-
-
-
-
- 1 Years
Beginner
-
-
- 1 Years
Beginner
-
-
- 1 Years
Beginner
-
- 2 Years
Beginner
-
-
-
- 1 Years
Intermediate
-
-
-
- 3 Years
Beginner
-
- 1 Years
Intermediate
-
- 3 Years
Intermediate
-
- 1 Years
Beginner
-
-
-
-
- 3 Years
Intermediate
-
- 1 Years
Intermediate
-
-
-
-
-
-
-
-
-
-
- 2 Years
Advanced
-
-
- 1 Years
Intermediate
-
-
-
-
-
- 1 Years
Intermediate
-
- 3 Years
Intermediate
-
-
-
-
- 3 Years
Beginner
-
- 1 Years
Beginner
-
- 2 Years
Intermediate
-
-
-
-
-
- 3 Years
Intermediate
-
-
-
- 1 Years
Beginner
-
- 3 Years
Intermediate
-
- 1 Years
Beginner
-
-
-
-
-
-
-
-
-
- 1 Years
Beginner
-
- 3 Years
Beginner
-
-
- 3 Years
Intermediate
-
-
-
- 1 Years
Beginner
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Portfolio Projects
Description
Used Python and Selenium to crawl data from e-commerce sites for specific zip codes and times. Managed tasks and dependencies with Apache Airflow to automate data collection. Stored data in Amazon S3 buckets and queried data using AWS Athena and generated business reports. Monitored real-time data with Kafka and Kibana. Applied machine learning for brand analytics to identify products across e-commerce sites. Designed and managed scalable data pipelines, developed and maintained API integrations, and ensured data integrity through ETL processes.
Show More Show LessVerifications
-
Phone Verified
Preferred Language
-
English - Fluent
-
Hindi - Conversational
Available Timezones
BROWSE SIMILAR DEVELOPER
-
KULJIT S
Corporate Mgmt. – PMG, HR, legal, MIS/ERP
-
Tommy L
Senior System Software Engineer
-
Ray G
Jack of all trades, master of several.
-
Steven T
Have coded almost everything from firmware through apps, dev to valid to customer suppport
-
Mikhail B
Seniors Micro-Services consultant
-
Eric A
Embedded Engineer
-
Thamil S
Project Manager
-
Terry L
SAS Consultant
-
Jeffrey L
Cisco Network and Voice Engineer with heavy Linux / C / PHP / Python programming background
-
Olaf C
Senior AI, Cognitive & Automation Architect Azure/Quantum Hybrid Architect