Raw nested data from multiple sources pushed to the S3 data lakes, this data is divided into multiple marts like member and enrollment, provider, claims, etc. AWS glue crawler crawls the data and creates tables in Athena, where ETL processing happens and processed data is pushed to AWS Redshift, Snowflake

Responsibilities included designing, implementing, and deploying serverless architecture to Perform ETL Processing in a scalable and secured way. Creating and Managing GIT Projects, Setting up User Permissions, and Merge Strategies. Building and maintaining CI/CD Pipelines in GitLab, defining the pipeline's configuration with YAML Scripts. Provisioning AWS resources Using Terraform as Primary IaaC and Serverless framework for Mart-specific resources, pushing code to S3. Post Deployment automation using python and bash. Implementing EMR security configuration by encrypting EBS Volumes. Focused on delivering tightly secured way possible by spinning AWS resources in private subnet and granting granular level IAM permissions. Setting Session Manager policies to connect to EC2 instances. Baking Amazon Machine Images(AMI) using packer, which EMR gets the benefit of custom AMI. Usage of StepFunctions to build data workload pipelines and integrate with other AWS Services. Writing lambdas to alert over usage of EMR, Rotate User Password in redshift, Creating schemas Various other use-cases. Auto-Scaling resources based on resource utilization. Defining tight IAM Roles and Policies, minimal security group rules. Troubleshooting AWS services as and when the team blocked. Proactively monitoring existing platforms to ensure ongoing stability utilizing SRE dashboards and alerts Tracking and reporting key performance indicators for the Release process Qualifications. Worked in systems development life cycle (technical analysis & requirements capturing, development, testing, release, maintenance, and support) Identified build errors in the system and identify the build issue and escalate it to the concerned team after careful analysis. Performed regular DBA activities including space management and performance monitoring.

Dispatch is responsible for setting up organization-level DevOps practices, which can be followed by SREs and other engineering teams. Designing and Implementing Base AWS Resources that every internal AWS Account should contain which enables safe, secured computing and provides standard and stable infrastructure across the environments. Seiji is an internal CLI-Tool developed and maintained by dispatch to orchestrate the deployments

Writing Different GitLab BaseTemplates for different project types like python, java, nodejs, etc Setting up and maintaining GitLab runners on EKS to manage Workloads Baking base AMIs Using Packer with no add-ons and publishing to all the Associated AWS Accounts. Defining VPC, private and public subnets, and security groups associated. Provisioning NAT instances to route traffic in/out to private subnets. Creating S3 buckets, Setting up bucket policies, and object life-cycle rules. Provisioning Redshift, Aurora clusters. writing terraform scripts to provision AWS infrastructure. Defining the instance size and capacity according to the environment type. Writing Lambdas to rotate redshift and other DB Passwords monthly. Setting up cloudwatch rules to make instances go down during non-working times to save AWS Costs. Auditing monthly AWS Costs, and preparing charts to understand areas where costs can be cut down. Configuring Integrations between GitLab and JIRA for effective branching strategy, better tracking merge requests within a given JIRA Story. Configuring Integrations of GitLab, and JIRA within Slack to alert channels with time to time changes. Developed a python based CLI-Tool to run terraform deployment from init to apply. Utilizing the benefits of Dynamo DB to capture various deployment parameters like infrastructure code version, time and date, and success/failure status. Publishing logs to S3, Setting up SNS alerts, Use of KMS keys to encrypt/decrypt EBS volumes. Creating docker images with various packages pre-installed and exporting them ECR, Docker hub. Building and maintaining the Kubernetes platform for automating and orchestrating deployment. Troubleshooting any security, network, and IAM Permission incidents.

Worked as Intern UI Developer Developed a single page web applications with Angular framework. creating signup/login page, product filter rules, sorting rules. implementing e-commerce features Product Catalogs, Add to cart, Add to wishlist. retrieving product images from AWS S3 bucket Hosting the webpage in AWS EC2 Instance with Web Server as Nginx for testing.

Writing Different GitLab BaseTemplates for different project types like python, java, nodejs, etc Setting up and maintaining GitLab runners on EKS to manage Workloads Baking base AMIs Using Packer with no add-ons and publishing to all the Associated AWS Accounts. Defining VPC, private and public subnets, and security groups associated. Provisioning NAT instances to route traffic in/out to private subnets. Creating S3 buckets, Setting up bucket policies, and object life-cycle rules. Provisioning Redshift, Aurora clusters. writing terraform scripts to provision AWS infrastructure. Defining the instance size and capacity according to the environment type. Writing Lambdas to rotate redshift and other DB Passwords monthly. Setting up cloudwatch rules to make instances go down during non-working times to save AWS Costs. Auditing monthly AWS Costs, and preparing charts to understand areas where costs can be cut down. Configuring Integrations between GitLab and JIRA for effective branching strategy, better tracking merge requests within a given JIRA Story. Configuring Integrations of GitLab, and JIRA within Slack to alert channels with time to time changes. Developed a python based CLI-Tool to run terraform deployment from init to apply. Utilizing the benefits of Dynamo DB to capture various deployment parameters like infrastructure code version, time and date, and success/failure status. Publishing logs to S3, Setting up SNS alerts, Use of KMS keys to encrypt/decrypt EBS volumes. Creating docker images with various packages pre-installed and exporting them ECR, Docker hub. Building and maintaining the Kubernetes platform for automating and orchestrating deployment. Troubleshooting any security, network, and IAM Permission incidents. Dispatch is responsible for setting up organization-level DevOps practices, which can be followed by SREs and other engineering teams. Designing and Implementing Base AWS Resources that every internal AWS Account should contain which enables safe, secured computing and provides standard and stable infrastructure across the environments. Seiji is an internal CLI-Tool developed and maintained by dispatch to orchestrate the deployments.