Vishnu K.

Vishnu K.

Module Lead Software Engineer

Wadgaon , India

Experience: 8 Years

Vishnu

Wadgaon , India

Module Lead Software Engineer

USD / Year

  • Start Date / Notice Period end date:

8 Years

Now you can Instantly Chat with Vishnu!

About Me

Overall 8+ years of experience in IT industry, principally in Big Data Engineering, DevOps, Hadoop Administration, Cloud Technologies (AWS/Palantir Cloud Foundry) and in Application software programming using Java / J2EE. 5.5 Years experience in Hado...

Show More

Portfolio Projects

Description

Involved in Spark Use cases bug fixing, Scheduling, Building, and support on production. Migrating the existing Hadoop Use cases over the Palantir Cloud Foundry environment. Involved in identification and correction of the corrupted and missed records in their Spark use cases. Implementing Batch and Stream Processing transformations to prepare specific combined datasets. Building and scheduling the use case pipelines in production. Setup of health checks monitoring for schedules and builds for respective Datasets. Debugging and Troubleshooting issues and coordination with Data Sources and Hadoop Shares stake holders to provide immediate break through fixes in production. Extensively involved in Hadoop and Spark performance tuning. Client handling and work with them closely to understand and implement the use cases as per their business requirements. Team handling and managing daily tasks/activities. Creating weekly dashboards for client. Coordination and discussion with different Use case owners. Helping new members to onboard and ramp-up them on required technologies stack to start work on Spark use cases.

Show More Show Less

Description

Involved into Cloudera Cluster Administration/Management and in Bare Metal Cluster build for Development, Sandbox and Production environments. Involved in administration tasks like commissioning, decommissioning Datanodes, cluster balancing and troubleshooting runtime Hadoop issues, monitoring cluster health, data cleanup from staging tables and in Performance tuning. Security Implementations and Data Protection like Kerberos, HDFS permissions, HDFS Sentry synchronization and role based access, Log Redaction, SSL / TLS, Certificate signing requests (certificates), Key Trustee Server, KMS, Encryption zones, Navigator encrypt. Handled activities like setup/configurations of HDFS, YARN, HUE, IMPALA High Availability, also setup/configured Kerberos and Sentry in CDH. Ensure complete backup of hive metastore DB and Hadoop namespace (fs_image and edit logs) on NFS. Setting up MySQL replication setup, creation/restoration of incremental and full db dumps. Fully involved in all activities and documentations like Transition, Cluster Build, Benchmarking and Validation. Involved in installing, configuring, testing Hadoop ecosystem components MapReduce/YARN, HDFS, Hive, Impala, Sqoop, Hue, Zookeeper, Spark, Oozie, KMS,KTS and tools like Kerberos, Sentry, Azkaban, Nagios. Installation and configuration of Tableau to test our some use cases during migration activity. Query validation and monitoring implementation. Involved in direct client calls and requirement gatherings.

Show More Show Less

Description

Involved in Cloudera Administration/Management of NGB, NRT and NGRS applications for Production environments. Extensively involved in Hadoop and Spark performance tuning. Involved in Cassandra Cluster management. Involved in HDFS data migration. Involved in implementing fact data reconciliation process. Responsible for administration tasks like commissioning, decommissioning data nodes, cluster balancing and troubleshooting run time Hadoop issues, monitoring cluster health, data cleanup from staging tables. Taking care of Hadoop echo systems and their troubleshooting. Involved in building and managing NiFi/Kafka cluster for production environment and their client. Building CI/CD pipelines using Jenkins. Involved in installing, configuring, testing different versions of CDH and its Hadoop ecosystem components MapReduce/YARN, HDFS, Hive, Impala, Sqoop, Hue, Zookeeper, Spark, Oozie and tools like Nifi, Kafka, Hazelcast, Nagios. Nagios setup and implementing its services for specific application monitoring. Involved in implementing monitoring and alerting utilities using shell script. Involved in direct client call and requirement gathering. Involved in creating documents and handling the processes individually.

Show More Show Less

Description

Involved in coding using Java/J2EE, implementing new criterias under the underwriter auto assignment process, group profile and generates proposal process. Helping team members and non-team members by introducing new product 6.6. Responsible for task estimation, defining story points against the user stories and maintaining root cause against the bug. Involved in maintaining RCA and weekly dashboard. Performing unit tests and writing Junits for implemented codes. Defect fixing and maintaining the whole process of software deployment on Web & Application servers.

Show More Show Less

Description

Involved in coding using Java/J2EE, implemented process to generating proposal and FTP it to file server location for Renewal Process and implementing OE and NOE effective dates process for Enrollment process. Responsible for client handling, task estimation, defining story points against the user stories and maintaining root cause against the bug. Involved in maintaining RCA and weekly dashboard. Performing unit tests and writing Junits for implemented codes. Defect fixing and maintaining the whole process of software deployment on Web & Application servers.

Show More Show Less

Description

Implementing Employee Rate Structure in NHCR and responsible for front end to till back-end implementation for it. Defect fixing and maintaining the whole process of software deployment on Web & Application servers. Involved in Application Migration from WAS 6 to WAS 7. Responsible for client handling, task estimation, implementation of CRs and in maintaining RCA and weekly dashboard.

Show More Show Less

Description

Involved in development of GlidePath from scratch level. Involved in client and server side coding in Spring-MVC. Involved in development of two modules - Journey and Assistance Needs. Involved in developing JSP pages with JavaScript and J-query

Show More Show Less

Description

Involved in development and maintenance of Axiomtec. Involved in implementation of one module Cross Reference in Spring and Hibernate. Writing Hibernate queries using HQL. Developing JSP pages with JSF and Rich Faces

Show More Show Less

Description

Involved in developing JSP pages with JavaScript and J-query. Involved in understanding the flow specifications and responsible for the development of the application which is totally based on MVC architecture. Involved in development and maintenance. Involved in requirements gathering from Client.

Show More Show Less