DevOps Engineer

The Linux / Devops Admin will have a deep understanding of Java, Hadoop / Spark / Storm / No SQL / My SQL administration, security and troubleshooting. The Linux / Devops Admin will be an outstanding communicator, creative thinker, and data nerd. 

 Responsible for implementation and ongoing administration of Big Data infrastructure

 Performance tuning of Big Data / cloud environment

 Troubleshooting (Very Important)

 Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Big Data and to expand existing environments.

 Working with data delivery teams to setup new users. This job includes setting up Linux users, setting up Kerberos principals and testing access for the new users.

 Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari and other tools.

 Screen cluster job performances and capacity planning

 Monitor cluster connectivity and security

 Manage and review log files.

 File system management and monitoring.

 SQL (No SQL such as Mongo or Cassandra / My SQL) support and maintenance.

 Collaborating with application teams to install operating system, updates, patches and version upgrades when required.

 Software installation and configuration.

 Database backup and recovery.

 Database connectivity and security.

 Disk Space Management.

 Motivated to work in start-up environment

Requirements

 Experience in cloud providers like AWS, Azure

 Experience in configuration management tool such as Ansible/Terraform

 Experience in CI/CD tool such as Jenkins.

 1+ years of Experience / Knowledge of Java web/application servers, Big Data tools stack, NoSQL databases such as Hbase, Cassandra, MongoDB, Couch, Riak, Redis etc.

 Hadoop skills like Flink, Ranger, Kafka, HBase, Hive, Pig etc.

 Experience on deploying and managing big data and cloud applications to production environment.

 Administrative aspects of Big Data and Big Data Virtual Machines Azure, AWS or other cloud platforms

 Expertise in the following technologies: Core JAVA, Spring, Struts, JSP, Web-services, Gather and process raw data scale using scripts, web scraping, SQL queries, etc.

 Implementing ETL processes

 Experience with various messaging systems, such as Kafka or RabbitMQ.

 Understanding of Lambda Architecture along with its advantages and drawbacks will be a definite plus

 Should possess good analytical and interpersonal communication skills. Able to write and communicate effectively.