Deep-rooted in engineering and software development, our Data Engineers take a unique approach to building innovative solutions and solving complex data issues for the clients we serve. In this entrepreneurial role, you’ll tackle a wide variety of data engineering challenges and development tasks.

 

• 
  Integrate data from a variety of data sources (data warehouse, data marts) utilizing on-prem or cloud-based data structures (AWS, Azure, GCP); determine new and existing data sources
  


• 
  Develop, implement and optimize data pipelines
  


• 
  Create and execute testing strategies including unit, integration, and full end-to-end tests of data pipelines
  


• 
  Utilize ETL processes to build data repositories; integrate data using Sqoop (batch ingest), Kafka (streaming), Spark, Hive or Impala (transformation)
  


• 
  Adapt and learn new technologies in a quickly changing field
  


• 
  Be creative; evaluate and recommend data driven technologies to solve problems and create solutions
  


• 
  Recommend and implement best tools to ensure optimized data performance; perform Data Analysis utilizing Spark, Hive, and Impala
  


• 
  Work on a variety of internal and open source projects and tools
  

• Previous experience as a Software Engineer, Data Engineer or Data Analytics


• Solid programming experience in Python, Java, Scala, or other statically typed programming language


• Production experience in core data engineering technologies including HDFS, Hive and YARN


• Hands-on experience in one or more ecosystem products/languages such as HBase, Spark, Kafka, Impala, Solr, Kudu, etc


• Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries


• Excellent communication skills; previous experience working with internal or external customers


• Strong analytical abilities; ability to translate business requirements and use cases into a data engineered solution, including ingestion of many data sources, ETL processing, data access, and consumption, as well as custom analytics


• 4 year Bachelor’s Degree in Computer Science or related field