The Lead Hadoop Systems Engineer will be responsible for collaborating with engineering and operations organizations on issues relating to the installation, configuration, and operational support of the Hadoop stack (Hortonworks) and related technologies (e.g. HBase, Hive, and Zookeeper) in multiple development, test, and production environments. This resource is also responsible for handling trouble tickets and service requests concerning Hadoop, and should have the expertise to see those tasks through to closure individually. However, it may require this resource to coordinate with other members of the operations organization as well as software development and infrastructure engineering organizations. This resource may also collaborate on system architecture and engineering efforts concerning Hadoop with the software development organization.

Responsibilities:
• Be the primary point of contact for Hadoop (Hortonworks) ecosystem architecture, systems-level, and network-level knowledge
• Responsible for provisioning, installing, configuring, monitoring, and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive, and Storm-Yarn
• Lead patching and upgrading Hortonworks clusters activities
• Lead and support node failures recovery and common Hadoop cluster issues troubleshooting
• Create and modify scripts for Hadoop package installation and configuration to support fully-automated deployments
• Support Hadoop developers and assisting in optimization of map reduce jobs, Pig Latin scripts, Hive Scripts, and HBase ingest Required
• Make recommendations about Hadoop development and architecture
• Be the primary point of contact for trouble tickets/service requests related to the Hadoop ecosystem
• Create and modify scripts to validate that the Hadoop ecosystem is successfully installed and operating within established parameters
• Collaborate with infrastructure support teams on Hadoop issues that cross engineering domains (e.g. operating systems, storage, networking)
• Ensure developer/user compliance with environment strategy including devising monitoring methodologies and/or processes
• Outline best practices for usage, security controls, version control, code migration, Unix scripting, logging, and other development and deployment procedures

*Must have 4 years degree in Computer science or related field.
*Must have at minimum 5 years of systems experience