Hadoop DevOps Engineer

| Boston

Job Summary

DataRobot has leveraged the power of Hadoop to develop a ground-breaking predictive analytics platform and is seeking experienced Hadoop DevOps Engineer to develop and support integrations with customer environments and Hadoop technologies. As a Hadoop DevOps Engineer at DataRobot you will work with Development, Test Automation, Release Engineering, and Support teams as you bring new features and integrations through the full release cycle from R&D to customer delivery.


  • Develop tools to integrate the product with multiple Hadoop platforms
  • Develop automated build and testing suites to ensure a stable, reliable product
  • Provide third-tier support for customer installations of DataRobot, jumping in for the most technically challenging problems
  • Pairing with and mentoring colleagues

Main Requirements

  • Profound knowledge of at least one Hadoop distribution (Cloudera, Hortonworks, etc.)
  • Deep experience with Hadoop ecosystem security technologies such as Kerberos, LDAP, and Active Directory
  • Detailed knowledge of core Hadoop architecture components (HDFS, YARN, ZooKeeper, etc)
  • 3+ years of experience supporting Hadoop customer integrations
  • 3+ years of experience with administering enterprise production Hadoop clusters
  • 5+ years of experience with Linux system configuration and administration
  • Scripting experience in Python and Bash
  • Excellent written and verbal communication skills
  • Great technical troubleshooting skills
  • Extensive experience as a technical lead

Desired Skills (at least some of the following)

  • Java or Scala programming
  • Experience with Java application lifecycle; development, testing, build, and release
  • Hands-on experience using Hadoop data analysis tools
  • Experience with systems and application performance tuning
  • Experience with complex software packaging, delivery and maintenance
  • Experience with cloud technologies such as AWS
  • Experience with configuration management tools such as Ansible, Puppet, Chef, etc
  • Experience with Docker
  • Previous startup experience
Read Full Job Description
Apply Now
loading ...


1 International Place 5th Floor, Boston, MA 02110
1 International Place 5th Floor, Boston, MA 02110
Similar Jobs in Boston