Senior Data Operations Engineer

Business Area:

Business Ops & IT

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

We are looking for a motivated and experienced Senior Data Operations Engineer to join our team. At Cloudera, we utilize the same cutting-edge technologies we deliver to our customers, ensuring our business is operationally efficient and data-driven. In this role, you will be responsible for maintaining, upgrading, and expanding our enterprise-scale on premise Hadoop environment, a critical infrastructure for supporting Cloudera's internal data operations. In addition, we are actively working on building a cloud footprint.

As a Senior Data Operations Engineer, you will collaborate closely with various technical teams—including Support, Engineering, and Field teams—to refine and implement best practices for operating and managing an enterprise-scale, multi-tenant Cloudera cluster. You will also contribute to optimizing the cost and efficiency of leveraging cloud technologies, both public and private, to support our infrastructure.

In addition to infrastructure management, you will monitor and improve data flows critical to Cloudera’s operations, working with Data Engineers and Application Developers to enhance job performance and reliability. Your responsibilities will also include performance tuning for Hadoop clusters, and managing key services such as HDFS, Hive, Impala, and Spark.

You'll develop and implement deployment, continuous integration (CI), and DevOps practices to ensure that data operations and applications run smoothly across their lifecycle. Managing the infrastructure for these practices is a key part of this role. Your contributions will be integral to ensuring that Cloudera continues to operate efficiently and that data flows reliably across the organization.

As A Sr. Data Operations Engineer, you will:

• Maintain, upgrade, and expand Cloudera’s enterprise Hadoop cluster, ensuring it meets business-critical needs.

• Collaborate with end users and internal technical teams (Engineering, Support, and Field) to address cluster issues and implement improvements.

• Optimize the use of cloud services (public and/or private) to improve operational efficiency and reduce infrastructure costs.

• Monitor and tune the performance of Hadoop clusters and jobs, particularly Hadoop MapReduce/Spark routines, to ensure high availability and efficiency.

• Support and manage Hadoop services, including HDFS, Hive, Impala, and Spark.

• Implement and refine DevOps practices to simplify and standardize deployments, ensuring reliable operation of applications across their lifecycle.

• Ensure the reliability of data pipelines and critical applications through continuous monitoring and improvements.

• Provide on-call and occasional weekend support as needed to maintain system stability and performance.

We’re excited about you if you have:

• Strong expertise in Cloudera Manager and the broader Hadoop ecosystem.

• Solid Linux OS administration and troubleshooting skills.

• Proven ability to diagnose and resolve issues in complex, unfamiliar systems.

• Working knowledge of SQL for querying and data management tasks.

• Familiarity with containerization technologies like Docker and Kubernetes.

• Excellent collaboration and communication skills for cross-functional teamwork.

You may also have:

• Proficiency in programming languages, especially Python and Bash shell scripting.

• Experience with technologies such as Solr, Spark, Kafka, and Yarn.

• Exposure to cloud platforms like AWS, Azure, Google Cloud, or OpenShift.

• Experience with configuration management tools like SaltStack.

• Familiarity with continuous integration (CI) tools like Jenkins

What you can expect from us:

• Generous PTO Policy 

• Support work life balance with Unplugged Days

• Flexible WFH Policy 

• Mental & Physical Wellness programs 

• Phone and Internet Reimbursement program 

• Access to Continued Career Development 

• Comprehensive Benefits and Competitive Packages 

• Paid Volunteer Time

• Employee Resource Groups

Cloudera is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

#LI-REMOTE

#LI-SZ1