Description

Design and maintain large-scale data pipelines and architectures using the Cloudera ecosystem.

This role is hybrid.

Responsibilities

• Develop and maintain data pipelines using Cloudera Data Platform for efficient processing and storage.
• Implement and optimize data workflows with Cloudera Hue to enhance accessibility and usability.
• Write and maintain Scala code and optimize Spark applications for large-scale data processing.
• Manage and monitor data clusters using Cloudera tools to ensure high availability and performance.
• Collaborate with cross-functional teams to design scalable data architectures and troubleshoot technical issues.

Required Skills

• 10+ years of professional experience in data engineering.
• Expertise with Cloudera Data Platform, Cloudera Hue, and related Cloudera tools.
• Proficiency in writing and maintaining Scala code for data processing.
• Hands-on experience with Spark and PySpark for data transformation and analysis.
• Cloudera Certified Associate (CCA) Spark and Hadoop Developer certification.
• Cloudera Certified Professional (CCP) Data Engineer certification.
• Strong problem-solving skills for troubleshooting complex data issues.

Preferred Skills

• Experience with additional big data technologies and tools.

Key Skills

Education

Any Graduate