Description

You will administer Cloudera CDP platforms and optimize data processing pipelines using PySpark and Python.

This role is remote.

Responsibilities

• Administer and support Cloudera CDP/CDH platforms, including HDFS, Hive, Spark, YARN, Hue, and CDE.
• Develop, deploy, and optimize PySpark and Python-based data processing solutions for enterprise workloads.
• Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket for automated deployment.
• Integrate security tools like Checkmarx into pipelines and implement governance best practices.
• Write and optimize SQL queries for Hive and Impala to improve performance and ensure system availability.

Required Skills

• 6+ years of experience in data engineering and DevOps automation.
• Hands-on experience with Cloudera CDP/CDH, HDFS, and Spark.
• Proficiency in PySpark, Python, and SQL.
• Experience building CI/CD pipelines with Jenkins.
• Strong understanding of Hive and Impala.
• Linux Administration skills.

Preferred Skills

• Experience with YARN, Hue, and CDE.
• Familiarity with GitHub, Bitbucket, and Checkmarx.
• Knowledge of SAST tools, scripting, and security controls.

Key Skills

Education

Any Graduate